Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI's plans according to sama

humanloop.com

Post reply on HN
Print view View original

101–110 of 269 posts

Re: OpenAI's plans according to sama

#101

Post by ilaksh »

mustacheemperor wrote: post #21
sovietmudkipz wrote: post #7

I’m hoping GPT will remove the information cutoff date. I write plenty of terraform/AWS and it’s a bit of a pain that the latest API isn’t accessible by GPT yet. There’s been quite a bit happening in the programming space since sept 2021. I use GPT to keep things high level and then do my normal research methodology for implementation details.

I enjoy using GPT4 as a co-programmer, and funny enough it is very challenging to get advice on Microsoft's own .NET MAUI because that framework was in prerelease at the time the model was trained. My understanding is right now they essentially need to train a new model on a new updated corpus to fix this, but maybe some other techniques could be devised...or they'll train something more up to date.

You might actually get pretty far if you just went through the Microsoft docs and created a bunch of really concise examples and fed that as the start of the prompt. Use like 6-7kb for that and then the question at the end.

Re: OpenAI's plans according to sama

#102

Post by ilaksh »

ren_engineer wrote: post #55
atemerev wrote: post #10

All AI companies (OpenAI included) are now working full tilt on making AIs improve themselves (writing their own code, inventing new pipelines etc). I don't know why choose anything else to work on. This is a prime directive, that will bring the greatest payoff.

if this was currently possible wouldn't it lead to sentient/superhuman AI rapidly? >tell AI to make itself more efficient by finding performance improvements in human written code >that newly available processing power can now be used to find more ways to improve itself >flywheel effect of AI improving itself as it gets smarter and smarter eventually you'd turn it loose on improving the actual hardware it runs on. I…

Within a couple of years of improvement processes like you suggest will actually be really dangerous and stupid.

Also don't confuse all other types of human/animal characteristics like sentience with intelligence. They are different things. Things like sentience, subjective stream of experience, or other aspects of being alive don't just accidentally fall out of larger training datasets.

And we should be glad. The models are going to be orders of magnitude faster (and perhaps X times higher IQ) than humans within a few years. It is incredibly foolish to try to make something like that into a living creature (or emulation of living).

Re: OpenAI's plans according to sama

#103

Post by jiggawatts »

londons_explore wrote: post #5

> is limited by GPU availability. Which is all the more curious, considering OpenAI said this only in January: > Azure will remain the exclusive cloud provider for all OpenAI workloads across our research, API and products [1] So... OpenAI is severely GPU constrained, it is hampering their ability to execute, onboard customers to existing products and launch products. Yet they signed an agreement not to just go rent…

One of Azure's unique offerings is very large HPC clusters with GPUs. You can deploy ~1,000 node scale sets with very high speed networking. AWS has many single-server GPU offerings, but nothing quite like what Azure has.

Don't assume Microsoft is bad at everything and that AWS is automatically superior at all product categories...

Re: OpenAI's plans according to sama

#104

Post by refulgentis »

tivert wrote: post #83
anamexis wrote: post #79

Earlier quoted context omitted.

But not before ramping up development and production of GPUs.

> But not before ramping up development and production of GPUs. Did the GPU manufactures ever embrace cryptocurrency? IIRC, they actually tried to discourage it (e.g. by butting throttling into mass market models to discourage their use for computation). Also, the graphs here show a long-term downward trend, with only a short-term sales blip 5 years ago due to cryptocurrency: https://www.tomshardware.com/news/sales-o…

Desktops is a very very key word there, I believe that’s why they repeat it so much. And it’s all tongue in cheek, and we all largely understand mining drove up gpu demand

Re: OpenAI's plans according to sama

#105

Post by refulgentis »

ftxbro wrote: post #73
boringuser2 wrote: post #3

>Dedicated capacity offering is limited by GPU availability. OpenAI also offers dedicated capacity, which provides customers with a private copy of the model. To access this service, customers must be willing to commit to a $100k spend upfront. How many shell corporations are intelligence agencies seeding right now?

I had been putting theories in comments but they kept getting flagged or banned or downvoted to oblivion, but maybe its time has come. I'll keep it tame. If you are curious you can google connections of OpenAI board of directors, Will Hurd, In-Q-Tel trustees, Allen and Company, etc. There is more but whatever. The conspiracy theory is that 'the govt stepped in' during the six month pause after gpt-4 was trained and b…

It probably keeps getting flagged because it’s ahistorical, source: OpenAI engineers, and #2 somewhat obviously so. You heard of RLHF?

Re: OpenAI's plans according to sama

#106

Post by jiggawatts »

dr_dshiv wrote: post #80

> OpenAI will avoid competing with their customers — other than with ChatGPT. Quite a few developers said they were nervous about building with the OpenAI APIs when OpenAI might end up releasing products that are competitive to them. Sam said that OpenAI would not release more products beyond ChatGPT. He said there was a history of great platform companies having a killer app and that ChatGPT would allow them to make…

Is this guy Aes Sedai?

Technically he can claim that OpenAI will not release competing products while Microsoft plugs AI into everything.

Microsoft just announced at Build 2023 that they'll have OpenAI tech integrated with: Windows, Bing, Outlook, Word, Teams, Visual Studio, Visual Studio Code, Microsoft Fabric, Dynamics, GitHub, Azure DevOps, and Logic Apps. I probably missed a bunch.

Very soon now, everything Microsoft sells will have OpenAI integration.

Unless you're selling a niche product too small for Microsoft to bother with, you're competing directly against OpenAI.

Oh, and to top it off: Microsoft can use GPT 4 all they want, via API access. Third parties have to beg and plead to get rate-limited access. That access can be withdrawn at any time if you're doing something unsafe to OpenAI's profit margins.

"Please Sir Sam, may I have some GPT please?"

"No."

Re: OpenAI's plans according to sama

#107

Post by invaliduser »

CSMastermind wrote: post #94
cwkoss wrote: post #19

Earlier quoted context omitted.

Last night I was musing how many different countries' intelligence agencies have moles working at OpenAI currently. Gotta be at least 6, maybe as high as two dozen?

US, France, Israel ... then who? Maybe another five eyes country like the UK? Possibly China? I'm pretty skeptical Russia would be able to get someone in there but maybe.

Hi. French here. I may be wrong, but I really feel like you are overestimating us.

Re: OpenAI's plans according to sama

#108

Post by refulgentis »

Terretta wrote: post #91
BeenAGoodUser wrote: post #72

Nice to see they are working on reducing the pricing. GPT-4 is just too expensive right now imo. A long conversation would quickly end up costing tens of dollars if not more, so less expensive model costs + stateful API is urgently needed. I think even OpenAI will actually gain a lot by reducing the pricing, right now I wouldn't be surprised if many uses of GPT-4 weren't viable just because of the costs.

This is off by probably x10 or more. Dozens of people using it daily for coding and conversations and review in a month might be a couple hundred bucks. All day convo, constantly, as fast as it can respond, might add up to $5. Not sure what kind of convo you're having that you could hit $10 unless you're parallelizing with something like the "guidance" tool or langchain.

Absolutely not. Dinner just got here, but tl;dr gpt4 is 0.03 per 750 words in 0.06 per 750 words out. People except the history to be included as well

Re: OpenAI's plans according to sama

#109

Post by refulgentis »

alchemist1e9 wrote: post #84
sashank_1509 wrote: post #48

Really great news to give at cheaper and faster GPT4. As a GPT+ subscriber, the most annoying thing is the 25 message limit every 3 hours, I really want that removed. A bit sad to hear that the multimodal model will only come next year, was hoping to get it this year 100k to 1 Million context length, sounds phenomenal especially if it comes to GPT4. I've used Claudes 100k context length and I found it so useful that…

Did you have any tips on how you got access to Claude? I do the request access but never get any email or any contact.

Poe, I’m in the same boat btw

Re: OpenAI's plans according to sama

#110

Post by jiggawatts »

Terretta wrote: post #91
BeenAGoodUser wrote: post #72

Nice to see they are working on reducing the pricing. GPT-4 is just too expensive right now imo. A long conversation would quickly end up costing tens of dollars if not more, so less expensive model costs + stateful API is urgently needed. I think even OpenAI will actually gain a lot by reducing the pricing, right now I wouldn't be surprised if many uses of GPT-4 weren't viable just because of the costs.

This is off by probably x10 or more. Dozens of people using it daily for coding and conversations and review in a month might be a couple hundred bucks. All day convo, constantly, as fast as it can respond, might add up to $5. Not sure what kind of convo you're having that you could hit $10 unless you're parallelizing with something like the "guidance" tool or langchain.

The version of GPT 4 with 32K token context length is the enabler for a huge range of "killer apps", but is even more expensive than the 8K version.

And yes, parallelism and loops are also key enablers for advanced use-cases.

For example, I have a lot of legacy code that needs uplifting. I'd love to be able to run different prompts over reams of code in parallel, iterating the prompts, etc...

The point of these things is that they're like humans you can clone at will.

The ability to point thousands of these things at a code base could be mindblowing.

Post reply on HN