Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI's plans according to sama

humanloop.com

Post reply on HN
Print view View original

91–100 of 269 posts

Re: OpenAI's plans according to sama

#91

Post by Terretta »

BeenAGoodUser wrote: post #72

Nice to see they are working on reducing the pricing. GPT-4 is just too expensive right now imo. A long conversation would quickly end up costing tens of dollars if not more, so less expensive model costs + stateful API is urgently needed. I think even OpenAI will actually gain a lot by reducing the pricing, right now I wouldn't be surprised if many uses of GPT-4 weren't viable just because of the costs.

This is off by probably x10 or more.

Dozens of people using it daily for coding and conversations and review in a month might be a couple hundred bucks. All day convo, constantly, as fast as it can respond, might add up to $5.

Not sure what kind of convo you're having that you could hit $10 unless you're parallelizing with something like the "guidance" tool or langchain.

Re: OpenAI's plans according to sama

#92

Post by thelittleone »

cwkoss wrote: post #17

I love the tongue-in-cheek paradox myth that the Bitcoin whitepaper was written by a future god-AI to increase demand for GPUs (and thus boost supply) so we are able to assemble the future god-AI.

Conceptually this is paradoxical because of the notion that time is linear. Which it is to the best of our current understanding.

Re: OpenAI's plans according to sama

#93

Post by ilaksh »

londons_explore wrote: post #5

> is limited by GPU availability. Which is all the more curious, considering OpenAI said this only in January: > Azure will remain the exclusive cloud provider for all OpenAI workloads across our research, API and products [1] So... OpenAI is severely GPU constrained, it is hampering their ability to execute, onboard customers to existing products and launch products. Yet they signed an agreement not to just go rent…

AWS might not really have much extra GPU capacity for them anyway.. also they would cost more.

I think that there aren't a lot of GPUs available and it takes time to add more to the datacenter even when you do get them.

Re: OpenAI's plans according to sama

#94

Post by CSMastermind »

cwkoss wrote: post #19
boringuser2 wrote: post #3

>Dedicated capacity offering is limited by GPU availability. OpenAI also offers dedicated capacity, which provides customers with a private copy of the model. To access this service, customers must be willing to commit to a $100k spend upfront. How many shell corporations are intelligence agencies seeding right now?

Last night I was musing how many different countries' intelligence agencies have moles working at OpenAI currently. Gotta be at least 6, maybe as high as two dozen?

US, France, Israel ... then who? Maybe another five eyes country like the UK? Possibly China? I'm pretty skeptical Russia would be able to get someone in there but maybe.

Re: OpenAI's plans according to sama

#95

Post by ilaksh »

dr_dshiv wrote: post #80

> OpenAI will avoid competing with their customers — other than with ChatGPT. Quite a few developers said they were nervous about building with the OpenAI APIs when OpenAI might end up releasing products that are competitive to them. Sam said that OpenAI would not release more products beyond ChatGPT. He said there was a history of great platform companies having a killer app and that ChatGPT would allow them to make…

I think the tricky part for me is that "work" is extremely broad and now that ChatGPT has plugins, it can kind of do anything. Heh.

Re: OpenAI's plans according to sama

#96

Post by CSMastermind »

yesimahuman wrote: post #11

The bit about plugins not having PMF is interesting and possibly flawed. I, like many others, got access to plugins but not the browsing or code interpreter plugins which feel like the bedrock plugins that make the whole offering useful. I think there's also just education that has to happen to teach users how to effectively use other plugins, and the UX isn't really there to help new users figure out what to even do…

Have you found plugins to be useful?

For what it's worth I've found the model actually performs significantly worse at most tasks when given access to browsing, in part because it relies on that instead of its own in built knowledge.

I haven't found a good way to have it only access the web for specific parts of its response.

Re: OpenAI's plans according to sama

#97

Post by ilaksh »

asnyder wrote: post #18

His statements on open sourcing in this interview/write-up is somewhat in conflict with his recent statement made last week in Munich https://youtu.be/uaQZIK9gvNo?t=1170 , where he explicitly said the Frontier of GPT won't be open sourced due to what they perceive as safety reasons, https://youtu.be/uaQZIK9gvNo?t=1170 (19:30 - 22:00).

He was talking about open sourcing GPT-3. That is not the frontier.

The frontier is the multimodal versions of GPT-4 which he just said wasn't even going to public release until next year. Or whatever they are on now which they are carefully not calling GPT-5.

Re: OpenAI's plans according to sama

#98

Post by jameshart »

boringuser2 wrote: post #71
layer8 wrote: post #70

Earlier quoted context omitted.

Someone without family?

You know the next step, right?

ChatGPT responds by threatening to torture a simulation of the agents’ consciousness in the cloud for eternity?

(I mean, since we’re just making up wild hypotheticals)

Re: OpenAI's plans according to sama

#99

Post by ilaksh »

sovietmudkipz wrote: post #7

I’m hoping GPT will remove the information cutoff date. I write plenty of terraform/AWS and it’s a bit of a pain that the latest API isn’t accessible by GPT yet. There’s been quite a bit happening in the programming space since sept 2021. I use GPT to keep things high level and then do my normal research methodology for implementation details.

As stated your request is entirely impossible. They cannot simply "remove the cut-off date". It takes months and huge amounts of hardware to train. Then they do the reinforcement adjustments on top of it while researching how to train the next batch.

Re: OpenAI's plans according to sama

#100

Post by mkoubaa »

cwkoss wrote: post #17

I love the tongue-in-cheek paradox myth that the Bitcoin whitepaper was written by a future god-AI to increase demand for GPUs (and thus boost supply) so we are able to assemble the future god-AI.

Then that god AI must have also pulled some strings for early video games
Post reply on HN