Live data from Hacker News

OpenAI's Foundry leaked pricing says a lot

cognitiverevolution.substack.com

1–10 of 214 posts

Re: OpenAI's Foundry leaked pricing says a lot

#2
It looks like OpenAI's first mover advantage won't last long, considering the speed at which these models are improving and compacting themselves. Seems like this new 'Moore's law' will be even more steep, at least in the beginning . So steep, that we can hope to be running these in our desktops instead of on someone else's computer.

Re: OpenAI's Foundry leaked pricing says a lot

#3
>Handle customer interactions – natural language Q&A, appointment setting, account management, and even tech support, available 24/7, pick up right where you left off, and switch from text to voice as needed. Customer service and experience will improve dramatically. For example, Microsoft will let companies create their own custom versions of ChatGPT — read here.

If I can prompt-hack your ChatGPT customer service agent into giving me a discount or accepting an otherwise invalid return or giving me an appointment at 3AM, how binding is that? And if the answer is "obviously it's not binding!", why should I trust anything else your bot tells me?

Re: OpenAI's Foundry leaked pricing says a lot

#4
post #2

It looks like OpenAI's first mover advantage won't last long, considering the speed at which these models are improving and compacting themselves. Seems like this new 'Moore's law' will be even more steep, at least in the beginning . So steep, that we can hope to be running these in our desktops instead of on someone else's computer.

but what kind of model will run in the cloud?

Re: OpenAI's Foundry leaked pricing says a lot

#5
post #3

>Handle customer interactions – natural language Q&A, appointment setting, account management, and even tech support, available 24/7, pick up right where you left off, and switch from text to voice as needed. Customer service and experience will improve dramatically. For example, Microsoft will let companies create their own custom versions of ChatGPT — read here. If I can prompt-hack your ChatGPT customer service ag…

That would presumably be treated the same as a human CSA doing the same thing.

Re: OpenAI's Foundry leaked pricing says a lot

#6
post #3

>Handle customer interactions – natural language Q&A, appointment setting, account management, and even tech support, available 24/7, pick up right where you left off, and switch from text to voice as needed. Customer service and experience will improve dramatically. For example, Microsoft will let companies create their own custom versions of ChatGPT — read here. If I can prompt-hack your ChatGPT customer service ag…

Presumably the same is true for social engineering people - the original "prompt hacking"? I've had customer service interactions that didn't go the way I wanted, hung up, and tried again with a friendlier person. Not sure how "binding" most customer service promises are either - have you ever had to call Comcast? Broken promises are the only promises.

Also, if you can lower your customer service costs by 90%, maybe accepting some prompt hacking that erodes margins a little is a good tradeoff?

Re: OpenAI's Foundry leaked pricing says a lot

#7
The Foundry pricing, $78,000 for a few months minimum, is absolutely the opposite of Open. It could completely kill my small startup if the API goes from less than a penny per request to requiring a huge up-front investment. It means that anyone bootstrapping is now locked out.

Re: OpenAI's Foundry leaked pricing says a lot

#8
post #2

It looks like OpenAI's first mover advantage won't last long, considering the speed at which these models are improving and compacting themselves. Seems like this new 'Moore's law' will be even more steep, at least in the beginning . So steep, that we can hope to be running these in our desktops instead of on someone else's computer.

but what kind of model will run in the cloud?

We could call it a weather model

Re: OpenAI's Foundry leaked pricing says a lot

#9
With reports[1] (maybe exaggerated, maybe apocryphal) of companies replacing FTEs with chatGPT, even at these high prices, it may make sense in some use cases, no, tho presumably this kills the playpen use cases.

[1]https://it.slashdot.org/story/23/02/27/009234/survey-claims-...

Re: OpenAI's Foundry leaked pricing says a lot

#10
post #2

It looks like OpenAI's first mover advantage won't last long, considering the speed at which these models are improving and compacting themselves. Seems like this new 'Moore's law' will be even more steep, at least in the beginning . So steep, that we can hope to be running these in our desktops instead of on someone else's computer.

but what kind of model will run in the cloud?

A model that augments the local? Runs above it? A supermodel?
Post reply on HN