Live data from Hacker News

OpenAI's Foundry leaked pricing says a lot

cognitiverevolution.substack.com

161–170 of 214 posts

Re: OpenAI's Foundry leaked pricing says a lot

#161
post #107

Earlier quoted context omitted.

> And we’re about to plug them straight into critical business flows? Anyone who thinks this is a problem has never managed flesh-and-blood employees, and especially not minimum wage ones. LLMs don't need to be perfect. The bar they need to meet for a lot of work is just not very high. We're also about a year or two into LLMs, and their capabilities are still increasing rapidly. We don't know where their ceiling is.…

> Anyone who thinks this is a problem has never managed flesh-and-blood employees, and especially not minimum wage ones. I’ve worked with minimum wage employees. I’ve even worked with people who insist against all evidence and questioning that basic facts about reality like the year are contrary to known reality. I’ve never in my now very aging career worked with any such person who can influence billions of people b…

I worked with people ranging from minimum wage to absurd salaries, read SVPs. And the latter group was by far more prone to ignore the actual year, color of the sky or wether water is wet than the former. The former is usually also better at following basic instructions and processes.

Judging from where I stand atm, I guess the SVP kind of functions are easier to replace by ChatGPT (writting pointless emails ignoring simple facts for example) than the minimun wage work involving actual work (solving invoice problems or moving stuff reliably from A to B).

Re: OpenAI's Foundry leaked pricing says a lot

#162
post #41
post #7

The Foundry pricing, $78,000 for a few months minimum, is absolutely the opposite of Open. It could completely kill my small startup if the API goes from less than a penny per request to requiring a huge up-front investment. It means that anyone bootstrapping is now locked out.

Good. I’m tired of fly by night tech bros flooding the markets with shitty AI business ideas they learned about on Youtube. Pay to play. Take a risk. Like a real entrepreneur. I hope the price goes even higher.

Thank you, arbiter of real entrepreneurship.

Tell me again about the projects you’ve launched during your time as a founder.

Wait…

Re: OpenAI's Foundry leaked pricing says a lot

#163
post #107

Earlier quoted context omitted.

> And we’re about to plug them straight into critical business flows? Anyone who thinks this is a problem has never managed flesh-and-blood employees, and especially not minimum wage ones. LLMs don't need to be perfect. The bar they need to meet for a lot of work is just not very high. We're also about a year or two into LLMs, and their capabilities are still increasing rapidly. We don't know where their ceiling is.…

> Anyone who thinks this is a problem has never managed flesh-and-blood employees, and especially not minimum wage ones. I’ve worked with minimum wage employees. I’ve even worked with people who insist against all evidence and questioning that basic facts about reality like the year are contrary to known reality. I’ve never in my now very aging career worked with any such person who can influence billions of people b…

Perhaps not minimum wage employees, but there have certainly been plenty of politicians who have spouted far worse.

Re: OpenAI's Foundry leaked pricing says a lot

#164

Earlier quoted context omitted.

Typically an agent of the company can act within their realm of authority. A human CSA can give you a discount, and that is usually binding. They can't declare X corp is going to mail a box of donuts to you every day for the rest of your life and have it be. So my expectation would be (in the absence of real world cases currently) that if you negotiate the AI into giving you a 10% discount on your bill.. it would be…

As usual courts will also look at the evidence (aka the whole Transcript) and it'll matter whether the AI made a mistake on it's own (ie. Hallucinating an additional plausible rebate) or whether the customer performed an obvious prompt injection attack. A judge will not look favorably on your 5000 token prompt of carefully selected instructions telling the AI to go wild

> A judge will not look favorably on your 5000 token prompt of carefully selected instructions telling the AI to go wild

But one day maybe even the judge will be an AI...

Re: OpenAI's Foundry leaked pricing says a lot

#165
post #7

The Foundry pricing, $78,000 for a few months minimum, is absolutely the opposite of Open. It could completely kill my small startup if the API goes from less than a penny per request to requiring a huge up-front investment. It means that anyone bootstrapping is now locked out.

Why would you start a company that is entirely dependent on a third party’s closed product, over which you have zero control? This just feels immensely risky.

Starting a company is risky. If everyone thinks like you, it creates an opportunity to create a product that doesn't exist. And yes, there's a risk.

Re: OpenAI's Foundry leaked pricing says a lot

#166
post #74
post #66

The single most valuable thing that Microsoft/OpenAI could use ChatGPT for, is to periodically crawl the sprawling SharePoint sites, Teams chat logs, and Github codebases for large companies. Having a customized ChatGPT for your company could be very valuable. That is assuming of course, that it doesn't just hallucinate a bunch of bullshit and can link back to the source documents, which BingGPT has had minimal succe…

Unless I miss my guess, the models that the big corporate cos pay millions for will not "just hallucinate a bunch of bullshit". It's the models that consumers have access to via APIs that will be decidedly less effective. The AI that makes movies for Disney will far outperform whatever movies the rest of us can put together on Stability's successors. If you thought the digital divide was bad, well, you ain't seen not…

> AI that makes movies for Disney

At least, for now, works entirely made by AI aren't eligible for copyright, so we'll have to change the law before we see things like that.

Re: OpenAI's Foundry leaked pricing says a lot

#167

Earlier quoted context omitted.

That would presumably be treated the same as a human CSA doing the same thing.

Typically an agent of the company can act within their realm of authority. A human CSA can give you a discount, and that is usually binding. They can't declare X corp is going to mail a box of donuts to you every day for the rest of your life and have it be. So my expectation would be (in the absence of real world cases currently) that if you negotiate the AI into giving you a 10% discount on your bill.. it would be…

[deleted]

Re: OpenAI's Foundry leaked pricing says a lot

#168

> This really should not be a surprise, because even the standard-issue ChatGPT can pass the Bar Exam No, it can’t. The two things that together have sometimes gotten misrepresented that way in “game of telephone” presentations are: (1) that when tested on the multiple choice component of the multistate bar exam (not the whole bar exam), it got passing grades in two subjects (evidence and torts), not the whole multip…

That's not even the important point. ChatGPT can't do anything. It exhibits behavior that was already encapsulated into the semantics of language itself. The only behavior ChatGPT has is to generate semantic continuations from its implicit language model. Every other behavior is a feature of language, not of ChatGPT. Even if ChatGPT could exhibit a passing exam, that would be the feature of carefully curated language…

How do we prove that there is a meaningful distinction between a sufficiently advanced "feature of carefully curated language in [an entity's] dataset" and general intelligence? Is there such a meaningful distinction?

Re: OpenAI's Foundry leaked pricing says a lot

#169
post #3

>Handle customer interactions – natural language Q&A, appointment setting, account management, and even tech support, available 24/7, pick up right where you left off, and switch from text to voice as needed. Customer service and experience will improve dramatically. For example, Microsoft will let companies create their own custom versions of ChatGPT — read here. If I can prompt-hack your ChatGPT customer service ag…

Presumably the same is true for social engineering people - the original "prompt hacking"? I've had customer service interactions that didn't go the way I wanted, hung up, and tried again with a friendlier person. Not sure how "binding" most customer service promises are either - have you ever had to call Comcast? Broken promises are the only promises. Also, if you can lower your customer service costs by 90%, maybe…

I could see a combination of a disclaimer and passing the output of the customer services AI through a "verification AI" that is fed a prompt along the line of a list of what the customer service AI is allowed to promise and the response, and asked to confirm whether or not they are in conflict.

Re: OpenAI's Foundry leaked pricing says a lot

#170
post #94
post #2

It looks like OpenAI's first mover advantage won't last long, considering the speed at which these models are improving and compacting themselves. Seems like this new 'Moore's law' will be even more steep, at least in the beginning . So steep, that we can hope to be running these in our desktops instead of on someone else's computer.

We saw the same phenomenon with DALL-E. It was state-of-the-art for a blip in time before Midjourney and StableDiffusion surpassed it. And now with ControlNet + the ecosystem of domain-specific models, if you're doing serious generative art, OpenAI isn't even a part of the conversation. If OpenAI makes their revenue off of charging exorbitant fees to use the LLMs, they'll no longer have incentive to ever open them (e…

Midjourney and StableDiffusion have not surpassed Dall-E for many types of image. They are still well behind in certain critical factors. I often jump to Dall-E when I hit a brick wall with SD.

My money is on Deep Floyd (if and when it gets released)

Post reply on HN