Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI's Foundry leaked pricing says a lot

cognitiverevolution.substack.com

Post reply on HN
Print view View original

101–110 of 214 posts

Re: OpenAI's Foundry leaked pricing says a lot

#101

Post by CamperBob2 »

dragonwriter wrote: post #100
CamperBob2 wrote: post #88

Earlier quoted context omitted.

"This talking dog is a dumbass. It can only pass HALF the bar exam. I don't see what all the hype is about." Not sure that's the indictment you and other ChatGPT detractors are presenting it as.

The claim in the article is that stock GPT can pass the bar exam today. It cannot. Period. That claim is simply false. It is also false that it “can pass HALF the bar exam.” It passed 2 of 7 sections of the MBE, which is used as the multiple choice part of bar exams (which typically also include essay and practical portions)

I stand corrected

Re: OpenAI's Foundry leaked pricing says a lot

#102

Post by koolba »

ianmcgowan wrote: post #6
Imnimo wrote: post #3

>Handle customer interactions – natural language Q&A, appointment setting, account management, and even tech support, available 24/7, pick up right where you left off, and switch from text to voice as needed. Customer service and experience will improve dramatically. For example, Microsoft will let companies create their own custom versions of ChatGPT — read here. If I can prompt-hack your ChatGPT customer service ag…

Presumably the same is true for social engineering people - the original "prompt hacking"? I've had customer service interactions that didn't go the way I wanted, hung up, and tried again with a friendlier person. Not sure how "binding" most customer service promises are either - have you ever had to call Comcast? Broken promises are the only promises. Also, if you can lower your customer service costs by 90%, maybe…

> Not sure how "binding" most customer service promises are either - have you ever had to call Comcast? Broken promises are the only promises.

For literally fun and profit, record your customer service calls with $FACELESS_CORP (for bonus points tell the customer service rep it’s for “quality assurance purposes”).

I haven’t yet had the joy of playing one back to get them to uphold a verbal agreement. The mere threat of having a recording has always gotten them to magically restore whatever special deal or terms I had previously negotiated.

Re: OpenAI's Foundry leaked pricing says a lot

#103

Post by fragsworth »

gateorade wrote: post #92
ilaksh wrote: post #7

The Foundry pricing, $78,000 for a few months minimum, is absolutely the opposite of Open. It could completely kill my small startup if the API goes from less than a penny per request to requiring a huge up-front investment. It means that anyone bootstrapping is now locked out.

Why would you start a company that is entirely dependent on a third party’s closed product, over which you have zero control? This just feels immensely risky.

It's the only service available that does this and you want to get ahead of it. Presumably, some competitors will show up and you should be able to switch. Prices will go down as competition pops up and they make things more efficient.

Re: OpenAI's Foundry leaked pricing says a lot

#104

Post by zamnos »

gateorade wrote: post #92
ilaksh wrote: post #7

The Foundry pricing, $78,000 for a few months minimum, is absolutely the opposite of Open. It could completely kill my small startup if the API goes from less than a penny per request to requiring a huge up-front investment. It means that anyone bootstrapping is now locked out.

Why would you start a company that is entirely dependent on a third party’s closed product, over which you have zero control? This just feels immensely risky.

Realistically, if you start a business, there are tons of such dependencies. If that's too scary for you, you're probably too risk adverse to be an entrepreneur.

Re: OpenAI's Foundry leaked pricing says a lot

#105

Post by beakerbreaker »

antondd wrote: post #99
3throwaway3141 wrote: post #24

Earlier quoted context omitted.

Dystopia? I think of it as a great comedy! We could be only months away from the first-ever hire where both the applicant and the company have automated the entire process and may not even realize there's been an accepted offer.

I tend to update my CV on a yearly basis regardless of whether I’m looking for a job or not. This year I used ChatGPT to write up my most recent role. After some minor tweaks it wrote it as good as I would have done - using the same language, tone, etc. I can see this working other way around: if I get a pile of CVs for a role I’m hiring for I’m going to use ChatGPT to summarise candidates’ skills. I’m not sure how w…

I think the interesting consequence is that candidates can expect this to happen and with access to the same consumer-facing models, they can then optimize their CV for an ideal summary.

Re: OpenAI's Foundry leaked pricing says a lot

#106

Post by unclad5968 »

zamnos wrote: post #104
gateorade wrote: post #92

Earlier quoted context omitted.

Why would you start a company that is entirely dependent on a third party’s closed product, over which you have zero control? This just feels immensely risky.

Realistically, if you start a business, there are tons of such dependencies. If that's too scary for you, you're probably too risk adverse to be an entrepreneur.

All those dependencies usually have alternatives though

Re: OpenAI's Foundry leaked pricing says a lot

#107

Post by blagie »

klabb3 wrote: post #31
dragonwriter wrote: post #22

> This really should not be a surprise, because even the standard-issue ChatGPT can pass the Bar Exam No, it can’t. The two things that together have sometimes gotten misrepresented that way in “game of telephone” presentations are: (1) that when tested on the multiple choice component of the multistate bar exam (not the whole bar exam), it got passing grades in two subjects (evidence and torts), not the whole multip…

Correct me if I’m wrong but aren’t virtually all tests and exams designed to minimize ambiguity, make them fair or easy to grade and questions are designed to have a clear correct answer? This is a stark difference to most real-world human activity. Add to the fact that LLMs perform much better on questions with a lot of training data. And also add the hallucinations or more generally: they don’t ask for help or admi…

> And we’re about to plug them straight into critical business flows?

Anyone who thinks this is a problem has never managed flesh-and-blood employees, and especially not minimum wage ones. LLMs don't need to be perfect. The bar they need to meet for a lot of work is just not very high.

We're also about a year or two into LLMs, and their capabilities are still increasing rapidly. We don't know where their ceiling is. They might plateau where they are, improve slowly, improve linearly, follow Moore's Law, or head off for singularity.

Re: OpenAI's Foundry leaked pricing says a lot

#108

Post by dragonwriter »

croddin wrote: post #80
gerdesj wrote: post #78

Earlier quoted context omitted.

"No, it can’t." Will it turn up in court - in person? I'm fairly sure that the Bar requires a corpus vivens for its representatives. I've probably got the Latin very badly wrong ...

There was an attempt at that.. https://news.ycombinator.com/item?id=34529340

Yeah, the Robot Lawyer is having some legal issues.

https://twitter.com/DoNotPayNYSCEF

Re: OpenAI's Foundry leaked pricing says a lot

#109

Post by tmaly »

seydor wrote: post #2

It looks like OpenAI's first mover advantage won't last long, considering the speed at which these models are improving and compacting themselves. Seems like this new 'Moore's law' will be even more steep, at least in the beginning . So steep, that we can hope to be running these in our desktops instead of on someone else's computer.

Will be interesting to see what Nvidia H100s will do to the scene and what will come after them.

Re: OpenAI's Foundry leaked pricing says a lot

#110

Post by thomastjeffery »

dragonwriter wrote: post #22

> This really should not be a surprise, because even the standard-issue ChatGPT can pass the Bar Exam No, it can’t. The two things that together have sometimes gotten misrepresented that way in “game of telephone” presentations are: (1) that when tested on the multiple choice component of the multistate bar exam (not the whole bar exam), it got passing grades in two subjects (evidence and torts), not the whole multip…

That's not even the important point.

ChatGPT can't do anything. It exhibits behavior that was already encapsulated into the semantics of language itself.

The only behavior ChatGPT has is to generate semantic continuations from its implicit language model.

Every other behavior is a feature of language, not of ChatGPT.

Even if ChatGPT could exhibit a passing exam, that would be the feature of carefully curated language in its dataset; not a feature of ChatGPT itself.

Post reply on HN