Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI's Foundry leaked pricing says a lot

cognitiverevolution.substack.com

Post reply on HN
Print view View original

61–70 of 214 posts

Re: OpenAI's Foundry leaked pricing says a lot

#61

Post by aperrien »

whatshisface wrote: post #35
klabb3 wrote: post #31

Earlier quoted context omitted.

Correct me if I’m wrong but aren’t virtually all tests and exams designed to minimize ambiguity, make them fair or easy to grade and questions are designed to have a clear correct answer? This is a stark difference to most real-world human activity. Add to the fact that LLMs perform much better on questions with a lot of training data. And also add the hallucinations or more generally: they don’t ask for help or admi…

> Add to the fact that LLMs perform much better on questions with a lot of training data. The answer key can get a 100% on the exam.

Would a human with a photographic memory count as possessing an answer key?

Re: OpenAI's Foundry leaked pricing says a lot

#62

Post by JohnFen »

MichaelZuo wrote: post #56
dragonwriter wrote: post #22

> This really should not be a surprise, because even the standard-issue ChatGPT can pass the Bar Exam No, it can’t. The two things that together have sometimes gotten misrepresented that way in “game of telephone” presentations are: (1) that when tested on the multiple choice component of the multistate bar exam (not the whole bar exam), it got passing grades in two subjects (evidence and torts), not the whole multip…

Well the first paper's authors does say: "While our ability to interpret these results is limited by nascent scientific understanding of LLMs and the proprietary nature of GPT, we believe that these results strongly suggest that an LLM will pass the MBE component of the Bar Exam in the near future."

Which is an overt admission that LLMs can't pass the bar exam right now.

Re: OpenAI's Foundry leaked pricing says a lot

#63

Post by JohnFen »

3throwaway3141 wrote: post #24
ccakes wrote: post #23

> Streamline hiring – in such a hot market, personalizing outreach, assessing resumes, summarizing & flagging profiles, and suggesting interview questions. For companies who have an overabundance of candidates, perhaps even conducting initial interviews? That's a hiring red flag if I've ever seen one. The nightmare dystopia is just around the corner it seems.

Dystopia? I think of it as a great comedy! We could be only months away from the first-ever hire where both the applicant and the company have automated the entire process and may not even realize there's been an accepted offer.

Dystopian comedies are a thing.

Re: OpenAI's Foundry leaked pricing says a lot

#64

Post by woeirua »

mc32 wrote: post #25
buildbot wrote: post #13

Earlier quoted context omitted.

Nobody is doing this, unless you have a source you would like to link?

According to this survey: https://it.slashdot.org/story/23/02/27/009234/survey-claims-... "Earlier this month, job advice platform Resumebuilder.com surveyed 1,000 business leaders who either use or plan to use ChatGPT. It found that nearly half of their companies have implemented the chatbot. And roughly half of this cohort say ChatGPT has already replaced workers at their companies...." There are anecdotes elsewher…

Yeah, I'm going to need some names here for companies, because there is no way 50% of the Fortune 500 have done _anything_ productive with ChatGPT in less than a month.

Re: OpenAI's Foundry leaked pricing says a lot

#65

Post by panarky »

Mistletoe wrote: post #53
ilaksh wrote: post #7

The Foundry pricing, $78,000 for a few months minimum, is absolutely the opposite of Open. It could completely kill my small startup if the API goes from less than a penny per request to requiring a huge up-front investment. It means that anyone bootstrapping is now locked out.

This answers the question I’ve had. How do they make money? It was naive to think we could have all this innovation for a penny. Someone has to pay those bills. How does Bing plan to monetize searches that go through their even more advanced ChatGPT? Humans will be repulsed by ads in the middle of their answer from a sentient feeling AI. Numbers I’ve seen is that ChatGPT searches will cost 10x a Google search. How do…

When you're watching a movie, and the main character picks up a can of Coca Cola while typing on a Microsoft Surface laptop, with the logos conveniently rotated toward the camera, it's obvious that Coke and Microsoft are paying the studio for product placement.

AI advertising will be like this, but subtle and undetectable, so that it's nearly impossible to determine that your conversation about malfeasance by a political candidate is being invisibly influenced by his political campaign.

Re: OpenAI's Foundry leaked pricing says a lot

#66

Post by woeirua »

The single most valuable thing that Microsoft/OpenAI could use ChatGPT for, is to periodically crawl the sprawling SharePoint sites, Teams chat logs, and Github codebases for large companies. Having a customized ChatGPT for your company could be very valuable. That is assuming of course, that it doesn't just hallucinate a bunch of bullshit and can link back to the source documents, which BingGPT has had minimal success with so far.

Re: OpenAI's Foundry leaked pricing says a lot

#67

Post by MichaelZuo »

JohnFen wrote: post #62
MichaelZuo wrote: post #56

Earlier quoted context omitted.

Well the first paper's authors does say: "While our ability to interpret these results is limited by nascent scientific understanding of LLMs and the proprietary nature of GPT, we believe that these results strongly suggest that an LLM will pass the MBE component of the Bar Exam in the near future."

Which is an overt admission that LLMs can't pass the bar exam right now.

ChatGPT 2.0 being able to do so would still be pretty relevant.

Re: OpenAI's Foundry leaked pricing says a lot

#68

Post by gigel82 »

buildbot wrote: post #13
mc32 wrote: post #9

With reports[1] (maybe exaggerated, maybe apocryphal) of companies replacing FTEs with chatGPT, even at these high prices, it may make sense in some use cases, no, tho presumably this kills the playpen use cases. [1] https://it.slashdot.org/story/23/02/27/009234/survey-claims-...

Nobody is doing this, unless you have a source you would like to link?

No link, but I heard rumors from someone at MS that themselves heard rumors (so take that as it is) that higher-ups ran pre-release next-gen GPT models on Office source code (millions of lines of MS-specific pre-standard C++ code) and tasked the model to implement a feature which it did flawlessly.

Don't know if that's a rumor some VP started spreading to justify the culling coming next week (bulk of the layoffs) or something real (I personally doubt the anecdote but you never know).

Re: OpenAI's Foundry leaked pricing says a lot

#69

Post by meghan_rain »

xwdv wrote: post #41
ilaksh wrote: post #7

The Foundry pricing, $78,000 for a few months minimum, is absolutely the opposite of Open. It could completely kill my small startup if the API goes from less than a penny per request to requiring a huge up-front investment. It means that anyone bootstrapping is now locked out.

Good. I’m tired of fly by night tech bros flooding the markets with shitty AI business ideas they learned about on Youtube. Pay to play. Take a risk. Like a real entrepreneur. I hope the price goes even higher.

And 90% of it is "Summarize your XXX" because it's the easiest prompt on OpenAI

Re: OpenAI's Foundry leaked pricing says a lot

#70

Post by meghan_rain »

HDThoreaun wrote: post #39
gjsman-1000 wrote: post #17

So much for "Open" AI. Open-source algorithm? No. Open access for free, or reasonable prices? No. Open emails and conversations of directors (accountability)? No. Open conversations of issues and ethics? No.

Open access for a fee? Yes. The original point of openAI was to make sure google and facebook don't completely dominate AI and keep their work hidden due to the innovator's dilemma they face. Seems like they've absolutely accomplished that. Yes, they've stretched the meaning of "open" but I don't think they've ever tried to claim they had some sort of open source aspirations.

OpenAI = Microsoft, which you have conveniently left out in your FAANG enumeration
Post reply on HN