Live data from Hacker News

OpenAI's Foundry leaked pricing says a lot

cognitiverevolution.substack.com

81–90 of 214 posts

Re: OpenAI's Foundry leaked pricing says a lot

#81
post #71

> Attention mechanism inference costs rise with the square of the inference window. This is incorrect. It is correct for the original Transformer, but OpenAI isn't using the original Transformer since GPT-3. Sparse Transformer scales O(N sqrt(N)). https://openai.com/research/sparse-transformer

Gpt3 includes dense attention layers that are n^2

Re: OpenAI's Foundry leaked pricing says a lot

#82
Around $250k for getting your own chatGPT. Sounds reasonable.

Of course this is for the enterprises. It's upto their managers to define how they can extract $250k worth of value from the investment which I think is easy given the AI frenzy.

Of course for startups they will have to use the direct OpenAI API on a pay per use model.

One question that is not clear, can I take a ChatGPT instance and provide an API similar to OpenAI API and charge for it?

Re: OpenAI's Foundry leaked pricing says a lot

#83

Earlier quoted context omitted.

Because Microsoft was in no way a leader in AI research when openAI was founded. But the important part here isn't keeping AI work from being dominated by big tech. It's to keep it from being hidden from the public by big tech.

Can you elaborate on the last sentence?

Google and Facebook have long had language models that have been reported to be vastly superior to what was publicly available. The one that a Google engineer claimed was sentient was the most well known example. OpenAI was founded in reaction to these models being hidden away.

Re: OpenAI's Foundry leaked pricing says a lot

#84
post #23

> Streamline hiring – in such a hot market, personalizing outreach, assessing resumes, summarizing & flagging profiles, and suggesting interview questions. For companies who have an overabundance of candidates, perhaps even conducting initial interviews? That's a hiring red flag if I've ever seen one. The nightmare dystopia is just around the corner it seems.

And I don't think "hot market" means what they think it means. Yes it is a hot market. Unemployment is at 3.4%, close to historic lows. The tech sector is even tighter. If you ask applicants to first get interviewed by a chat bot they are going to tell you to f off.

Re: OpenAI's Foundry leaked pricing says a lot

#85
post #84
post #23

> Streamline hiring – in such a hot market, personalizing outreach, assessing resumes, summarizing & flagging profiles, and suggesting interview questions. For companies who have an overabundance of candidates, perhaps even conducting initial interviews? That's a hiring red flag if I've ever seen one. The nightmare dystopia is just around the corner it seems.

And I don't think "hot market" means what they think it means. Yes it is a hot market. Unemployment is at 3.4%, close to historic lows. The tech sector is even tighter. If you ask applicants to first get interviewed by a chat bot they are going to tell you to f off.

I really dont see the reason to be upset here. If someone is asking me to interview with AI I’m going to have my own model take the interview - problem solved

Re: OpenAI's Foundry leaked pricing says a lot

#87

> This really should not be a surprise, because even the standard-issue ChatGPT can pass the Bar Exam No, it can’t. The two things that together have sometimes gotten misrepresented that way in “game of telephone” presentations are: (1) that when tested on the multiple choice component of the multistate bar exam (not the whole bar exam), it got passing grades in two subjects (evidence and torts), not the whole multip…

Well, I _might_ be able to teach an AI how to do effective legal research and writing, or even to do pre and post trial discovery, but representing someone at trial? Not without full immunity from malpractice liability. It would be fun to see how an AI handled cross examination of a hostile witness, or dealt with a response to their hearsay objection like, "res gestae!".

Still, a sophisticated AI could be a real help in transactional legal matters like contracts, real estate, taxes, wills and trusts where boilerplate abounds. As far as grades go, my average in law school was C+ (I'd never seen a blue book before that first final -- in college it was all research papers), but I was also one of the 48% who passed a certain state's bar exam in 1982. So there is hope for those AIs who dream of a future in the legal profession.

Or maybe they'd just wind up as a sysadmin for a Fortune 200 company, and never regret it.

Re: OpenAI's Foundry leaked pricing says a lot

#88

> This really should not be a surprise, because even the standard-issue ChatGPT can pass the Bar Exam No, it can’t. The two things that together have sometimes gotten misrepresented that way in “game of telephone” presentations are: (1) that when tested on the multiple choice component of the multistate bar exam (not the whole bar exam), it got passing grades in two subjects (evidence and torts), not the whole multip…

"This talking dog is a dumbass. It can only pass HALF the bar exam. I don't see what all the hype is about."

Not sure that's the indictment you and other ChatGPT detractors are presenting it as.

Re: OpenAI's Foundry leaked pricing says a lot

#89
post #65

Earlier quoted context omitted.

When you're watching a movie, and the main character picks up a can of Coca Cola while typing on a Microsoft Surface laptop, with the logos conveniently rotated toward the camera, it's obvious that Coke and Microsoft are paying the studio for product placement. AI advertising will be like this, but subtle and undetectable, so that it's nearly impossible to determine that your conversation about malfeasance by a polit…

In many jurisdictions that kind of subtle product placement is not legal.

How about prohibitions on product use, like Apple phones not being usable by villains?

Re: OpenAI's Foundry leaked pricing says a lot

#90
post #87

> This really should not be a surprise, because even the standard-issue ChatGPT can pass the Bar Exam No, it can’t. The two things that together have sometimes gotten misrepresented that way in “game of telephone” presentations are: (1) that when tested on the multiple choice component of the multistate bar exam (not the whole bar exam), it got passing grades in two subjects (evidence and torts), not the whole multip…

Well, I _might_ be able to teach an AI how to do effective legal research and writing, or even to do pre and post trial discovery, but representing someone at trial? Not without full immunity from malpractice liability. It would be fun to see how an AI handled cross examination of a hostile witness, or dealt with a response to their hearsay objection like, "res gestae!". Still, a sophisticated AI could be a real help…

I have read enough bad lawsuits to believe an AI could be better than most pro se litigants.
Post reply on HN