> Attention mechanism inference costs rise with the square of the inference window. This is incorrect. It is correct for the original Transformer, but OpenAI isn't using the original Transformer since GPT-3. Sparse Transformer scales O(N sqrt(N)). https://openai.com/research/sparse-transformer
OpenAI's Foundry leaked pricing says a lot
81–90 of 214 posts
Re: OpenAI's Foundry leaked pricing says a lot
#82Of course this is for the enterprises. It's upto their managers to define how they can extract $250k worth of value from the investment which I think is easy given the AI frenzy.
Of course for startups they will have to use the direct OpenAI API on a pay per use model.
One question that is not clear, can I take a ChatGPT instance and provide an API similar to OpenAI API and charge for it?
Re: OpenAI's Foundry leaked pricing says a lot
#83Earlier quoted context omitted.
Because Microsoft was in no way a leader in AI research when openAI was founded. But the important part here isn't keeping AI work from being dominated by big tech. It's to keep it from being hidden from the public by big tech.
Can you elaborate on the last sentence?
Re: OpenAI's Foundry leaked pricing says a lot
#84> Streamline hiring – in such a hot market, personalizing outreach, assessing resumes, summarizing & flagging profiles, and suggesting interview questions. For companies who have an overabundance of candidates, perhaps even conducting initial interviews? That's a hiring red flag if I've ever seen one. The nightmare dystopia is just around the corner it seems.
Re: OpenAI's Foundry leaked pricing says a lot
#85> Streamline hiring – in such a hot market, personalizing outreach, assessing resumes, summarizing & flagging profiles, and suggesting interview questions. For companies who have an overabundance of candidates, perhaps even conducting initial interviews? That's a hiring red flag if I've ever seen one. The nightmare dystopia is just around the corner it seems.
And I don't think "hot market" means what they think it means. Yes it is a hot market. Unemployment is at 3.4%, close to historic lows. The tech sector is even tighter. If you ask applicants to first get interviewed by a chat bot they are going to tell you to f off.
Re: OpenAI's Foundry leaked pricing says a lot
#86You can read a full screenshot of the google doc that OpenAI shared publicly with partners in that thread, including pricing info.
Re: OpenAI's Foundry leaked pricing says a lot
#87> This really should not be a surprise, because even the standard-issue ChatGPT can pass the Bar Exam No, it can’t. The two things that together have sometimes gotten misrepresented that way in “game of telephone” presentations are: (1) that when tested on the multiple choice component of the multistate bar exam (not the whole bar exam), it got passing grades in two subjects (evidence and torts), not the whole multip…
Still, a sophisticated AI could be a real help in transactional legal matters like contracts, real estate, taxes, wills and trusts where boilerplate abounds. As far as grades go, my average in law school was C+ (I'd never seen a blue book before that first final -- in college it was all research papers), but I was also one of the 48% who passed a certain state's bar exam in 1982. So there is hope for those AIs who dream of a future in the legal profession.
Or maybe they'd just wind up as a sysadmin for a Fortune 200 company, and never regret it.
Re: OpenAI's Foundry leaked pricing says a lot
#88> This really should not be a surprise, because even the standard-issue ChatGPT can pass the Bar Exam No, it can’t. The two things that together have sometimes gotten misrepresented that way in “game of telephone” presentations are: (1) that when tested on the multiple choice component of the multistate bar exam (not the whole bar exam), it got passing grades in two subjects (evidence and torts), not the whole multip…
Not sure that's the indictment you and other ChatGPT detractors are presenting it as.
Re: OpenAI's Foundry leaked pricing says a lot
#89Earlier quoted context omitted.
When you're watching a movie, and the main character picks up a can of Coca Cola while typing on a Microsoft Surface laptop, with the logos conveniently rotated toward the camera, it's obvious that Coke and Microsoft are paying the studio for product placement. AI advertising will be like this, but subtle and undetectable, so that it's nearly impossible to determine that your conversation about malfeasance by a polit…
In many jurisdictions that kind of subtle product placement is not legal.
Re: OpenAI's Foundry leaked pricing says a lot
#90> This really should not be a surprise, because even the standard-issue ChatGPT can pass the Bar Exam No, it can’t. The two things that together have sometimes gotten misrepresented that way in “game of telephone” presentations are: (1) that when tested on the multiple choice component of the multistate bar exam (not the whole bar exam), it got passing grades in two subjects (evidence and torts), not the whole multip…
Well, I _might_ be able to teach an AI how to do effective legal research and writing, or even to do pre and post trial discovery, but representing someone at trial? Not without full immunity from malpractice liability. It would be fun to see how an AI handled cross examination of a hostile witness, or dealt with a response to their hearsay objection like, "res gestae!". Still, a sophisticated AI could be a real help…