Live data from Hacker News

OpenAI's Foundry leaked pricing says a lot

cognitiverevolution.substack.com

71–80 of 214 posts

Re: OpenAI's Foundry leaked pricing says a lot

#71
> Attention mechanism inference costs rise with the square of the inference window.

This is incorrect. It is correct for the original Transformer, but OpenAI isn't using the original Transformer since GPT-3. Sparse Transformer scales O(N sqrt(N)).

https://openai.com/research/sparse-transformer

Re: OpenAI's Foundry leaked pricing says a lot

#72

Earlier quoted context omitted.

Open access for a fee? Yes. The original point of openAI was to make sure google and facebook don't completely dominate AI and keep their work hidden due to the innovator's dilemma they face. Seems like they've absolutely accomplished that. Yes, they've stretched the meaning of "open" but I don't think they've ever tried to claim they had some sort of open source aspirations.

OpenAI = Microsoft, which you have conveniently left out in your FAANG enumeration

Because Microsoft was in no way a leader in AI research when openAI was founded. But the important part here isn't keeping AI work from being dominated by big tech. It's to keep it from being hidden from the public by big tech.

Re: OpenAI's Foundry leaked pricing says a lot

#73
post #65

Earlier quoted context omitted.

This answers the question I’ve had. How do they make money? It was naive to think we could have all this innovation for a penny. Someone has to pay those bills. How does Bing plan to monetize searches that go through their even more advanced ChatGPT? Humans will be repulsed by ads in the middle of their answer from a sentient feeling AI. Numbers I’ve seen is that ChatGPT searches will cost 10x a Google search. How do…

When you're watching a movie, and the main character picks up a can of Coca Cola while typing on a Microsoft Surface laptop, with the logos conveniently rotated toward the camera, it's obvious that Coke and Microsoft are paying the studio for product placement. AI advertising will be like this, but subtle and undetectable, so that it's nearly impossible to determine that your conversation about malfeasance by a polit…

In many jurisdictions that kind of subtle product placement is not legal.

Re: OpenAI's Foundry leaked pricing says a lot

#74
post #66

The single most valuable thing that Microsoft/OpenAI could use ChatGPT for, is to periodically crawl the sprawling SharePoint sites, Teams chat logs, and Github codebases for large companies. Having a customized ChatGPT for your company could be very valuable. That is assuming of course, that it doesn't just hallucinate a bunch of bullshit and can link back to the source documents, which BingGPT has had minimal succe…

Unless I miss my guess, the models that the big corporate cos pay millions for will not "just hallucinate a bunch of bullshit". It's the models that consumers have access to via APIs that will be decidedly less effective. The AI that makes movies for Disney will far outperform whatever movies the rest of us can put together on Stability's successors.

If you thought the digital divide was bad, well, you ain't seen nothing yet.

Re: OpenAI's Foundry leaked pricing says a lot

#75
post #26
post #12

Earlier quoted context omitted.

They only require an up front payment if you're renting a dedicated instance.

Yeah but will "DV" be available any other way?

Have you ever heard of a "digital divide"?

Well get ready to hear about an "AI divide"?

Most of us are just on the wrong side of it this time.

Re: OpenAI's Foundry leaked pricing says a lot

#76

Earlier quoted context omitted.

> Add to the fact that LLMs perform much better on questions with a lot of training data. The answer key can get a 100% on the exam.

Would a human with a photographic memory count as possessing an answer key?

Yes, also a human with an answer key.

Re: OpenAI's Foundry leaked pricing says a lot

#77
People don't yet understand where the value for AI services are. Most of the hype is coming from technology-centric sources and so isn't considering the tech in practical terms. The idea that any business would use AI in a decision making capacity is absolutely absurd and irresponsible. As it stands today, while AI may help filter and suggest, there will always be a person at the end of the decision-making process. Evangelizing the tech with unsubstantiated assumptions doesn't help legitimize it.

Re: OpenAI's Foundry leaked pricing says a lot

#78

> This really should not be a surprise, because even the standard-issue ChatGPT can pass the Bar Exam No, it can’t. The two things that together have sometimes gotten misrepresented that way in “game of telephone” presentations are: (1) that when tested on the multiple choice component of the multistate bar exam (not the whole bar exam), it got passing grades in two subjects (evidence and torts), not the whole multip…

"No, it can’t."

Will it turn up in court - in person? I'm fairly sure that the Bar requires a corpus vivens for its representatives. I've probably got the Latin very badly wrong ...

Re: OpenAI's Foundry leaked pricing says a lot

#79

Earlier quoted context omitted.

OpenAI = Microsoft, which you have conveniently left out in your FAANG enumeration

Because Microsoft was in no way a leader in AI research when openAI was founded. But the important part here isn't keeping AI work from being dominated by big tech. It's to keep it from being hidden from the public by big tech.

Can you elaborate on the last sentence?

Re: OpenAI's Foundry leaked pricing says a lot

#80
post #78

> This really should not be a surprise, because even the standard-issue ChatGPT can pass the Bar Exam No, it can’t. The two things that together have sometimes gotten misrepresented that way in “game of telephone” presentations are: (1) that when tested on the multiple choice component of the multistate bar exam (not the whole bar exam), it got passing grades in two subjects (evidence and torts), not the whole multip…

"No, it can’t." Will it turn up in court - in person? I'm fairly sure that the Bar requires a corpus vivens for its representatives. I've probably got the Latin very badly wrong ...

There was an attempt at that.. https://news.ycombinator.com/item?id=34529340
Post reply on HN