Best gimmick ever. This did work out on me to get me subscribed ;)
OpenAI has temporarily stopped selling the Plus plan
41–50 of 63 posts
Re: OpenAI has temporarily stopped selling the Plus plan
#42The comments are so ignorant it's unreal. I think the OpenAI team is doing their best. I've heard it's actually hard to scale an app to 100+ million users
Its Open so you can just grab a copy and spin up your own version ... /s
Re: OpenAI has temporarily stopped selling the Plus plan
#43Best gimmick ever. This did work out on me to get me subscribed ;)
OO I can still subscribe ... I have only used it once or twice in the last 6 months, but if I dont subscribe now I might not be able to ever again ...
Re: OpenAI has temporarily stopped selling the Plus plan
#44from the reddit comments: > I bought it and it was removed off of my account. I paid money for a feature I never got. Anyone else get this? It look like a very bad experience. if i were him, i would issue a credit card charge back
I’d at least give them an opportunity to fix and make me whole before jumping to charge backs.
Re: OpenAI has temporarily stopped selling the Plus plan
#45Earlier quoted context omitted.
I mean, that might be the cost for a onesie-twosie in Azure, but if you're microsoft and you own the hardware, the cost may be one or more orders of magnitude less than that. (Of course, there's just a limit on the number of GPUs that exist and that Nvidia can pump out.)
Microsoft's profit margin for "intelligent cloud" in their most recent earnings was less than 50%. Impressive, but not nearly enough to make GPT subscriptions make financial sense.
And a lot of that is marketing, keeping unused capacity in reserve, etc. Microsoft can probably afford a very low price without losing money if they price the compute at-cost. Certainly less than $7/request. 70 teraflop per request, and an $8000 GPU, with $2k of server overhead, $10k in power and cooling costs, $20k total for 312 teraflops of compute, leased for 2 years gives you an at-cost hardware price of $0.00007/request: https://www.google.com/search?q=%2420000*70/(312*3600*24*365...
So even assuming just a 1% utilization rate, you’re still talking less than 1 cent per request.
Remember, inference runs at reduced precision. FP16 (or even just 8 bit) is WAY cheaper than fp64 bit. More than an order of magnitude cheaper. 9.7Tflops vs 312Tflops, factor of 32 improvement.
With sparse matrix and 8-bit precision, you can effectively get over 100x the performance on an A100 than with FP64, plus the memory requirements are more than an order of magnitude less. Factor of 128 improvement in processing speed plus at least a factor of 8-16 or more improvement in tokens per memory, depending on sparsity. (Sparsity and reduced precision do reduce performance for the same number of operations and weights, but the overall effect on performance from reducing precision is beneficial probably at least to 4-bit quantization… You get diminishing or negative returns if you go less than that with current architectures, but in principle we can keep going.)
https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...
I think your compute cost figure is both very old and probably assumes double precision whereas GPT-3 uses at most FP16 at inference and GPT-4 may go beyond that.
Re: OpenAI has temporarily stopped selling the Plus plan
#46Earlier quoted context omitted.
They are just giving away GPT-3 grade queries. In terms of revenue, that's NaN% gross margin! Thus, -10,000% gross margin is quite the improvement. While I personally don't think that they are spending quite that much on compute, burning investor capital to build a customer base is a time honored tradition. Which means we can't really deduce that because -10,000% is such a big number, that can't possibly be their com…
Was this written by gpt?
If you ask ChatGPT what 1/0 is, you get a paragraph as to why it's undefined. Nowhere does it use the phrase "NaN". Perhaps you need to adjust your humor filter, LLMs aren't quite there enough to be able to use NaN% in context as a joke like that.
Also:
> Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something.
https://news.ycombinator.com/newsguidelines.html
If you're going to accuse me of using ChatGPT, at least bother to say why.
Re: OpenAI has temporarily stopped selling the Plus plan
#47From my experience with their Plus plan GPT 4 usually just times out no matter what the prompt, forcing me to revert to 3.5. I'm not sure why I haven't asked for a refund yet.
I find the OpenAI API Playground is more reliable. It’s less convenient than ChatGPT Plus, but I’ve not had many timeouts. Plus, you can always use Bing Chat. It’s more locked down, but depending on what you’re doing, it’s pretty good and backed by GPT-4.
The Playground doesn't have GPT-4 API yet.
As for Bing, despite the claims that it is GPT-4, it's clearly inferior to what OpenAI is offering. It's probably an older iteration of the model, and I wonder if it might also be a scaled-down version to run it cheaper at scale.
Re: OpenAI has temporarily stopped selling the Plus plan
#48Earlier quoted context omitted.
Basic common sense would tell you that starting with an assumption and working backwards to justify that assumption is called succumbing to confirmation bias. I sourced my cost/flop estimate from here: https://aiimpacts.org/2019-recent-trends-in-gpu-price-per-fl... I'll acknowledge that a fleet entirely made up of A100 GPUs running at full capacity 100% of the time with Azure's 3-year commitment pricing (likely very…
You can be sure Open AI isn't even paying Azure's punlishedy 3-year commitment pricing rate. The other thing to note is that OpenAI limits paying users to X queries per Y hours in GPT-4, something like 3 per 5. Which means the GPT-4 fleet is quite limited.
GPT-4 cap is currently at 25 messages every 3 hours.
It also keeps saying "expect significantly lower caps, as we adjust for demand", but it's been three weeks now and they haven't lowered it yet.
Re: OpenAI has temporarily stopped selling the Plus plan
#49Earlier quoted context omitted.
Was this written by gpt?
If you ask ChatGPT what 1/0 is, you get a paragraph as to why it's undefined. Nowhere does it use the phrase "NaN". Perhaps you need to adjust your humor filter, LLMs aren't quite there enough to be able to use NaN% in context as a joke like that. Also: > Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something. https://news.ycombinator.com/newsguidelines.h…
It really shouldn't use the word NaN in any case, since 1/0 would be +Inf. Meanwhile, here's what GPT-4 had to say (after refusing to talk about percentages at all at first because it is "impossible to calculate"):
>> ... suppose you're describing this to a technical audience - software engineers, specifically. There might be some way to talk about percentages concisely in that particular context.
> In that case, you could describe the situation to a technical audience by saying, "The company's profit margin is effectively -∞% due to offering the product for free while incurring expenses."
Re: OpenAI has temporarily stopped selling the Plus plan
#50Earlier quoted context omitted.
They apparently got a lot of Azure credits and Microsoft isn't making any revenue from running OpenAI's workloads.
Creating credits out of thin air is impossible as all financial transactions must be accounted for. In the case of Azure credits, they will appear as increased revenue on Microsoft's balance sheet. However, if Microsoft decides to price Azure services below cost as part of their agreement with OpenAI, their profit margins will be affected. I highly doubt that is the case because the alleviation of cost is in the form…
It will, hence the MSFT layoffs happening at the same time.
People here wanted Google scale of operations and replacing Google with ChatGPT as their search engine.
But it seems that some here have forgotten about the high availability requirements and incalculable operational costs of running a search engine. Google.com's availability is a very high barrier of serving in the multi-billions of searches a day.
Azure has lots of experience in unreliability and running services at a massive loss whilst minting credits to compete on cost.