What would happen to Nvidia, Anthropic, OpenAI, if tomorrow someone released an open weights model on HuggingFace that matched performance and accuracy of Opus 5 running locally on an RTX 5070? That won’t happen tomorrow, but it will likely happen someday… what’s the plan beyond “don’t be the one holding the bags?”
Nvidia dramatically reduces amount of OpenAI infra financing it may guarantee
11–20 of 161 posts
Re: Nvidia dramatically reduces amount of OpenAI infra financing it may guarantee
#12What would happen to Nvidia, Anthropic, OpenAI, if tomorrow someone released an open weights model on HuggingFace that matched performance and accuracy of Opus 5 running locally on an RTX 5070? That won’t happen tomorrow, but it will likely happen someday… what’s the plan beyond “don’t be the one holding the bags?”
I guess I'd like to understand the technical reasoning on how you think an how an Opus 5 could over time fit on an RTX 5070.
Re: Nvidia dramatically reduces amount of OpenAI infra financing it may guarantee
#13What would happen to Nvidia, Anthropic, OpenAI, if tomorrow someone released an open weights model on HuggingFace that matched performance and accuracy of Opus 5 running locally on an RTX 5070? That won’t happen tomorrow, but it will likely happen someday… what’s the plan beyond “don’t be the one holding the bags?”
It seems very very unlikely that an Opus 5 matching local model that runs on a 5070 will be released within the next 5 years (I don't want to say "ever").
If it does happen then NVidia will sell a lot of 5070s though!
Re: Nvidia dramatically reduces amount of OpenAI infra financing it may guarantee
#14What would happen to Nvidia, Anthropic, OpenAI, if tomorrow someone released an open weights model on HuggingFace that matched performance and accuracy of Opus 5 running locally on an RTX 5070? That won’t happen tomorrow, but it will likely happen someday… what’s the plan beyond “don’t be the one holding the bags?”
Nothing would really change IMO? 99% of users don't have anything like a RTX5070 (mobile especially).
Even if it did, it still doesn't make much economic sense running a model locally vs on a datacentre.
For example, I managed to just about squeeze a Q2 quant of Qwen 3.7 27b on my 9070XT. I get around 60tps decode (slightly faster prefill). _but_ it uses 300W of power to do so. At UK electricity rates of 30c/kWh this works out at something like 42c/MTok. I can get far far better models on openrouter cheaper than that, plus I'm not horrendously constrained on context length.
Re: Nvidia dramatically reduces amount of OpenAI infra financing it may guarantee
#15I would like to see the numbers. If Nvidia sells hardware for $100B with 75% cross margin, and provides $50 billion in backstop for that same hardware, it would be still be nicely profitable deal ($25B) if the backstop capacity would be a total write-off recovering $0. Reselling that capacity in some large discount below already low backstop price would increase the profits. It's all those pension funds, sovereign we…
Pretty much, I have said it for a while now, Softbank and Oracle are the ones I would be worried about. Both of them have put their companies wealth behind this, if it goes down so will they.
Others have played it fairly smart in terms of insulating potential issues.
Re: Nvidia dramatically reduces amount of OpenAI infra financing it may guarantee
#16I would like to see the numbers. If Nvidia sells hardware for $100B with 75% cross margin, and provides $50 billion in backstop for that same hardware, it would be still be nicely profitable deal ($25B) if the backstop capacity would be a total write-off recovering $0. Reselling that capacity in some large discount below already low backstop price would increase the profits. It's all those pension funds, sovereign we…
Pretty much, I have said it for a while now, Softbank and Oracle are the ones I would be worried about. Both of them have put their companies wealth behind this, if it goes down so will they. Others have played it fairly smart in terms of insulating potential issues.
A better world is just a few steps away
Re: Nvidia dramatically reduces amount of OpenAI infra financing it may guarantee
#17In other words: the investments that were never going to happen are not going to happen.
While it is true they haven't lost anything, it does signal to shareholders, potential share holders and current VC's the direction of things.
Re: Nvidia dramatically reduces amount of OpenAI infra financing it may guarantee
#18What would happen to Nvidia, Anthropic, OpenAI, if tomorrow someone released an open weights model on HuggingFace that matched performance and accuracy of Opus 5 running locally on an RTX 5070? That won’t happen tomorrow, but it will likely happen someday… what’s the plan beyond “don’t be the one holding the bags?”
inference is the cheap part; training is expensive. what compute infrastructure would train this mythical magic model?
Re: Nvidia dramatically reduces amount of OpenAI infra financing it may guarantee
#19What would happen to Nvidia, Anthropic, OpenAI, if tomorrow someone released an open weights model on HuggingFace that matched performance and accuracy of Opus 5 running locally on an RTX 5070? That won’t happen tomorrow, but it will likely happen someday… what’s the plan beyond “don’t be the one holding the bags?”
Those companies will be quick to copy the tech, inference cost would plummet and there is a greater chance that these companies could make it to solvency. At least in the short term. Long term it might not be so great as consume hardware catches up.
Re: Nvidia dramatically reduces amount of OpenAI infra financing it may guarantee
#20I would like to see the numbers. If Nvidia sells hardware for $100B with 75% cross margin, and provides $50 billion in backstop for that same hardware, it would be still be nicely profitable deal ($25B) if the backstop capacity would be a total write-off recovering $0. Reselling that capacity in some large discount below already low backstop price would increase the profits. It's all those pension funds, sovereign we…
Pretty much, I have said it for a while now, Softbank and Oracle are the ones I would be worried about. Both of them have put their companies wealth behind this, if it goes down so will they. Others have played it fairly smart in terms of insulating potential issues.
SoftBank has always managed to squeeze by after every mistake selling some early huge wins Alibaba, Nvidia, arm. Wonder if they still have any of those left in the back pocket.