Earlier quoted context omitted.
But Im saying something different than the person I was responding to. They said that the risk was due to company going bankrupt and therefore Nvidia losing its "investment" - read: the GPUs that it leased. Whereas Im saying that the risk is due to company going bankrupt, Nvidia getting its GPUs back, but now they have too many at hand than they can usefully deploy/sell. The two are risks triggered by the same event,…
In the world in which OpenAI goes bankrupt, their used GPUs would be worth perhaps 10% of their value today.
Circular Financing: Does Nvidia's $110B Bet Echo the Telecom Bubble?
201–210 of 218 posts
Re: Circular Financing: Does Nvidia's $110B Bet Echo the Telecom Bubble?
#202One of the things before AI in the market was that capital had limited growth opportunities. Tech, which was basically a universe of scaled out crud apps, was where capital would keep going back into. AI is a lot more useful than hyper scaled up crud apps. Comparing this to the past is really overfitting imho. The only argument against accumulating GPUs is that they get old and stop working. Not that it sucks, not th…
> Your web apps could truly one day be generated frame by frame by a video model. Really. The amount of compute we’ll need will be staggering. We've technically been able to play board games by entering our moves into our telephones, sending them to a CPU to be combined, then printing out a new board on paper to conform to the new board state. We do not do this because it would be stupid. We can not depend on people…
If you’re a board game player then you are more than capable of imagining possibilities well beyond this.
Re: Circular Financing: Does Nvidia's $110B Bet Echo the Telecom Bubble?
#203Knowing history of past bubbles is only mildly informative. The dotcom bubble was different than the railroads bubble etc. The only thing to keep in mind is that all of this is about business and ROI. Given the colossal investments, even if the companies finances are healthy and not fraudulent, the economic returns have to be unprecedented or there will be a crash. They are all chasing a golden goose.
With Bezos openly stating the goal to build 10 GW+ data-centers in space, it almost feels in question whether this is about ROI, or simply building the Neuromancer future where the ultra-rich can finally be free of their need for the rest of us. Not needing labor at all would be the final return on investment. https://news.ycombinator.com/item?id=45465480 https://www.datacenterdynamics.com/en/news/jeff-bezos-claims..…
We are a long way from that. At least 10 years, probably never gonna happen.
Re: Circular Financing: Does Nvidia's $110B Bet Echo the Telecom Bubble?
#204I think the fundamental issue is the uncertainty of achieving AGI with baked in fundamentals of reasoning. Almost 90% of topline investments appear to be geared around achieving that in the next 2-5 years. If that doesn’t come to pass soon enough, investors will loose interest. Interest has been maintained by continuous growth in benchmark results. Perhaps this pattern can continue for another 6-12 months before fati…
Re: Circular Financing: Does Nvidia's $110B Bet Echo the Telecom Bubble?
#205Earlier quoted context omitted.
Inference will be cheapest when run in a shared cloud environment, simply due to the LLMs roofline. Thus, most B2B use cases are likely to be datacenter based, like AWS today. Of course, cern is still going to use their FPGA hyper-optimized for their specific trigger model for the LHC, and apple is gojng to use a specialized low power ASIC running a quantized model for hello Siri, but I meant the majority usecase.
I do not buy this premise. I think it will end up being cheaper to simply run the LLMs directly on the user device. I think that there are plenty of competitors in the "LLMs with open weights" space to essentially make the models a commodity, so all that is left is the compute cost and there is no way that someone will be running a datacenter in a way that is cheaper than "the computer that I already have running on…
==========
[1] https://rundata.co.za/blog/index.html?the-ai-value-chain
Re: Circular Financing: Does Nvidia's $110B Bet Echo the Telecom Bubble?
#206Earlier quoted context omitted.
In the world in which OpenAI goes bankrupt, their used GPUs would be worth perhaps 10% of their value today.
How so? If OpenAI when bankrupt tomorrow, what percent of their value do you think their GPUs would be worth?
Re: Circular Financing: Does Nvidia's $110B Bet Echo the Telecom Bubble?
#207Earlier quoted context omitted.
> most important technology transition in the history of humankind Get real. Farming? Plow? Steam engine? Combustion engine? Electricity? Air conditioning? Computers? Internet?
Creating a true digital brain would be humankind's greatest (last?) invention.
Re: Circular Financing: Does Nvidia's $110B Bet Echo the Telecom Bubble?
#208Earlier quoted context omitted.
Creating a true digital brain would be humankind's greatest (last?) invention.
By what metric? In my opinion actually solving all of the problems we currently have and man we have a lot of them past the obvious ones like climate change, that would be our greatest achievement.
Re: Circular Financing: Does Nvidia's $110B Bet Echo the Telecom Bubble?
#209I was there in the middle of the dotcom crash and the telecoms crash which was much worse. Fiber does not rust, and while there was vast overcapacity, not all of it was lit, or indeed worth lighting. 10 years after, thanks to DWDM there were 8 strand cables where only 2 strands were lit, albeit with many more wavelengths than envisaged before. Even though demand had grown. How much is a 10 year old GPU worth? Where i…
> How much is a 10 year old GPU worth? Where is the “dwdm but for GPUs?”.
From other sources cited in TFA it seems GPUs won't last 3 years, let alone 10! But I think we know what the "DWDM for GPUs" is -- it's the processing efficiency gains that we've seen over the last few years which keeps driving the per-token prices sharply down.
Re: Circular Financing: Does Nvidia's $110B Bet Echo the Telecom Bubble?
#210Earlier quoted context omitted.
By what metric? In my opinion actually solving all of the problems we currently have and man we have a lot of them past the obvious ones like climate change, that would be our greatest achievement.
The optimistic thinking is that with thousands/millions of tireless 24/7 brains at work on these problems we could address more problems in biology, chemistry, physics, materials science, etc. faster. It's a bold, but not unreasonable belief.