Earlier quoted context omitted.
>Otherwise we'd see SOTA models from new groups every month We do. It's just that startups don't go after the frontier models but niche spaces which are under served and can be explored with a few million in hardware. Just like how open AI made gpt2 before they made gpt3.
> We do. > It's just that startups don't go after the frontier models but niche spaces But both of "New SOTA models every month" and "Startups don't go for SOTA" cannot be true at the same time. Either we get new SOTA models from new groups every month (not true today at least) or we don't, maybe because the labs are focusing on non-SOTA instead.
How OpenAI uses complex and circular deals to fuel its multibillion-dollar rise
301–310 of 428 posts
Re: How OpenAI uses complex and circular deals to fuel its multibillion-dollar rise
#302Earlier quoted context omitted.
It's the first new way of interacting with computers since the iPhone. It's going to be massively valuable and OpenAI is essentially guaranteed to be one of the players.
Why is their product not palm? Or windows mobile?
Palm is closer but it's a different world. It's established that Internet advertising companies are worth trillions. It's only in retrospect that what Palm could have been is obvious.
Barring something very unexpected OpenAI is coming out on top. They're prepaying for a good 5-10 years of compute. That means their inference and training for that time are "free" because they've been paid for. They're going to be able to bury their competition in money or buy them out.
Re: How OpenAI uses complex and circular deals to fuel its multibillion-dollar rise
#303Earlier quoted context omitted.
To simplify it down even more: - For the ML team, you need money. Money to pay them and money to get access to GPUs. You might buy the GPUs and make your own server farm (which also takes time) or you might just burn all that money with AWS and use their GPUs. You can trade off money vs. time. - For the chip design team, you need money and time. There's no workaround for the time aspect of it. You can't spend more mo…
> - For the ML team, you need money. Money to pay them and money to get access to GPUs. You might buy the GPUs and make your own server farm (which also takes time) or you might just burn all that money with AWS and use their GPUs. You can trade off money vs. time. Even if you do those things though, it doesn't guarantee success or you'll be able to train something bigger. For that you need knowledge, hard work and e…
You know what I can guarantee? No matter how much money you throw at it, you will not have a new SOTA fab in a few months.
Re: How OpenAI uses complex and circular deals to fuel its multibillion-dollar rise
#304Re: How OpenAI uses complex and circular deals to fuel its multibillion-dollar rise
#305Earlier quoted context omitted.
Yup. Not just Nvidia. Just look at the quarterly results reported by Amazon, Google, Meta, Microsoft and Apple. Each one is reporting revenues never before seen in history. If you make 100 Billion a quarter you have to spend it on something. These guys are running hyper optimized cash extraction mega machines. There is no comparison to previous bubbles, cause so no such companies ever existed in the past.
So many such profitable companies are the best possible evidence for the need for drastic antitrust intervention. The lack of competition and regulation is leading to a massive drain on every other sector.
Re: How OpenAI uses complex and circular deals to fuel its multibillion-dollar rise
#306Earlier quoted context omitted.
Real question -- how else is OpenAI supposed to fund itself? It has capital requirements that the most moneyed business companies can't provide. So it has to come up with ways to get access to money while de-risking the terms. Not saying the circularity works but I don't know how else you raise at their scale. This money is well beyond VC capability. Either this lets them build to net positive without dying from pain…
They could try selling their services above cost.
Re: How OpenAI uses complex and circular deals to fuel its multibillion-dollar rise
#307Earlier quoted context omitted.
OpenAI invests heavily into integration with other products. If model development stalls they just need to be not worse than other stalled models while taking advantage of brand recognition and momentum to stay ahead in other areas. In that sense it makes sense to keep spending billions even f model development is nearing diminishing return - it forces competition to do the same and in that game victory belongs to th…
But, if model development stalls, and everyone else is stalled as well, then what happens to turn the current wildly-unprofitable industry into something that "it makes sense to keep spending billions" on?
Re: How OpenAI uses complex and circular deals to fuel its multibillion-dollar rise
#308[flagged]
That means you'll have to, you know, actually use your brain and try to construct an argument on how any of this is good for people.
Re: How OpenAI uses complex and circular deals to fuel its multibillion-dollar rise
#309Isn't paying a company to dig a hole who then pays you the same amount to fill said hole illegal?
Yes, but what does that have to do with this situation? The hole served no purpose. The companies are using the GPUs.
And, well, nobody knows if it is providing real value. We know it's doing something and has some value WE attached to it. We don't know what the real value is, we're just speculating.
Re: How OpenAI uses complex and circular deals to fuel its multibillion-dollar rise
#310Earlier quoted context omitted.
Not really. The idea that reality lies _in_ the middle is fairly coherent. It's not, on it's face, absolutely true but there are and infinite number of options between two outcomes so the odds are overwhelmingly in the favor that the truth lies somewhere in between. Is either side totally right about every single point of contention between them? Probably not, so the answer is likely in the middle. The fallacy is a l…
Flat-earthers: The earth is flat. Round-earthers: The earth is round. "Reality lies in the middle" argument: The earth is oblong, not a perfect sphere, so both sides were right.