This is so much money with which we could actually solve problems in the world. maybe even stop wars which break out because of scarcity issues. maybe i am getting to old or to friendly to humans, but it's staggering to me how the priorities are for such things.
Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
591–600 of 1001 posts
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#592Despite the fact that this is THE thing I'd be the happiest to see in the real world (having spent a considerable amount of my career in companies working towards this vision), we are so far from it (as anyone who actually worked on these problems will attest) that Altman's comment here isn't just overselling, it's a blatant lie about this tech's capabilities.
I guess the pitch was something like: "hey o3 can already do PhD level maths so you know in 5 years it will be able to do drugs too, and cure shit, Mr President".
Trouble is o3 can't do advanced math (or at least definitely not at the level openai claimed.. it was a lie, it turns out openai funds the dataset that measures this - ouch). And the bigger problem is, going from "ai can do maths" to "invent cures" is about a 10-100 X jump. If it wasn't, don't we think the pharma companies would have solved this by hiring lots of "really smart math guys"?
As anyone in biotech will tell you, the hard bit is not the first third of the drug discovery pipeline (where 99% of ai driven biotechs focus). It's the later parts where the rubber meets the road.. i.e. where your precious little molecule is out in the real world with real people where the incredible variability of real biological hosts makes most drugs fail spectacularly. You can't GPT your way out of this. The answers for this is not in science papers that you can just read and regurgitate a version that "solves biology and cures diseases".
To solve this you need AI but most of all you have to do science. Real science. In the lab, in vitro and in Vivo, not just in silico, doing ablation studies, overfitting famous benchmark datasets and other pseudo science shit the ML community is used to doing.
That is all to say, I'd bet we won't see a single purely AI designed novel drug in the clinic in this decade. All parts of that sentence are important. Purely AI designed. Novel. But that's for another post..
Now, back to Altman. If you watch the clip, he almost did the smart thing at first when Trump put him on the spot and said "I have no idea about healthcare, biotech (or AI beyond board room drama)" but then could not resist coming up with this outlandish insane answer.
Famously (in tech circles anyway) Paul Graham wrote more than a decade ago about Altman that he's the most strong willed individual he's ever met, who can just bend the universe to his will. That's his super skill. And clearly.. convincing SoftBank and Oracle to do this 500 billion investment for OpenAI (a non profit turned for profit) is an unbelievable achievement. I have no idea what Altman can say (or do) in board rooms that unlocks these possibilities for him.. Any ideas? Let me know!
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#593Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#594Earlier quoted context omitted.
Let me avoid the use of the word AGI here because the term is a little too loaded for me these days. 1) reasoning capabilities in latest models are rapidly approaching superhuman levels and continue to scale with compute. 2) intelligence at a certain level is easier to achieve algorithmically when the hardware improves. There's also a larger path to intelligence and often simpler mechanisms 3) most current generation…
> 1) reasoning capabilities in latest models are rapidly approaching superhuman levels and continue to scale with compute. What would you say is the strongest evidence for this statement?
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#595I'm confused and a bit disturbed; honestly having a very difficult time internalizing and processing this information. This announcement is making me wonder if I'm poorly calibrated on the current progress of AI development and the potential path forward. Is the key idea here that current AI development has figured out enough to brute force a path towards AGI? Or I guess the alternative is that they expect to figure…
"There are maybe a few hundred people in the world who viscerally understand what's coming. Most are at DeepMind / OpenAI / Anthropic / X but some are on the outside. You have to be able to forecast the aggregate effect of rapid algorithmic improvement, aggressive investment in building RL environments for iterative self-improvement, and many tens of billions already committed to building data centers. Either we're a…
I don't immediately disagree with you but you just accidentally also described all crypto/NFT enthusiasts of a few years ago.
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#596Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#597I'm confused and a bit disturbed; honestly having a very difficult time internalizing and processing this information. This announcement is making me wonder if I'm poorly calibrated on the current progress of AI development and the potential path forward. Is the key idea here that current AI development has figured out enough to brute force a path towards AGI? Or I guess the alternative is that they expect to figure…
I think what's been going on is compute/$ has been exponentially rising for decades in a steady way and has recently passed the point that you can get human brain level compute for modest money. The tendency has been once the compute is there lots of bright PhDs get hired to figure algorithms to use it so that bit gets sorted in a few years. (as written about by Kurzweil, Wait But Why and similar).
So it's not so much brute forcing AGI so much that exponential growth makes it inevitable at some point and that point is probably quite soon. At least that seems to be what they are betting.
The annual global spend on human labour is ~$100tn so if you either replace that with AGI or just add $100tn AGI and double GDP output, it's quite a lot of money.
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#598Earlier quoted context omitted.
This has nothing to do with technology it is a purely financial and political exercise...
But why drop $500B (or even $100B short term) if there is not something there? The numbers are too big
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#599This is a Military project. Have no doubts about it.