Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
251–260 of 1001 posts
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#252Any clues to how they plan to invest $500 billion dollars? What infrastructure are they planning that will cost that much?
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#253It appears this basically locks out Google, Amazon and Meta. Why are we declaring OpenAI as the winner? This is like declaring Netscape the winner before the dust settled. Having the govt involved in this manner can’t be a good thing.
Interestingly, there seems to be no actual government involvement aside from the announcement taking place at the White House. It all seems to be private money.
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#254The fallout is going to be insane when the AI bubble pops.
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#255The fallout is going to be insane when the AI bubble pops.
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#256Earlier quoted context omitted.
Reasonably speaking, there is no way they can know how they plan to invest $500 billion dollars. The current generation of large language models basically use all human text thats ever been created for the parameters... not really sure where you go after than using the same tech.
That's not really true - the current generation, as in "of the last three months", uses reinforcement learning to synthesize new training data for themselves: https://huggingface.co/deepseek-ai/DeepSeek-R1-Zero
If it's possible to produce intelligence from just ingesting text, then current tech companies have all the data they need from their initial scrapes of the internet. They don't need more. That's different to keeping models up to date on current affairs.
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#257Earlier quoted context omitted.
Reasonably speaking, there is no way they can know how they plan to invest $500 billion dollars. The current generation of large language models basically use all human text thats ever been created for the parameters... not really sure where you go after than using the same tech.
It seems to me you could generate a lot of fresh information from running every youtube video, every hour of TV on archive.org, every movie on the pirate bay -- do scene by scene image captioning + high quality whisper transcriptions (not whatever junk auto-transcription YouTube has applied), and use that to produce screenplays of everything anyone has ever seen. I'm not sure why I've never heard of this being done,…
EVERY youtube video?? Even the 9/11 truther videos? Sandy Hook conspiracy videos? Flat earth? Even the blatantly racist? This would be some bad training data without some pruning.
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#258It appears this basically locks out Google, Amazon and Meta. Why are we declaring OpenAI as the winner? This is like declaring Netscape the winner before the dust settled. Having the govt involved in this manner can’t be a good thing.
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#259~$125B per year would be 2-3% of all domestic investment. It's similar in scale to the GDP of a small middle income country. If the electric grid — particularly the interconnection queue — is already the bottleneck to data center deployment, is something on this scale even close to possible? If it's a rationalized policy framework (big if!), I would guess there's some major permitting reform announcement coming soon.
Re: Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
#260Earlier quoted context omitted.
> Instead, what this pushes, is accomplishing the removal of humans from humanity. If you buy the marketing, yeah. But we aren't really seeing that in the tech sector. We haven't seen it succeed in the entertainment sector... it's still fighting for relevance in the medical and defense industries too. The number and quality of jobs that AI replaced is probably still quite low, and it will probably remain that way eve…
> AI is DOA. LLMs have no successor, and the transformer architecture hit it's bathtub curve years ago Tell me you didn’t read the DeepSeek R1 paper without telling me you also don’t know about reinforcement learning.