Earlier quoted context omitted.
I think they just want Apple devices to train their computer-use models in a realistic environment.
What realistic environment requires 10,000 Macs?
10000 realistic encironments
Apple Is Suddenly an AI Infra Stock as OpenAI Buys 10k+ Macs
21–27 of 27 posts
Re: Apple Is Suddenly an AI Infra Stock as OpenAI Buys 10k+ Macs
#22> According to The Information, OpenAI has reportedly purchased tens of thousands of Mac minis and Mac Studios in recent months for reinforcement learning and training computer-use agents.
I do hope they verified this claim and didn't just read the headline. I'm not interested in subscribing to that source to find out unfortunately.
Re: Apple Is Suddenly an AI Infra Stock as OpenAI Buys 10k+ Macs
#23I don't understand the economics of that, is it just because compute is very constrained and they are buying everything they can, even suboptimal machines with a lower performance per $? Or is it just an experiment and anyway 10k macs are just a blip?
Theyre distilling tge open models. Fr
Re: Apple Is Suddenly an AI Infra Stock as OpenAI Buys 10k+ Macs
#24Good luck with that. Managing zillions of Macs has always been difficult, clients and servers. Stanford tried to build an Xserve cluster and failed miserably at it because the OS wasn't conducive to it, nor the hardware at the time either. :( It's not impossible but requires a lot of messy custom, fragile tooling.. and that's expensive to support.
Sounds like a job for a state of the art model...
Chicken, meet egg.
Re: Apple Is Suddenly an AI Infra Stock as OpenAI Buys 10k+ Macs
#25The one good thing out of this, we may finally get the mac pro back. Hopefully a rackmount version that doesn't cost trillions.
Re: Apple Is Suddenly an AI Infra Stock as OpenAI Buys 10k+ Macs
#26Just to make sure we’re gonna do opening and run locally?
That went wrong.. I meant -> Just to make sure we won't be able to buy and run LLMs locally
Re: Apple Is Suddenly an AI Infra Stock as OpenAI Buys 10k+ Macs
#27The one good thing out of this, we may finally get the mac pro back. Hopefully a rackmount version that doesn't cost trillions.
Perhaps only billions per 2u with the current trajectory of ram pricing. /s