Guys, don’t take the claim so literally. He’s a successful tech poster. He makes good money showing off his purchases the good money complaining about how expensive they were. But certainly don’t imitate his choices, his economics aren’t your economics!
I regret building this $3000 Pi AI cluster
221–230 of 377 posts
Re: I regret building this $3000 Pi AI cluster
#222I thought the conclusion should have been obvious: A cluster of Raspberry Pi units is an expensive nerd indulgence for fun, not an actual pathway to high performance compute. I don’t know if anyone building a Pi cluster actually goes into it thinking it’s going to be a cost effective endeavor, do they? Maybe this is just YouTube-style headline writing spilling over to the blog for the clicks. If your goal is to play…
I did some calculations on this. Procuring a Mac Studio with the latest Mx Ultra processor and maxing out the memory seems to be the most cost effective way to break into 100b+ parameter model space.
>cost effective
lmao
Re: I regret building this $3000 Pi AI cluster
#223> With 160 GB of total RAM, shared by the CPU and iGPU, this could be a small, efficient AI Cluster, right? Well, you'd think. I don't know anyone who would think this actually.
You'd be surprised by the number of emails, Instagram DMs, YouTube comments, etc. I get—even after explicitly showing how bad a system is at a certain task—asking if a Pi would be good for X, or if they could run ChatGPT on their laptop...
Re: I regret building this $3000 Pi AI cluster
#224brand fanboyism, and vendor locking, the bane of our society the common denominator is always capital gain capitalism is the reason why we haven't been able to go back to the moon and build bases there
blanket-blaming capitalism without good reasoning is becoming the new red-flag of "can't think critically"
Re: I regret building this $3000 Pi AI cluster
#225I thought the conclusion should have been obvious: A cluster of Raspberry Pi units is an expensive nerd indulgence for fun, not an actual pathway to high performance compute. I don’t know if anyone building a Pi cluster actually goes into it thinking it’s going to be a cost effective endeavor, do they? Maybe this is just YouTube-style headline writing spilling over to the blog for the clicks. If your goal is to play…
Did OP really think his fellow humans are that moronic that they just didn't find out you can plug in together a cuple of rasperri pis?
Re: I regret building this $3000 Pi AI cluster
#226If Pi Clusters were actually cost competitive for performance there would be data centres full of them.
Re: I regret building this $3000 Pi AI cluster
#227Earlier quoted context omitted.
how many can run on batteries? it's nice to take it on road trips / into hotels. can't really imagine hauling a server around. we probably have different definitions of "very little power".
> it's nice to take it on road trips / into hotels. > can't really imagine hauling a server around. These two sentences contradict each other.
I can fit a raspberry pi and external ssd in my pocket.
I cannot do that for a server.
I could use a laptop, but simply plugging in a firestick to the hotel tv or a projector when camping is nicer.
Re: I regret building this $3000 Pi AI cluster
#228I thought the conclusion should have been obvious: A cluster of Raspberry Pi units is an expensive nerd indulgence for fun, not an actual pathway to high performance compute. I don’t know if anyone building a Pi cluster actually goes into it thinking it’s going to be a cost effective endeavor, do they? Maybe this is just YouTube-style headline writing spilling over to the blog for the clicks. If your goal is to play…
Geerling's titles have been increasingly click-bait for a while now. It's pretty sad, because I like his content, but hate the click-bait BS.
Don’t hate the player, hate the game.
Re: I regret building this $3000 Pi AI cluster
#229I thought the conclusion should have been obvious: A cluster of Raspberry Pi units is an expensive nerd indulgence for fun, not an actual pathway to high performance compute. I don’t know if anyone building a Pi cluster actually goes into it thinking it’s going to be a cost effective endeavor, do they? Maybe this is just YouTube-style headline writing spilling over to the blog for the clicks. If your goal is to play…
Some Raspberry Pi products are sold at a loss, so I could see how it's in the realm of possibility.