Live data from Hacker News

I regret building this $3000 Pi AI cluster

jeffgeerling.com

221–230 of 377 posts

Re: I regret building this $3000 Pi AI cluster

#221

Guys, don’t take the claim so literally. He’s a successful tech poster. He makes good money showing off his purchases the good money complaining about how expensive they were. But certainly don’t imitate his choices, his economics aren’t your economics!

I totally agree. A person with that kind of builder knowledge already knows a decent GPU could 10x that compute power.

Re: I regret building this $3000 Pi AI cluster

#222
post #25

I thought the conclusion should have been obvious: A cluster of Raspberry Pi units is an expensive nerd indulgence for fun, not an actual pathway to high performance compute. I don’t know if anyone building a Pi cluster actually goes into it thinking it’s going to be a cost effective endeavor, do they? Maybe this is just YouTube-style headline writing spilling over to the blog for the clicks. If your goal is to play…

I did some calculations on this. Procuring a Mac Studio with the latest Mx Ultra processor and maxing out the memory seems to be the most cost effective way to break into 100b+ parameter model space.

>Mac

>cost effective

lmao

Re: I regret building this $3000 Pi AI cluster

#223

> With 160 GB of total RAM, shared by the CPU and iGPU, this could be a small, efficient AI Cluster, right? Well, you'd think. I don't know anyone who would think this actually.

Most people who haven't actually self-hosted AI models would think this—for some reason people still think RAM is RAM, and they don't think about specs like memory speed, whether the full amount of RAM is shared with the GPU, etc.

You'd be surprised by the number of emails, Instagram DMs, YouTube comments, etc. I get—even after explicitly showing how bad a system is at a certain task—asking if a Pi would be good for X, or if they could run ChatGPT on their laptop...

Re: I regret building this $3000 Pi AI cluster

#224

brand fanboyism, and vendor locking, the bane of our society the common denominator is always capital gain capitalism is the reason why we haven't been able to go back to the moon and build bases there

and yet spaceX is for-profit and is pushing the boundaries again, after NASA (a not-for-profit government-created monopoly) stagnated.

blanket-blaming capitalism without good reasoning is becoming the new red-flag of "can't think critically"

Re: I regret building this $3000 Pi AI cluster

#225

I thought the conclusion should have been obvious: A cluster of Raspberry Pi units is an expensive nerd indulgence for fun, not an actual pathway to high performance compute. I don’t know if anyone building a Pi cluster actually goes into it thinking it’s going to be a cost effective endeavor, do they? Maybe this is just YouTube-style headline writing spilling over to the blog for the clicks. If your goal is to play…

What I think is strange with stuff like this that you should be able to come to that conclusion without technical knowledge. Just the fact that everyone runs AI on GPUs and NVIDIAs stock skyrocketed since the AI boom should tell you s.th..

Did OP really think his fellow humans are that moronic that they just didn't find out you can plug in together a cuple of rasperri pis?

Re: I regret building this $3000 Pi AI cluster

#227

Earlier quoted context omitted.

how many can run on batteries? it's nice to take it on road trips / into hotels. can't really imagine hauling a server around. we probably have different definitions of "very little power".

> it's nice to take it on road trips / into hotels. > can't really imagine hauling a server around. These two sentences contradict each other.

How?

I can fit a raspberry pi and external ssd in my pocket.

I cannot do that for a server.

I could use a laptop, but simply plugging in a firestick to the hotel tv or a projector when camping is nicer.

Re: I regret building this $3000 Pi AI cluster

#228

I thought the conclusion should have been obvious: A cluster of Raspberry Pi units is an expensive nerd indulgence for fun, not an actual pathway to high performance compute. I don’t know if anyone building a Pi cluster actually goes into it thinking it’s going to be a cost effective endeavor, do they? Maybe this is just YouTube-style headline writing spilling over to the blog for the clicks. If your goal is to play…

Geerling's titles have been increasingly click-bait for a while now. It's pretty sad, because I like his content, but hate the click-bait BS.

If it makes an appreciable difference to how much money he makes on YouTube then I can’t begrudge him for doing it.

Don’t hate the player, hate the game.

Re: I regret building this $3000 Pi AI cluster

#229

I thought the conclusion should have been obvious: A cluster of Raspberry Pi units is an expensive nerd indulgence for fun, not an actual pathway to high performance compute. I don’t know if anyone building a Pi cluster actually goes into it thinking it’s going to be a cost effective endeavor, do they? Maybe this is just YouTube-style headline writing spilling over to the blog for the clicks. If your goal is to play…

> I don’t know if anyone building a Pi cluster actually goes into it thinking it’s going to be a cost effective endeavor, do they?

Some Raspberry Pi products are sold at a loss, so I could see how it's in the realm of possibility.

Re: I regret building this $3000 Pi AI cluster

#230

Earlier quoted context omitted.

It's good for the soul to have your cluster running in your home somewhere.

Bad for your power bill though.

I got past that back when I was paying for ISDN and had 5 Surplus Desktop PCs...write it off as 'Professional development'
Post reply on HN