Live data from Hacker News

I regret building this $3000 Pi AI cluster

jeffgeerling.com

311–320 of 377 posts

Re: I regret building this $3000 Pi AI cluster

#311

Earlier quoted context omitted.

Presumably the non-economist following them picked up the twenty, unencumbered by theory.

I've never seen a $20 bill on the ground in my entire life, so I guess the economists are actually right.

I recently saw a $20 bill left in the bill dispenser of a gas station ATM. I didn’t take it because I assumed there was a chance that whoever left it would realize within a minute or two and run back for it. But most likely the next person to see it grabbed it.

Re: I regret building this $3000 Pi AI cluster

#312

RPIs have always had shit cpu performance - the initial idea for the pi was to use very low cost broadcom crap chips that no one would buy and market it for "educational" use. They are essentially for kids to play around with learning computers by blinking LEDs and integrating with circuit boards. The idea of building a high performance cluster with pis is dumb from day one

>They are essentially for kids to play around with learning computers by blinking LEDs and integrating with circuit boards.

Where a "kid" may be a 53 years old with 30+ years softdev experience who ultimately got to get to the stuff he wanted to for quite some time, and the "blinking LEDs" are a bunch of servos programmatically controlled based on input from a bunch of sensors. While there are definitely better alternatives based on various narrow metrics, especially when it may come to actual productization, the ease (and cheapness, so you don't think much about that spending) of starting with all those easily available for RPi servo array drive boards and various IO ports array boards and all the available software - it is hard to imagine how it can be more easy/cheaper/available than it already is with all that actual compute power and full-featured Linux environment.

Re: I regret building this $3000 Pi AI cluster

#313
post #282

Earlier quoted context omitted.

No need for so much CPU power, any old quad core would work.

Old quad core won't have all the virtualisation extensions.

Virtualization existed long before virtualization instructions. Not strictly necessary.

Re: I regret building this $3000 Pi AI cluster

#314

Earlier quoted context omitted.

What if you need ARM? What is the best sub $100 sbc that I am missing? Orange Pi hardware always looks good but I hear a lot of negativity about the software that I don't really experience with Raspbian.

Then you should take a good hard look at older, much cheaper Raspberry Pis. Then look at Apple’s ARM offerings, and AWS Graviton if you need ARM with raw power. If you need embedded/GPIO you should consider an Arduino, or clone. If you need GPIOs and Internet connectivity, look at an ESP32. GPIOs, ARM and wired ethernet? Consdier the the STM32H. Robotics/machine vision applications, needing IO and lots of compute pow…

N100s absolutely curb stomp Pis and have very good video hardware encoders/decoders to boot

Re: I regret building this $3000 Pi AI cluster

#315

Earlier quoted context omitted.

If it makes an appreciable difference to how much money he makes on YouTube then I can’t begrudge him for doing it. Don’t hate the player, hate the game.

Just to add context — I've been experimenting on my 2nd channel (Level 2 Jeff) with titles that are straight/barebones exactly describing the content of the video, vs a slight bit of clickbait (never untrue, but certainly more intriguing and not describing the exact topic of the video). The ones that are dead straight with no clickbait are 10/10 (the worst performers), and usually by a massive margin. Even with the s…

Thanks for the transparency. Much respect to you.

Re: I regret building this $3000 Pi AI cluster

#316

Earlier quoted context omitted.

What if you need ARM? What is the best sub $100 sbc that I am missing? Orange Pi hardware always looks good but I hear a lot of negativity about the software that I don't really experience with Raspbian.

Then you should take a good hard look at older, much cheaper Raspberry Pis. Then look at Apple’s ARM offerings, and AWS Graviton if you need ARM with raw power. If you need embedded/GPIO you should consider an Arduino, or clone. If you need GPIOs and Internet connectivity, look at an ESP32. GPIOs, ARM and wired ethernet? Consdier the the STM32H. Robotics/machine vision applications, needing IO and lots of compute pow…

> If you need embedded/GPIO you should consider an Arduino, or clone. If you need GPIOs and Internet connectivity, look at an ESP32

I would throw in the RP2040 for consideration as well, and nRF chips if you need wireless connectivity.

Re: I regret building this $3000 Pi AI cluster

#317
post #259

Earlier quoted context omitted.

Those kWh prices are insane, that’ll make industry move out of there.

Industrial pays different rates than homes. That said, I am not sure those numbers are true. I am in California (PG&E with East Bay community generation), and my TOU rates are much lower than those.

If he’s only paying $50 most of it is connection fees and low usage distorting his per kWh price way up.

Re: I regret building this $3000 Pi AI cluster

#318
post #238

For anyone interested in playing with distributed systems, I'd really recommend getting a single machine with latest 16-core CPU from AMD and just running 8 virtual machines on it. 8 virtual machines, with 4 hyper threads pinned per machine, and 1/8 of total RAM per machine. Create a network between them virtually within your virtualization software of choice (such as Proxmox). And suddenly you can start playing with…

Tangentially related: I really expected running old MPI programs on stuff like the AMD multi-chip workstation packages to become a bigger thing.

I actually worked with some MPI code way back. What MPI programs are you referring to?

Re: I regret building this $3000 Pi AI cluster

#319

Earlier quoted context omitted.

Depends. At full load? At Irish power prices? Just the Pi, no peripherals, no NVMe? 5 units? €13/mo. Handy: https://700c.dk/?powercalc My Pi CM4 NAS with a PCIe switch, SATA and USB3 controllers, 6 SATA SSDs, 2 VMs, 2 LXC containers, and a Nextcloud snap pretty much sits at 17 watts most of the time, hitting 20 when a lot is being asked of it, and 26-27W at absolute max with all I/O and CPU cores pegged. €3.85/mo if…

> Depends. At full load? At Irish power prices? Just the Pi, no peripherals, no NVMe? 5 units? €13/mo. Pretty sure most of us aren't running anywhere close to full load 24/7, but whoa, Irish power is expensive. In the central US I pay $0.14/KWh.

Yeah, it's brutal. Was €0.39 right after Mad Vlad kicked off his vanity conflict.

Re: I regret building this $3000 Pi AI cluster

#320
post #282
post #238

For anyone interested in playing with distributed systems, I'd really recommend getting a single machine with latest 16-core CPU from AMD and just running 8 virtual machines on it. 8 virtual machines, with 4 hyper threads pinned per machine, and 1/8 of total RAM per machine. Create a network between them virtually within your virtualization software of choice (such as Proxmox). And suddenly you can start playing with…

No need for so much CPU power, any old quad core would work.

Aren’t newer CPUs especially AMDs more energy efficient?
Post reply on HN