Earlier quoted context omitted.
Presumably the non-economist following them picked up the twenty, unencumbered by theory.
I've never seen a $20 bill on the ground in my entire life, so I guess the economists are actually right.
I regret building this $3000 Pi AI cluster
311–320 of 377 posts
Re: I regret building this $3000 Pi AI cluster
#312RPIs have always had shit cpu performance - the initial idea for the pi was to use very low cost broadcom crap chips that no one would buy and market it for "educational" use. They are essentially for kids to play around with learning computers by blinking LEDs and integrating with circuit boards. The idea of building a high performance cluster with pis is dumb from day one
Where a "kid" may be a 53 years old with 30+ years softdev experience who ultimately got to get to the stuff he wanted to for quite some time, and the "blinking LEDs" are a bunch of servos programmatically controlled based on input from a bunch of sensors. While there are definitely better alternatives based on various narrow metrics, especially when it may come to actual productization, the ease (and cheapness, so you don't think much about that spending) of starting with all those easily available for RPi servo array drive boards and various IO ports array boards and all the available software - it is hard to imagine how it can be more easy/cheaper/available than it already is with all that actual compute power and full-featured Linux environment.
Re: I regret building this $3000 Pi AI cluster
#313Re: I regret building this $3000 Pi AI cluster
#314Earlier quoted context omitted.
What if you need ARM? What is the best sub $100 sbc that I am missing? Orange Pi hardware always looks good but I hear a lot of negativity about the software that I don't really experience with Raspbian.
Then you should take a good hard look at older, much cheaper Raspberry Pis. Then look at Apple’s ARM offerings, and AWS Graviton if you need ARM with raw power. If you need embedded/GPIO you should consider an Arduino, or clone. If you need GPIOs and Internet connectivity, look at an ESP32. GPIOs, ARM and wired ethernet? Consdier the the STM32H. Robotics/machine vision applications, needing IO and lots of compute pow…
Re: I regret building this $3000 Pi AI cluster
#315Earlier quoted context omitted.
If it makes an appreciable difference to how much money he makes on YouTube then I can’t begrudge him for doing it. Don’t hate the player, hate the game.
Just to add context — I've been experimenting on my 2nd channel (Level 2 Jeff) with titles that are straight/barebones exactly describing the content of the video, vs a slight bit of clickbait (never untrue, but certainly more intriguing and not describing the exact topic of the video). The ones that are dead straight with no clickbait are 10/10 (the worst performers), and usually by a massive margin. Even with the s…
Re: I regret building this $3000 Pi AI cluster
#316Earlier quoted context omitted.
What if you need ARM? What is the best sub $100 sbc that I am missing? Orange Pi hardware always looks good but I hear a lot of negativity about the software that I don't really experience with Raspbian.
Then you should take a good hard look at older, much cheaper Raspberry Pis. Then look at Apple’s ARM offerings, and AWS Graviton if you need ARM with raw power. If you need embedded/GPIO you should consider an Arduino, or clone. If you need GPIOs and Internet connectivity, look at an ESP32. GPIOs, ARM and wired ethernet? Consdier the the STM32H. Robotics/machine vision applications, needing IO and lots of compute pow…
I would throw in the RP2040 for consideration as well, and nRF chips if you need wireless connectivity.
Re: I regret building this $3000 Pi AI cluster
#317Earlier quoted context omitted.
Those kWh prices are insane, that’ll make industry move out of there.
Industrial pays different rates than homes. That said, I am not sure those numbers are true. I am in California (PG&E with East Bay community generation), and my TOU rates are much lower than those.
Re: I regret building this $3000 Pi AI cluster
#318For anyone interested in playing with distributed systems, I'd really recommend getting a single machine with latest 16-core CPU from AMD and just running 8 virtual machines on it. 8 virtual machines, with 4 hyper threads pinned per machine, and 1/8 of total RAM per machine. Create a network between them virtually within your virtualization software of choice (such as Proxmox). And suddenly you can start playing with…
Tangentially related: I really expected running old MPI programs on stuff like the AMD multi-chip workstation packages to become a bigger thing.
Re: I regret building this $3000 Pi AI cluster
#319Earlier quoted context omitted.
Depends. At full load? At Irish power prices? Just the Pi, no peripherals, no NVMe? 5 units? €13/mo. Handy: https://700c.dk/?powercalc My Pi CM4 NAS with a PCIe switch, SATA and USB3 controllers, 6 SATA SSDs, 2 VMs, 2 LXC containers, and a Nextcloud snap pretty much sits at 17 watts most of the time, hitting 20 when a lot is being asked of it, and 26-27W at absolute max with all I/O and CPU cores pegged. €3.85/mo if…
> Depends. At full load? At Irish power prices? Just the Pi, no peripherals, no NVMe? 5 units? €13/mo. Pretty sure most of us aren't running anywhere close to full load 24/7, but whoa, Irish power is expensive. In the central US I pay $0.14/KWh.
Re: I regret building this $3000 Pi AI cluster
#320For anyone interested in playing with distributed systems, I'd really recommend getting a single machine with latest 16-core CPU from AMD and just running 8 virtual machines on it. 8 virtual machines, with 4 hyper threads pinned per machine, and 1/8 of total RAM per machine. Create a network between them virtually within your virtualization software of choice (such as Proxmox). And suddenly you can start playing with…
No need for so much CPU power, any old quad core would work.