Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Let's Build a 28-Core Raspberry Pi Cluster

ikarus.sg

Post reply on HN
Print view View original

141–150 of 158 posts

Re: Let's Build a 28-Core Raspberry Pi Cluster

#141

Post by notpiika »

giancarlostoro wrote: post #109
_v7gu wrote: post #66

Reminds me of moot "revealing" the "datacenter" that hosted 4chan: https://imgur.com/sBLRuZY I'm putting the air-quotes because I still sincerely hope that it was a joke

I'm more impressed he got trips, that's pretty amusing about the USB being as fast as an SSD. Technically SSD's are supposed to be based off SD card tech if I'm not mistaken, issue with a USB being based off the same tech is the USB speeds themselves vs a SSD can go significantly faster due to its connector (SATA or otherwise). Although I can see USB C being 'fast enough' instead.

As someone not that familiar with 4chan, what are trips?

Re: Let's Build a 28-Core Raspberry Pi Cluster

#142

Post by rumanator »

wahern wrote: post #68
rumanator wrote: post #54

Earlier quoted context omitted.

600$ buys you a considerable amount of time in a cloud vendor. For example you can have a 1vCPU instance in Hetzner for 3€/month, which means 600$ can buy you about a year's worth of 20 instances running 24/7. If you don't need 99.9999 availability of your cluster and are only interested in firing up the cluster from time to time then those same 600$ can buy you a few years of cluster time

The 3€/month is a single thread (not even a core), and it's not even dedicated. The lowest dedicated instance is 2 vCPU (1 core) for 23€/month with 8GB or RAM. That's 276€/year. 8 of those instances is equivalent to an 8 core (16 thread) chip with 64GB of memory. Using, e.g., Supermicro AMD EPYC 3251 + parts, you could build an entire server for less than 1/2 that price. You could have twice the compute for the same…

> 8 of those instances is equivalent to an 8 core (16 thread) chip with 64GB of memory. Using, e.g., Supermicro AMD EPYC 3251 + parts, you could build an entire server for less than 1/2 that price.

Your choice of comparisons suggest you completely missed the whole point. If the author wanted a desktop I'm sure he would buy one for 600$ instead of spending that money to put together an underperforming cluster that's entirely unusable as a desktop.

If instead you are interested in gaining experience managing a cluster that runs distributed systems then yes you would do something like putting together a raspberry pi cluster.

Yet, if you seek to have the same experience (or arguably far better) without spendig a hefty sum as capex and having access to more computational resources for a negligible opex then cloud providers such as Hetzner are clearly a far better option.

Re: Let's Build a 28-Core Raspberry Pi Cluster

#143

Post by nforest »

giancarlostoro wrote: post #116
Hamuko wrote: post #110

Earlier quoted context omitted.

> I'm more impressed he got trips There's probably admin tools for that.

I wondered about this, but sometimes people say it cause the previous post they see is 999 so they post it, sometimes you get lucky as heck haha. I doubt they'd screw with the admin tools just to do it.

On big boards there's so many posts per hour that it's impossible to really predict this way, it's very much luck.

I remember people used to run scripts to be sure to get the big gets (6+ last digits identical) but I suppose such methods don't work anymore with captcha and other anti spam measures.

Re: Let's Build a 28-Core Raspberry Pi Cluster

#144

Post by rtkwe »

cptskippy wrote: post #132
rtkwe wrote: post #126

Earlier quoted context omitted.

It looks like it was more a question of price in their market. In the post he mentions a 16 port switch but it's 10x the price of an 8 port. I bet it's a question of there being fewer people in the Singapore market looking for an >8 port switch on the low end of the market.

The switches he references in his post are from two entirely different product verticals. One is from the unmanaged vertical, the other is from the managed PoE vertical. Not only is he ignoring that a 16 port switch exists in the unmanaged vertical, he's ignored an entire vertical of managed switches without PoE. TP-Link makes a $40 unmanaged 16-port gigabit switch and a $80 managed 16-port gigabit switch. He's creat…

It's entirely possible that those options weren't readily available in the local store he's using. I'm not familiar with Singapore in particular but a lot of Asian countries don't have the huge electronics box stores that are common in the US and Europe. I've seen quite a few videos where the best electronic source the person had was what would be a small sized store in a US mall (20 feet wide, one isle with a counter running down one side for example). Online shopping does exist but shipping times and cost can also be pretty large.

Re: Let's Build a 28-Core Raspberry Pi Cluster

#145

Post by e1ghtSpace »

notpiika wrote: post #141
giancarlostoro wrote: post #109

Earlier quoted context omitted.

I'm more impressed he got trips, that's pretty amusing about the USB being as fast as an SSD. Technically SSD's are supposed to be based off SD card tech if I'm not mistaken, issue with a USB being based off the same tech is the USB speeds themselves vs a SSD can go significantly faster due to its connector (SATA or otherwise). Although I can see USB C being 'fast enough' instead.

As someone not that familiar with 4chan, what are trips?

When the post number ends with 3 of the same number. In this case 000. Theres also dubs and quads.

Re: Let's Build a 28-Core Raspberry Pi Cluster

#146

Post by cptskippy »

rtkwe wrote: post #144
cptskippy wrote: post #132

Earlier quoted context omitted.

The switches he references in his post are from two entirely different product verticals. One is from the unmanaged vertical, the other is from the managed PoE vertical. Not only is he ignoring that a 16 port switch exists in the unmanaged vertical, he's ignored an entire vertical of managed switches without PoE. TP-Link makes a $40 unmanaged 16-port gigabit switch and a $80 managed 16-port gigabit switch. He's creat…

It's entirely possible that those options weren't readily available in the local store he's using. I'm not familiar with Singapore in particular but a lot of Asian countries don't have the huge electronics box stores that are common in the US and Europe. I've seen quite a few videos where the best electronic source the person had was what would be a small sized store in a US mall (20 feet wide, one isle with a counte…

> I'm not familiar with Singapore

Singapore is a very small (~250 sq mile) country, so it would take less than 30 minutes to drive across.

It's very wealthy.

It has, almost dead center in the middle, an electronics mall called Sim Lim Tower that's like 10-20 stories tall.

They most certainly have options.

Re: Let's Build a 28-Core Raspberry Pi Cluster

#147

Post by djaque »

rasz wrote: post #73
jp0d wrote: post #62

Earlier quoted context omitted.

Hey mate. The rig looks awesome. How is the performance output compared to a regular desktop with Ryzen-5/7 or Core-i7 processor in it? Can it run Spark? Apologies if my questions are irrelevant. I'm not sure if Spark/Java works well on the ARM platform yet. Although it'd be foolish on my part to expect too much performance from something like this that costs around $600! It'd be an interesting setup to test parallel…

Imagine clustering 7 desktops from 2006, same performance.

Hahaha. Yeah, but probably an order of magnitude less power consumption though.

Re: Let's Build a 28-Core Raspberry Pi Cluster

#148

Post by Hamuko »

nforest wrote: post #143
giancarlostoro wrote: post #116

Earlier quoted context omitted.

I wondered about this, but sometimes people say it cause the previous post they see is 999 so they post it, sometimes you get lucky as heck haha. I doubt they'd screw with the admin tools just to do it.

On big boards there's so many posts per hour that it's impossible to really predict this way, it's very much luck. I remember people used to run scripts to be sure to get the big gets (6+ last digits identical) but I suppose such methods don't work anymore with captcha and other anti spam measures.

Pass users don't have CAPTCHA though.

Re: Let's Build a 28-Core Raspberry Pi Cluster

#150

Post by justinclift »

fock wrote: post #81
tra3 wrote: post #43

Earlier quoted context omitted.

The use case is tinkering. I think it’s pretty sweet to be able to build a super low cost cluster like this. Play with docker, k8s etc.

if you only want to play with software, VMs are a lot easier though (and you got to learn the basics of the VMs)

Generally, the point of a cluster like this is to also gain insight into things that involve physical components as well.

It's a different type of desired end result / learning than a purely software approach. :)

Post reply on HN