Live data from Hacker News

Let's Build a 28-Core Raspberry Pi Cluster

ikarus.sg

121–130 of 158 posts

Re: Let's Build a 28-Core Raspberry Pi Cluster

#121
post #66

Reminds me of moot "revealing" the "datacenter" that hosted 4chan: https://imgur.com/sBLRuZY I'm putting the air-quotes because I still sincerely hope that it was a joke

> I'm putting the air-quotes because I still sincerely hope that it was a joke

Hey if it worked, I'd consider that impressive, not concerning!

Re: Let's Build a 28-Core Raspberry Pi Cluster

#122
post #8

I have to admire someone who spends their first paycheck on a pi cluster: > The total damage my wallet sustained from Kraken was S$626.63 or in $449.73 USD, which was virtually all I had left for the month after subtracting expenses and education loan repayments.

I think one could easily calculate ROI in incoming recruiter messages after reaching first page of HN with personal blog, if nothing else.

Re: Let's Build a 28-Core Raspberry Pi Cluster

#123

I wonder if there is something to be said for not using Ethernet in something like this? Perhaps it is possible to make a kind of IP over GPIO interface, or attach them all directly to a USB bus? It just seems to me like RasPi -> USB -> Ethernet (for less than 1m) -> USB -> RasPi has a layer or two more than necessary (and I believe the on-board ethernets on RasPi are USB interfaces to the chip too). Could be an inte…

It would be educational.

I'd say the most interesting way to approach this at the moment would be to use RasPi 4s and link them via the PCI express bus.

None of this stuff is more than educational, though. I admire this build because it's almost a rite of passage for nerds to build a cluster, but when you're all done and the cool wears off you've basically got a pile of obsolete hardware for which you need to find a home.

Re: Let's Build a 28-Core Raspberry Pi Cluster

#125
post #75
post #37

Earlier quoted context omitted.

People who complain about SD card "reliability" is just writing to it way too often . Longevity of NAND flash is measured in TBW(total bytes written, in terabytes) but they have 4MB or so minimum size for write access, so people easily end up writing effectively gigabytes over weeks or months thinking it's just kilobytes averaged and use up all its life in just few months to years. You don't need "better quality SD c…

That's very interesting and explains a number of things. 4MB writes seems pretty high though as a minimum write block size, I've googled but can't find details among the sea of pages trying to sell me SD cards, won't you by chance have a reference? Thanks!

Google search for "microsd erase block size"[0]

From a forum post in raspberrypi.org[1]:

> My 16 GB SanDisk Extreme Pro 45 MB/s UHS 1 card reports an erase block size of 4 MB.

> My 8 GB Transcend SDHC Class 6 150x card reports an erase block size of 4 MB.

> My 2 GB Transcend SD 150x card reports an erase block size of 8 kB.

.

From another post from StackExchange.com[2]:

> the data cannot be overwritten without being erased first and an erase block is the smallest unit that a NAND flash storage can erase. The erase block size is typically between 128 kB and 2 MB.

.

According to a Micron Technical Note from 2006[3]:

> The NAND Flash device discussed in this technical note is based on a 2Gb asynchronous SLC device and its parameters (unless otherwise noted).

> The NAND Flash array is grouped into a series of blocks, which are the smallest erasable entities in a NAND Flash device.

> A NAND Flash block is 128KB. Erasing a block sets all bits to 1 (and all bytes to FFh). Programming is necessary to change erased bits from 1 to 0. The smallest entity that can be programmed is a byte.

(Note: 2 gigabits = 256 MB)

.

In a more modern TLC 3D NAND chip from 2016[4]:

> Block Size 27,888K bytes

or 27.888MB

---

[0]: https://www.google.com/search?q=microsd+erase+block+size

[1]: https://www.raspberrypi.org/forums/viewtopic.php?t=11258

[2]: https://raspberrypi.stackexchange.com/questions/32884/

[3]: https://www.micron.com/-/media/client/global/documents/produ...

[4]: https://www.micron.com/-/media/client/global/documents/produ...

Re: Let's Build a 28-Core Raspberry Pi Cluster

#126

> The maximum number of ports on a consumer-grade network switch was 8, enough for 7 nodes and a cable to the router. Are there laws in Singapore that delineate between consumer and business grade networking equipment based on port numbers or something? Here in Yankey Land you can pickup a consumer grade 16-port unmanaged gigabit switch for $50 at the local Wally World. The going rate on switch ports is $3-4 per port…

It looks like it was more a question of price in their market. In the post he mentions a 16 port switch but it's 10x the price of an 8 port. I bet it's a question of there being fewer people in the Singapore market looking for an >8 port switch on the low end of the market.

Re: Let's Build a 28-Core Raspberry Pi Cluster

#127
post #62

Earlier quoted context omitted.

Hey mate. The rig looks awesome. How is the performance output compared to a regular desktop with Ryzen-5/7 or Core-i7 processor in it? Can it run Spark? Apologies if my questions are irrelevant. I'm not sure if Spark/Java works well on the ARM platform yet. Although it'd be foolish on my part to expect too much performance from something like this that costs around $600! It'd be an interesting setup to test parallel…

> How is the performance output compared to a regular desktop Sorry, but often budget (junk) CPUs are only 10% of the performance of current desktop-class processors. You can use "openssl speed" to test and compare performance. When I was experimenting with Intel's Atom netbook chip, it was exactly 10% of a Xeon thread. So it could be used for httpd static content, but not java. > It'd be an interesting setup to test…

Are you sure that it wasn't due to the fact that Intel Atom doesn't have AES instruction set[1]? I think openssl uses it a lot so it would explain this huge difference (since looking at the clocks, AVX/SSEs etc. I would expect at most ~50% difference looking at single core of Xeon vs single core of Atom) unless generations of Xeon and Atom were many years apart. I think newer RbPis CPUs have AES instructions so they could be faster than Atoms in applications that utilise it.

[1] https://en.wikipedia.org/wiki/AES_instruction_set

Re: Let's Build a 28-Core Raspberry Pi Cluster

#128

People wanting to torture themselves with k8s at home ... I still dont understand why.

I'd want to - or rather, the idea of managing a series of applications in a distributed fashion is interesting to me.

HOWEVER, i like to write distributed software that i want "uninformed" users to run. Aka not run on nice, automated k8 deployments - but on dirty, random computers.

My current idea is to run this software on all my personal PCs, but also a couple RaspPis over wifi in random locations.

Slow, poor connectivity machines sounds like a decent and predictably bad user environment.

Re: Let's Build a 28-Core Raspberry Pi Cluster

#129
post #79

"This build is for you if you:" ahem, for 600 dollars I get a fine computer which can host all the kubernets and docker I ever want in a nice formfactor... I mean, it's cool and all, but effectively utterly useless except for the blinking lights.

And cost effective redundancy.

Re: Let's Build a 28-Core Raspberry Pi Cluster

#130
post #108

How timely... just today I received my CloverPi which I backed on Kickstarter (no other affiliation), a “back panel to enable 4 RaspberryPis to be clustered”. Finally I can earn my “ My other computer is a Beowulf Cluster ” bumper sticker from what feels like aeons ago (courtesy of the now-defunct ThinkGeek.com ).

> now-defunct ThinkGeek.com

Noooo!! They had the best toys.

Unfortunately their shipping to Canada made everything double the price for me...

Post reply on HN