Live data from Hacker News

1GB Raspberry Pi 5, and memory-driven price rises

raspberrypi.com

51–60 of 124 posts

Re: 1GB Raspberry Pi 5, and memory-driven price rises

#51

Earlier quoted context omitted.

Good point! But they are slightly more energy hungry. At these scales I wonder if Stargate could go with one less nuclear reactor simply by switching to non-ECC RAM

Penny-wise and pound foolish. Non-ECC RAM might save on the small amount of RAM power, but if a bit-flip causes a failed computation then an entire forwards/backwards step – possibly involving several nodes – might need to be redone.

>but if a bit-flip causes a failed computation then an entire forwards/backwards step – possibly involving several nodes – might need to be redone.

Which for the most part it would be an irrelevant cost-of-doing business compared to the huge savings from non-ECC and how incosequential it is if some ChatGPT computation fails...

Re: 1GB Raspberry Pi 5, and memory-driven price rises

#52
post #25

What surprises me the most is the 1GB option is even viable though I can imagine this will be for IoT users who shove Pi's into things doing embedded stuff where a kernel with a few user space things along with maybe a container are doing all the work.

Probably but I fail to see what use case doesn't need more than 1Gb but can't be done already with a Pi 3b or 4.

Usually it's just "same thing but faster". CPU is 2-3x faster, and even boot speed is faster, so it can be handy to not have to wait so long to run updates, compile something, reboot, etc.

Re: 1GB Raspberry Pi 5, and memory-driven price rises

#53
post #16

It’s sad to see the one area of life that has long resisted inflation (computing) now succumb to inflationary forces. Other than emergency situations such as COVID-19, I’m used to seeing prices going down over time for computers and their components. It’s one of the rare bright spots when everything else is escalating in price, and now that’s disappearing.

There was the issue of hard disk prices for years after the floods in taiwan in 2011.

GPU prices were horrendes when crypto happened (they migrated into a stable issue but it was still because of crypto).

DDR4 jumped because they started focusing on DDR5 before these news right now.

I could probably find more examples but hey

Re: 1GB Raspberry Pi 5, and memory-driven price rises

#54
post #3

Earlier quoted context omitted.

Apparently OpenAI locked down 40% of the global DRAM supply for their Stargate project, which then caused everyone else to start panic-buying, and now we're here: https://pcpartpicker.com/trends/price/memory/

I dont even get this trend, wouldnt OpenAI be buying ECC RAM only anyway? Who in their right mind runs this much infrastructure on NON ECC RAM??? Makes no sense to me. Same with GPUs they aren't buying your 5090s. Peoples perception is wild to me.

The 5090 is the same chip as the workstation RTX 6000.

Of course OpenAI is also not buying that but B200 DGX systems, but that is still the same process at TSMC.

Re: 1GB Raspberry Pi 5, and memory-driven price rises

#55
post #3

Earlier quoted context omitted.

Apparently OpenAI locked down 40% of the global DRAM supply for their Stargate project, which then caused everyone else to start panic-buying, and now we're here: https://pcpartpicker.com/trends/price/memory/

It's kind of depressing to see that it takes just one asshole to screw the entire electronic market. If you read this, Sam, FU.

I understand hating at people like Musk who destroys human lifes but what is Sam Altman doing?

Because of (c) of images or just because he bought ram?

Re: 1GB Raspberry Pi 5, and memory-driven price rises

#56

Earlier quoted context omitted.

It's kind of depressing to see that it takes just one asshole to screw the entire electronic market. If you read this, Sam, FU.

I got one of the Newegg circulars in my email advertising a sweet little uATX AMD server board and got to thinking that my home FreeBSD server could use a CPU bump and more memory. As soon as I saw how much 128GB of DDR5 ECC would cost my jaw dropped and noped the fuck out. The cheapest 32GB modules are around $300 and upwards of $500. Thought I was going to gift myself early this Christmas. Depressing indeed.

Exactly this.

I'd been planning to upgrade my desktop as a christmas present for myself.

Now I have the cash and was looking at buying my PCPartPicker list, the cost of the 64GB DDR5-6000 RAM I planned to buy has gone from £300-400 to £700-800+, a difference of almost the price of the 9070 XT I just bought to go in the computer.

I guess I'll stick with my outdated AM4/X370 setup and make the best of the GPU upgrade until RAM prices stop being a complete joke.

Re: 1GB Raspberry Pi 5, and memory-driven price rises

#57
post #15
post #14

Earlier quoted context omitted.

What will happen once the bubble pops and OpenAI will not be able to pay for all the useless stuff they ordered ?

Ideally the consumer market gets flooded with surplus at cost or below server grade hardware flowing out in going out of business fire sales.

not much use for the 100GB+ AI boards or server RAM for consumers. Tho homelab guys will be thrilled.

Enterprise wise, the used servers kinda always have been cheap (at least compared to MSRP or even after discount price), just because there is enough companies that want a feel good of having a warranty on equipment and yeet it after 5 years.

Re: 1GB Raspberry Pi 5, and memory-driven price rises

#59
post #47

Earlier quoted context omitted.

I dont even get this trend, wouldnt OpenAI be buying ECC RAM only anyway? Who in their right mind runs this much infrastructure on NON ECC RAM??? Makes no sense to me. Same with GPUs they aren't buying your 5090s. Peoples perception is wild to me.

ECC RAMs utility is overblown. Major companies often use off-the-shelves non enterprise parts for huge server installations, including regular RAM. The rare bit flipping is hardly a major concern at their scale, and for their specific purposes.

Do you have a source for this?

I would not want to rerun a whole run just because of bit flips and bit flips become a lot more relevant the more servers you need.

Re: 1GB Raspberry Pi 5, and memory-driven price rises

#60
post #3
post #2

What has changed now in the memory landscape/ai workload in the recent months compared to summer or spring?

Apparently OpenAI locked down 40% of the global DRAM supply for their Stargate project, which then caused everyone else to start panic-buying, and now we're here: https://pcpartpicker.com/trends/price/memory/

> Apparently OpenAI locked down 40% of the global DRAM supply for their Stargate project

That sounds like a lot, and almost unbelievable, but the scales of all of this kind of sits in that space, so what do I know.

Nonetheless, where are you getting this specific number and story from? I've seen it echoed before, but no one been able to trace it to any sort of reliable source that doesn't boil down to "secret insider writing on Substack".

Post reply on HN