Live data from Hacker News

Building the heap: racking 30 petabytes of hard drives for pretraining

si.inc

11–20 of 281 posts

Re: Building the heap: racking 30 petabytes of hard drives for pretraining

#11
post #5

So how do they get this data to the GPUs now...? Just run it over the public internet to the datacenter?

They can rent a dark fiber for themselves for that distance, and it'll be cheap. However, as they noted they use 100gbps capacity from their ISP.

We want to get darkfiber from the datacenter to the office. I love 100Gbps

Re: Building the heap: racking 30 petabytes of hard drives for pretraining

#16
post #2

No mention of disk failure rates? curious how it's holding up after a few months

They mentioned the cluster being used enterprise drives, I can see the desire to save money but agree, that is going to be one expensive mistake down the road.

I should also note personally for home cluster use, I learned quickly that used drives didn’t seem to make sense. Too much performance variability.

Re: Building the heap: racking 30 petabytes of hard drives for pretraining

#18

But where do you get 90 million hours worth of video data?

And not just any video data, they specifically mentioned screen recordings for agentic computer uses. A very specific kind of video. My guess is they have a partnership with someone like Rewind.ai
Post reply on HN