21–30 of 138 posts
[flagged]
For me, it required a hard unfollow and sometimes block for anyone talking politics, softer measures for dunking/clickbait/bullshit. After that, the place is a pretty great with smart engineers talking engineering.
For those wondering, 3200W power, in residential / low-end commercial in the US, they say you'll need two separate circuits, they have a built-in power limiting utility in the OS which will let you safely run on one circuit at reduced speed.
The only part of this that gives me pause is interconnect -- over PCIe, 64GB/s stated. This is much, much lower than infiniband -- can any ML engineers comment on using this box for a full finetune of, say, LLama 3.1 / 70b?
Very unusual specs on paper. - Air cooling 6x4090 and a 32 core CPU for sustained peak workloads. - 3200W total power when a single 4090 can draw close to 600W. Maybe they are targeting startups who aren't interested in overclocking.
A 4090 draws 450W unless you unlock the power limit
And with a distributed training you can end-up with "synchronized" transients over all cards :(.
Very unusual specs on paper. - Air cooling 6x4090 and a 32 core CPU for sustained peak workloads. - 3200W total power when a single 4090 can draw close to 600W. Maybe they are targeting startups who aren't interested in overclocking.
This thing could run off a single US outlet (1600W) with some throttling, if I'm not mistaken? Shame it wasn't designed for EU sockets. 230V*16A = 3700W, or double that on separate breakers!
They have a real website, why not link to that instead of Twitter?
[flagged]
The feed should adapt to your tastes depending on what you like, retweet or who you follow, maybe also on what you click on. You can also add topic of interest somewhere in your profile.
For me, just following a number of "good" accounts seems to do the job.
Or you could just ignore the "For You" tab and use the "Following" tab
[flagged]
Social media sites are the collective equivalent of a "dollar auction"[1] In the dollar auction, each immediate choice isrational, but the overall process inevitably results in you losing value once you've decided to participate. But at each step, you lose more by quitting than by keeping going. Social media is the same, except that it's collective: if you want to keep in touch with certain people, you don't have a c…
[flagged]
Social media sites are the collective equivalent of a "dollar auction"[1] In the dollar auction, each immediate choice isrational, but the overall process inevitably results in you losing value once you've decided to participate. But at each step, you lose more by quitting than by keeping going. Social media is the same, except that it's collective: if you want to keep in touch with certain people, you don't have a c…
An alcoholic who can't stop going to the bar because they will lose their drinking buddies is not a dollar auction.
https://tinygrad.org/#tinybox Looks like good value, but I wonder if it would get CPU/RAM bottlenecked, especially if you want to train something with a lot of preprocessing in the pipeline. Something comparable I've found with 7x4090 which comes to about $50k, but with much better CPU/RAM (3x CPU, 4x RAM, 5x SSD): https://www.overclockers.co.uk/8pack-supernova-mk3-amd-ryzen...
> 6x PCIe 4.0 x16 (64 GB/s) Wikipedia [0] states that PCIe 4.0 x16 has a throughput of ~32GB/s, what does the (64 GB/s) indicate on the website, is this just a typo and you have 6x ~32GB/s or does it mean in total you can "only" expect a throughput of 64GB/s all lanes slots combined? If so, wouldn't you also be bottlenecked by the PCIe bandwidth (when moving data between CPU and GPU)? [0] https://en.wikipedia.org/wik…
https://tinygrad.org/#tinybox Looks like good value, but I wonder if it would get CPU/RAM bottlenecked, especially if you want to train something with a lot of preprocessing in the pipeline. Something comparable I've found with 7x4090 which comes to about $50k, but with much better CPU/RAM (3x CPU, 4x RAM, 5x SSD): https://www.overclockers.co.uk/8pack-supernova-mk3-amd-ryzen...