Live data from Hacker News

Tinybox – A powerful computer for deep learning

tinygrad.org

41–50 of 372 posts

Re: Tinybox – A powerful computer for deep learning

#41

My interest in anything associated with geohot took a colossal nose dive today after seeing this post against democracy, quoting frelling M*ncius M*ldbug: Democracy is a Liability. https://news.ycombinator.com/item?id=47469543 https://geohot.github.io//blog/jekyll/update/2026/03/21/demo... Theres a lot there that makes sense & I think needs to be considered. But a lot just seems to be out of the blue, included withou…

Damn, that's a take.

Re: Tinybox – A powerful computer for deep learning

#43

There's some irony in the fact that this website reads as extremely NOT AI-generated, very human in the way it's designed and the tone of its writing. Still, this is a great idea, and one I hope takes off. I think there's a good argument that the future of AI is in locally-trained models for everyone, rather than relying on a big company's own model. One thought: The ability to conveniently get this onto a 240v circu…

I am a little surprised that they openly solicit code contributions with "Invest with your PRs" but don't have any statement on AI contributions.

Maybe the volume for them is ok that well-intentioned but poor quality PRs can be politely(or otherwise, culture depending) disregarded and the method of generation is not important.

Re: Tinybox – A powerful computer for deep learning

#44
post #22

What’s the most effective ~$5k setup today? Interested in what people are actually running.

The DGX Spark is probably the best bang for your buck at $4k. It's slower than my 4090 but 128gb of GPU-usable memory is hard to find anywhere else at that price. It being an ARM processor does make it harder to install random AI projects off of GitHub because many niche Python packages don't provide ARM builds (Claude Code usually can figure out how to get things running). But all the popular local AI tools work fine out of the box and PyTorch works great.

Re: Tinybox – A powerful computer for deep learning

#45

Surprising to see this with AMD GPUs considering how George famously threw up his hands as AMD not being worth working with.

Yeah, and labeling AMD "Driver Quality" as "Good" (for comparison, they label nvidia's driver quality as "Great").

Things changed. On my new Ryzen Strix Halo laptop I was able to run training experiments with PyTorch on Windows day 1: https://news.ycombinator.com/item?id=46052535

Re: Tinybox – A powerful computer for deep learning

#46

Are we at the point where 2x 9070XT's are a viable LLM platform? (I know this has 4, just wondering for myself).

These things don’t have Flash Attention or either have a really hacked together version of it. Is it viable for a hobby? Sure. Is it viable for a serious workload with all the optimizations, CUDA, etc.. Not really.

Re: Tinybox – A powerful computer for deep learning

#48
post #31
post #22

What’s the most effective ~$5k setup today? Interested in what people are actually running.

DGX Spark is a fantastic option at this price point. You get 128GB VRAM which is extremely difficult to get at this price point. Also it’s a fairly fast GPU. And stupidly fast networking - 200gbps or 400gbps mellanox if you find coin for another one.

Can even network 4 of these together, using a pretty cheap InfiniBand switch. There is a YouTube video of a guy building and benchmarking such setup.

For 5K one can get a desktop PC with RTX 5090, that has 3x more compute, but 4x less VRAM - so depending on the workload may be a better option.

Re: Tinybox – A powerful computer for deep learning

#49

There's some irony in the fact that this website reads as extremely NOT AI-generated, very human in the way it's designed and the tone of its writing. Still, this is a great idea, and one I hope takes off. I think there's a good argument that the future of AI is in locally-trained models for everyone, rather than relying on a big company's own model. One thought: The ability to conveniently get this onto a 240v circu…

A typical U.S. 240V circuit is actually just two 120V circuits. Fairly trivial to rewire for that.

I’ve actually had half of my dryer outlet fail when half of the breaker failed.

Can confirm.

Re: Tinybox – A powerful computer for deep learning

#50

IDK, I feel it’s quite overpriced, even with the current component prices. I almost sure it’s possible to custom build a machine as powerful as their red v2 within 9k budget. And have a lot of fun along the way.

AMD now has 32 GiB Radeon AI Pro 9700. 4 of these (just under 2k each) would put you at 128 GiB VRAM
Post reply on HN