Live data from Hacker News

Tinybox – A powerful computer for deep learning

tinygrad.org

81–90 of 372 posts

Re: Tinybox – A powerful computer for deep learning

#81

My interest in anything associated with geohot took a colossal nose dive today after seeing this post against democracy, quoting frelling M*ncius M*ldbug: Democracy is a Liability. https://news.ycombinator.com/item?id=47469543 https://geohot.github.io//blog/jekyll/update/2026/03/21/demo... Theres a lot there that makes sense & I think needs to be considered. But a lot just seems to be out of the blue, included withou…

[deleted]

Re: Tinybox – A powerful computer for deep learning

#84
I would love to see real-life tokens/sec values advertised for one or various specific open source models.

I'm currently shopping for offline hardware and it is very hard to estimate the performance I will get before dropping $12K, and would love to have a baseline that I can at least always get e.g. 40 tok/s running GPT-OSS-120B using Ollama on Ubuntu out of the box.

Re: Tinybox – A powerful computer for deep learning

#85

There's some irony in the fact that this website reads as extremely NOT AI-generated, very human in the way it's designed and the tone of its writing. Still, this is a great idea, and one I hope takes off. I think there's a good argument that the future of AI is in locally-trained models for everyone, rather than relying on a big company's own model. One thought: The ability to conveniently get this onto a 240v circu…

A typical U.S. 240V circuit is actually just two 120V circuits. Fairly trivial to rewire for that.

If you actually use two 120V circuits that way and one breaker flips the other half will send 120V through the load back into the other circuit. So while that circuit's breaker is flipped it is still live. Very bad. Much better to use a 240V breaker that picks up two rails in the panel.

Re: Tinybox – A powerful computer for deep learning

#86

Earlier quoted context omitted.

What companies are buying this instead of like a Dell server or whatever?

These specs look enormously cheaper than doing it with dell servers. The last quote I had for a bog standard dell server was $50k and only if bought in the next few days or so. The prices are going up weekly.

So what’s the catch? If it seems too good to be true it probably is.

Re: Tinybox – A powerful computer for deep learning

#87
post #79

Earlier quoted context omitted.

The $12,000 one also requires it.

Surprisingly affordable but I’m not really interested in the 9070XT. If it shipped with like 4090+ (for a higher price) it’d be more tempting.

They offered a version a few months ago with 4x5090 for 25k

https://x.com/__tinygrad__/status/1983917797781426511

Stopped due to raising GPU prices:

https://x.com/__tinygrad__/status/2011263292753526978

Re: Tinybox – A powerful computer for deep learning

#90
post #7

The exabox is interesting. I wonder who the customer is; after watching the Vera Rubin launch, I cannot imagine deciding I wanted to compete with NVIDIA for hyperscale business right now. Maybe it’s aiming at a value-conscious buyer? Maybe it’s a sensible buy for a (relatively) cash-strapped ML startup; actually I just checked prices, and it looks like Vera Rubin costs half for a similar amount of GPU RAM. I’m certai…

Sometimes you can compete with the big boys simply because they built their infra 5+ years ago and it’s not economically viable for them to upgrade yet, because it’s a multi-billion dollar process for them. They can run a deficit to run you out of the business, but if you’re taking less than 0.01% of their business, I doubt they’d give a crap.
Post reply on HN