My interest in anything associated with geohot took a colossal nose dive today after seeing this post against democracy, quoting frelling M*ncius M*ldbug: Democracy is a Liability. https://news.ycombinator.com/item?id=47469543 https://geohot.github.io//blog/jekyll/update/2026/03/21/demo... Theres a lot there that makes sense & I think needs to be considered. But a lot just seems to be out of the blue, included withou…
Tinybox – A powerful computer for deep learning
81–90 of 372 posts
Re: Tinybox – A powerful computer for deep learning
#82Re: Tinybox – A powerful computer for deep learning
#83Re: Tinybox – A powerful computer for deep learning
#84I'm currently shopping for offline hardware and it is very hard to estimate the performance I will get before dropping $12K, and would love to have a baseline that I can at least always get e.g. 40 tok/s running GPT-OSS-120B using Ollama on Ubuntu out of the box.
Re: Tinybox – A powerful computer for deep learning
#85There's some irony in the fact that this website reads as extremely NOT AI-generated, very human in the way it's designed and the tone of its writing. Still, this is a great idea, and one I hope takes off. I think there's a good argument that the future of AI is in locally-trained models for everyone, rather than relying on a big company's own model. One thought: The ability to conveniently get this onto a 240v circu…
A typical U.S. 240V circuit is actually just two 120V circuits. Fairly trivial to rewire for that.
Re: Tinybox – A powerful computer for deep learning
#86Earlier quoted context omitted.
What companies are buying this instead of like a Dell server or whatever?
These specs look enormously cheaper than doing it with dell servers. The last quote I had for a bog standard dell server was $50k and only if bought in the next few days or so. The prices are going up weekly.
Re: Tinybox – A powerful computer for deep learning
#87Earlier quoted context omitted.
The $12,000 one also requires it.
Surprisingly affordable but I’m not really interested in the 9070XT. If it shipped with like 4090+ (for a higher price) it’d be more tempting.
https://x.com/__tinygrad__/status/1983917797781426511
Stopped due to raising GPU prices:
Re: Tinybox – A powerful computer for deep learning
#88Can someone explain the exabox? They say it "functions as a single GPU". Is there anything like that currently existing?
Re: Tinybox – A powerful computer for deep learning
#89Can someone explain the exabox? They say it "functions as a single GPU". Is there anything like that currently existing?
Re: Tinybox – A powerful computer for deep learning
#90The exabox is interesting. I wonder who the customer is; after watching the Vera Rubin launch, I cannot imagine deciding I wanted to compete with NVIDIA for hyperscale business right now. Maybe it’s aiming at a value-conscious buyer? Maybe it’s a sensible buy for a (relatively) cash-strapped ML startup; actually I just checked prices, and it looks like Vera Rubin costs half for a similar amount of GPU RAM. I’m certai…