Tinybox – A powerful computer for deep learning
tinygrad.org
Tinybox – A powerful computer for deep learning
1–10 of 372 posts
Re: Tinybox – A powerful computer for deep learning
#2Sound like solid prebuilt with well balanced components and a pretty case
Not revolutionary in any way, but nice. Unless I'm missing something here?
Re: Tinybox – A powerful computer for deep learning
#3exabox -
720x RDNA5 AT0 XL 25,920 GB VRAM 23,040 GB System RAM
~ $10 Million
Who is the target market here?
Re: Tinybox – A powerful computer for deep learning
#4Sound like solid prebuilt with well balanced components and a pretty case Not revolutionary in any way, but nice. Unless I'm missing something here?
It's pretty close to what people have been frankenbuilding on r/LocaLLaMa... It's nice to have a prebuild option.
Re: Tinybox – A powerful computer for deep learning
#5Surprising to see this with AMD GPUs considering how George famously threw up his hands as AMD not being worth working with.
Re: Tinybox – A powerful computer for deep learning
#6exabox - 720x RDNA5 AT0 XL 25,920 GB VRAM 23,040 GB System RAM ~ $10 Million Who is the target market here?
VC funded startups
Re: Tinybox – A powerful computer for deep learning
#7The exabox is interesting. I wonder who the customer is; after watching the Vera Rubin launch, I cannot imagine deciding I wanted to compete with NVIDIA for hyperscale business right now. Maybe it’s aiming at a value-conscious buyer? Maybe it’s a sensible buy for a (relatively) cash-strapped ML startup; actually I just checked prices, and it looks like Vera Rubin costs half for a similar amount of GPU RAM. I’m certain that the interconnect will not be as good as NV’s.
I have no idea who would buy this. Maybe if you think Vera Rubin is three years out? But NV ships, man, they are shipping.
Re: Tinybox – A powerful computer for deep learning
#8I wonder if this is frontpage right now because of the other tiiny (the names are similar) video that went viral ... which turns out wasn't an actual product by the tinygrad linked in this post[1]
Re: Tinybox – A powerful computer for deep learning
#9Cool that you have a dual power supply model. It says rack mountable or free standing. Does that mean two form factors? $65K is more than we can afford right now but we are definitely eventually in the market for something we can run in our own colo.
It's funny though... we're using deepseek now for features in our service and based on our customer-type we thought that they would be completely against sending their data to a third-party. We thought we'd have to do everything locally. But they seem ok with deepseek which is practically free. And the few customers that still worry about privacy may not justify such a high price point.
Re: Tinybox – A powerful computer for deep learning
#10exabox - 720x RDNA5 AT0 XL 25,920 GB VRAM 23,040 GB System RAM ~ $10 Million Who is the target market here?
And... what about 20k lbs and 1360 cubic feet screams "tiny" :)