Theres a lot there that makes sense & I think needs to be considered. But a lot just seems to be out of the blue, included without connection, in my view. Feels like maybe are in-grouo messages, that I don't understand. How this is headered as against democracy is unclear to me, and revolting. I both think we must grapple with the world as it is, and this post is in that area, strongly, but to let fear be the dominant ruling emotion is one of the main definitions of conservativism, and it's use here to scare us sounds bad.
Tinybox – A powerful computer for deep learning
11–20 of 372 posts
Re: Tinybox – A powerful computer for deep learning
#12Still, this is a great idea, and one I hope takes off. I think there's a good argument that the future of AI is in locally-trained models for everyone, rather than relying on a big company's own model.
One thought: The ability to conveniently get this onto a 240v circuit would be nice. Having to find two different 120v circuits to plug this into will be a pain for many folks.
Re: Tinybox – A powerful computer for deep learning
#13The exabox is interesting. I wonder who the customer is; after watching the Vera Rubin launch, I cannot imagine deciding I wanted to compete with NVIDIA for hyperscale business right now. Maybe it’s aiming at a value-conscious buyer? Maybe it’s a sensible buy for a (relatively) cash-strapped ML startup; actually I just checked prices, and it looks like Vera Rubin costs half for a similar amount of GPU RAM. I’m certai…
Can it run Crysis?
Re: Tinybox – A powerful computer for deep learning
#14Re: Tinybox – A powerful computer for deep learning
#15Re: Tinybox – A powerful computer for deep learning
#16Surprising to see this with AMD GPUs considering how George famously threw up his hands as AMD not being worth working with.
Re: Tinybox – A powerful computer for deep learning
#17Sound like solid prebuilt with well balanced components and a pretty case Not revolutionary in any way, but nice. Unless I'm missing something here?
It's pretty close to what people have been frankenbuilding on r/LocaLLaMa... It's nice to have a prebuild option.
Re: Tinybox – A powerful computer for deep learning
#18Cool that you have a dual power supply model. It says rack mountable or free standing. Does that mean two form factors? $65K is more than we can afford right now but we are definitely eventually in the market for something we can run in our own colo. It's funny though... we're using deepseek now for features in our service and based on our customer-type we thought that they would be completely against sending their d…
Re: Tinybox – A powerful computer for deep learning
#19exabox - 720x RDNA5 AT0 XL 25,920 GB VRAM 23,040 GB System RAM ~ $10 Million Who is the target market here?