"but if you haven't contributed to tinygrad your application won't be considered" this company expects people to work for free?
[deleted]
Tinybox – A powerful computer for deep learning
111–120 of 372 posts
Re: Tinybox – A powerful computer for deep learning
#112I would love to see real-life tokens/sec values advertised for one or various specific open source models. I'm currently shopping for offline hardware and it is very hard to estimate the performance I will get before dropping $12K, and would love to have a baseline that I can at least always get e.g. 40 tok/s running GPT-OSS-120B using Ollama on Ubuntu out of the box.
Look for llmfit on github. This will help with that analysis. I've found it reasonably accurate. If you have Ollama already installed, it can download the relevant models directly.
Re: Tinybox – A powerful computer for deep learning
#113Earlier quoted context omitted.
man, cmon. a little more effort.
Sure thing. For those who don’t know, wiring money like this is a good way to lose your money. https://consumer.ftc.gov/articles/what-know-you-wire-money
Wire transfer is a bank transfer, not money wire to Western Union and like.
Re: Tinybox – A powerful computer for deep learning
#114There's some irony in the fact that this website reads as extremely NOT AI-generated, very human in the way it's designed and the tone of its writing. Still, this is a great idea, and one I hope takes off. I think there's a good argument that the future of AI is in locally-trained models for everyone, rather than relying on a big company's own model. One thought: The ability to conveniently get this onto a 240v circu…
I find that the most respected writing about AI has very few signs of being written by AI. I'm guessing that's because people in the space are very sensitive to the signs and signal vs. noise.
Re: Tinybox – A powerful computer for deep learning
#115There's some irony in the fact that this website reads as extremely NOT AI-generated, very human in the way it's designed and the tone of its writing. Still, this is a great idea, and one I hope takes off. I think there's a good argument that the future of AI is in locally-trained models for everyone, rather than relying on a big company's own model. One thought: The ability to conveniently get this onto a 240v circu…
A typical U.S. 240V circuit is actually just two 120V circuits. Fairly trivial to rewire for that.
It's more accurate to say that the typical 120V circuit is just a 240V source with the neutral tapped into the midpoint of the transformer winding.
Re: Tinybox – A powerful computer for deep learning
#116Earlier quoted context omitted.
AMD now has 32 GiB Radeon AI Pro 9700. 4 of these (just under 2k each) would put you at 128 GiB VRAM
VRAM is not everything - GPU cores also matter (a lot) for inference
inference speed is like monitor Hz; sure, you go from 60 to 120Hz and thats noticeable, but unless your model is AGI, at some point you're just generating more code than you'll ever realistically be able to control, audit and rely on.
So, context is probably more $/programming worth than inference speed.
Re: Tinybox – A powerful computer for deep learning
#117Who is this for?
Re: Tinybox – A powerful computer for deep learning
#118Earlier quoted context omitted.
Sure thing. For those who don’t know, wiring money like this is a good way to lose your money. https://consumer.ftc.gov/articles/what-know-you-wire-money
Wire transfer is a bank transfer, not money wire to Western Union and like.
Yeah I agree the FTC article could be more clear here. I think they call out Western Union because those are tools that are commonly used by scammers.
But let’s be clear: the risks are the same if you are wiring money through Western Union or wiring through any other bank. Once you wire the money you do not have the same protections as other payment mechanisms. And if you don’t get the product as described, you are likely out your money. This is compared to other forms of payment like credit cards where you are protected. With a credit card you can issue a charge back to the seller and get your money back in the case of fraud. With a wire transfer you cannot.
Re: Tinybox – A powerful computer for deep learning
#119What’s the most effective ~$5k setup today? Interested in what people are actually running.
At $7.2k + tax:
* RAM - $1500 - Crucial Pro 128GB Kit (2x64GB) DDR5 RAM, 5600MHz CP2K64G56C46U5, up to 4 sticks for 128GB or 256GB, Amazon
* GPU - $4700 - RTX Pro 5000 48GB, Microcenter
* CPU/Mobo bundle - $1100 - AMD Ryzen 7 9800X3D, MSI X870E-P Pro, ditch the 32GB RAM, Microcenter
* Case - $220, Hyte Y70, Microcenter
* Cooler - $155, Arctic Cooling Liquid Freezer III Pro, top-mount it, Microcenter
* PSU - $180, RM1000x, Microcenter
* SSD - $400 - Samsung 990 pRO 2TB gen 4 NVMe M.2
* Fans - $100 - 6x 120mm fans, 1x 140mm fan, of your choice
Look into models like Qwen 3.5
Re: Tinybox – A powerful computer for deep learning
#120Tinybox is cool but I think the market is maybe looking more for a turn-key explicit promise of some level of intelligence @ a certain Tok/s like "Kimi 2.5 at 50Tok/s".