Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Tinybox – A powerful computer for deep learning

tinygrad.org

Post reply on HN
Print view View original

131–140 of 372 posts

Re: Tinybox – A powerful computer for deep learning

#131

Post by overfeed »

oofbey wrote: post #68
BobbyJo wrote: post #37

Earlier quoted context omitted.

Internet seems to think the SW support for those is bad, and that strix halo boxes are better ROI.

Meh. DGX is Arm and CUDA. Strix is X86 and ROCm. Cuda has better support than ROCm . And x86 has better support than Arm. Nowadays I find most things work fine on Arm. Sometimes something needs to be built from source which is genuinely annoying. But moving from CUDA to ROCm is often more like a rewrite than a recompile.

> But moving from CUDA to ROCm is often more like a rewrite than a recompile.

Isn't everyone* in this segment just using PyTorch for training, or wrappers like Ollama/vllm/llama.cpp for inference? None have a strict dependency on Cuda. PyTorch's AMD backend is solid (for supported platforms, and Strix Halo is supported).

* enthusiasts whose budget is in the $5k range. If you're vendor-locked to CUDA, Mac Mini and Strix Halo are immediately ruled out.

Re: Tinybox – A powerful computer for deep learning

#133

Post by SmartestUnknown »

Regarding 2x faster than pytorch being a condition for tinygrad to come out of alpha:

Can they/someone else give more details as to what workloads pytorch is more than 2x slower than the hardware provides? Most of the papers use standard components and I assume pytorch is already pretty performant at implementing them at 50+% of extractable performance from typical GPUs.

If they mean more esoteric stuff that requires writing custom kernels to get good performance out of the chips, then that's a different issue.

Re: Tinybox – A powerful computer for deep learning

#135

Post by LogicFailsMe »

SilverElfin wrote: post #103
stale2002 wrote: post #61

Earlier quoted context omitted.

Geohotz's politics are fairly straightforward once you understand his background. Geohotz is the prodigy child who, at the age of ~16 accomplished amazing technical feats on his own. And his politics are a derivative of Great Man Theory, and his positions on things like democracy follow from that. This idea, and those espoused by some of the VC/tech elite like Peter Theil are that singular hardworking genius individu…

What makes it “Libertarianism” still? To me it feels like they’re taking away freedom, control, and influence from everyone who is not them. Even the concentration of wealth is itself taking away everyone else’s places in the world.

Scratch a libertarian and a fascist bleeds libertarianism here, no?

Re: Tinybox – A powerful computer for deep learning

#139

Post by overfeed »

stale2002 wrote: post #61
jauntywundrkind wrote: post #11

My interest in anything associated with geohot took a colossal nose dive today after seeing this post against democracy, quoting frelling M*ncius M*ldbug: Democracy is a Liability. https://news.ycombinator.com/item?id=47469543 https://geohot.github.io//blog/jekyll/update/2026/03/21/demo... Theres a lot there that makes sense & I think needs to be considered. But a lot just seems to be out of the blue, included withou…

Geohotz's politics are fairly straightforward once you understand his background. Geohotz is the prodigy child who, at the age of ~16 accomplished amazing technical feats on his own. And his politics are a derivative of Great Man Theory, and his positions on things like democracy follow from that. This idea, and those espoused by some of the VC/tech elite like Peter Theil are that singular hardworking genius individu…

> also because they are willing to break the rules that are set forth by this bottom 99.9%[...] they are going about this imposition of their will on the world by doing it all themselves, through their own hard work.

I think all these wildly successful neo-feudalists get increasingly emboldened the more they get away with bigger and bigger social infractions.

It's also clear that they haven't experienced existed an environment with extreme inequality - it's not safe for anyone there! They think the NPC plebs will continue to follow "the rules" ad perpetuam without considering that it is a direct result of the stability they are actively undermining. They clearly don't read enough history.

Re: Tinybox – A powerful computer for deep learning

#140

Post by latchkey »

Gigachad wrote: post #138
latchkey wrote: post #136

Earlier quoted context omitted.

Old news. ROCm works a lot better now than it did a year ago.

You are still really limited in what you can run. So much stuff is cuda only.

Like what? Most of the good stuff is ported over already and anything else, tag Anush on X and see what you get. Also happy to help.

The point is that they care now.

Post reply on HN