Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Tinybox – A powerful computer for deep learning

tinygrad.org

Post reply on HN
Print view View original

91–100 of 372 posts

Re: Tinybox – A powerful computer for deep learning

#91

Post by dist-epoch »

zozbot234 wrote: post #13
vessenes wrote: post #7

The exabox is interesting. I wonder who the customer is; after watching the Vera Rubin launch, I cannot imagine deciding I wanted to compete with NVIDIA for hyperscale business right now. Maybe it’s aiming at a value-conscious buyer? Maybe it’s a sensible buy for a (relatively) cash-strapped ML startup; actually I just checked prices, and it looks like Vera Rubin costs half for a similar amount of GPU RAM. I’m certai…

> The exabox is interesting. Can it run Crysis?

Yes, it can generate Crysis with diffusion models at 60 fps.

Re: Tinybox – A powerful computer for deep learning

#93

Post by dist-epoch »

znpy wrote: post #51
operatingthetan wrote: post #24

The incremental price increases between products is funny. $12,000, $65,000, $10,000,000.

I was more worried by the 600kW power requirement... that's 200 houses at full load (3kw) in southern europe... which likely means 400 houses at half load. the town near my hometown has 650 – 800 houses (according to chatgpt). crazy.

Your hometown also has public lightning, water pumps, and probably some other stuff.

Re: Tinybox – A powerful computer for deep learning

#94

Post by ejpir »

aabaker99 wrote: post #92

> Can I pay with something besides wire transfer? In order to keep prices low and quality high, we don't offer any customization to the box or ordering process. Wire transfer is the only accepted form of payment. Sorry, what? Is this just a scam?

man, cmon. a little more effort.

Re: Tinybox – A powerful computer for deep learning

#96

Post by 101008 »

aabaker99 wrote: post #92

> Can I pay with something besides wire transfer? In order to keep prices low and quality high, we don't offer any customization to the box or ordering process. Wire transfer is the only accepted form of payment. Sorry, what? Is this just a scam?

Wire transfer has no comission or extra costs associated to it, so I find it very honest.

Re: Tinybox – A powerful computer for deep learning

#97

Post by cyanydeez »

Lerc wrote: post #43
ivraatiems wrote: post #12

There's some irony in the fact that this website reads as extremely NOT AI-generated, very human in the way it's designed and the tone of its writing. Still, this is a great idea, and one I hope takes off. I think there's a good argument that the future of AI is in locally-trained models for everyone, rather than relying on a big company's own model. One thought: The ability to conveniently get this onto a 240v circu…

I am a little surprised that they openly solicit code contributions with "Invest with your PRs" but don't have any statement on AI contributions. Maybe the volume for them is ok that well-intentioned but poor quality PRs can be politely(or otherwise, culture depending) disregarded and the method of generation is not important.

I'm starting to think that if you have an AI repo thats basically about codegen, you should just close all issues automatically, the manually (or whatever) open the ones you/maintainers actually care about. Thats about the only way to kill some of the signal/noise ratio AIs are creating.

Then you could focus fire, like the script kiddies did with DDoS in the old days on fixing whatever preferred issues you have.

Re: Tinybox – A powerful computer for deep learning

#98

Post by ejpir »

kristopolous wrote: post #56
mayukh wrote: post #22

What’s the most effective ~$5k setup today? Interested in what people are actually running.

Fully aware of the DGX spark I've actually been looking into AMD Ryzen AI Max+ 395/392 machines. There's some interesting things here like https://www.bee-link.com/products/beelink-gtr9-pro-amd-ryzen... and https://www.amazon.com/GMKtec-5-1GHz-LPDDR5X-8000MHz-Display... ... haven't pulled the trigger yet but apparently inferencing on these chips are not trash. Machines with the 4xx chips are coming next month so mayb…

unfortunately the bigger models are pretty slow in token speed. The memory is just not that fast.

You can check what each model does on AMD Strix halo here:

https://kyuz0.github.io/amd-strix-halo-toolboxes/

Re: Tinybox – A powerful computer for deep learning

#99

Post by aabaker99 »

ejpir wrote: post #94
aabaker99 wrote: post #92

> Can I pay with something besides wire transfer? In order to keep prices low and quality high, we don't offer any customization to the box or ordering process. Wire transfer is the only accepted form of payment. Sorry, what? Is this just a scam?

man, cmon. a little more effort.

Sure thing. For those who don’t know, wiring money like this is a good way to lose your money.

https://consumer.ftc.gov/articles/what-know-you-wire-money

Re: Tinybox – A powerful computer for deep learning

#100

Post by ilaksh »

I thought the most interesting thing about tinygrad was that theoretically you could render a model all the way into hardware similar to Taalas (tinygrad might be where Taalas got the idea for all I know).

I could swear I filed a GitHub issue asking about the plans for that but I don't see it. Anyway I think he mentioned it when explaining tinygrad at one point and I have wondered why that hasn't got more attention.

As far as boxes, I wish that there were more MI355X available for normal hourly rental. Or any.

Post reply on HN