Live data from Hacker News

Tinybox – A powerful computer for deep learning

tinygrad.org

261–270 of 372 posts

Re: Tinybox – A powerful computer for deep learning

#261
post #249

Earlier quoted context omitted.

It's a shipping container that you install outdoors.

Are you referring to the images of branded shipping containers on their Twitter page that have visible Gemini watermarks … and jokes in the comments about AI trailer parks?

20x8x8.5 ft is the dimensions of a half shipping container. You think that render is a joke but it's not. They don't have photos yet because it's a 2027 product (if it actually comes out which I would bet against).

Re: Tinybox – A powerful computer for deep learning

#262
post #258

Earlier quoted context omitted.

Not a joke. It's just true.

It doesn't matter if it's a joke. The non-technical manager or VP making this purchase will not understand it and will expect poor treatment from this vendor, an expectation that will be reinforced by numerous other things on this page. There is no reason to include it at all.

It doesn’t read as if they actually care about broad appeal, given their plain refusal to accommodate traditional procurement processes

Re: Tinybox – A powerful computer for deep learning

#263
post #261

Earlier quoted context omitted.

Are you referring to the images of branded shipping containers on their Twitter page that have visible Gemini watermarks … and jokes in the comments about AI trailer parks?

20x8x8.5 ft is the dimensions of a half shipping container. You think that render is a joke but it's not. They don't have photos yet because it's a 2027 product (if it actually comes out which I would bet against).

[deleted]

Re: Tinybox – A powerful computer for deep learning

#264

Earlier quoted context omitted.

Your framing of this section is misleading. On the site it's preceded by a FAQ-style 'question': > Can you fill out this supplier onboarding form? That's very important context, as anyone who has been asked to fill out a supplier onboarding form (hi) will attest.

Filling out an onboarding form is an example of what he's not willing to do, not the only thing he isn't willing to do. > we don't offer any customization to the box or ordering process Every B2B deal of that size that I've ever seen requires at least weeks of meetings between the customer and vendor, in which every detail is at least discussed if not negotiated. That would certainly constitute a "customization" to t…

Then if they succeed, I guess you're going to see a different process for the first time in your life.

On a website where we frequently talk about disruptive business models, this whole attitude kinda stinks.

Re: Tinybox – A powerful computer for deep learning

#265
post #164
post #2

Sound like solid prebuilt with well balanced components and a pretty case Not revolutionary in any way, but nice. Unless I'm missing something here?

If you wanted a box built by geohot, most recently known for signing on to Elons Twitter and then bailing, it's for you

actually known for comma.ai

Re: Tinybox – A powerful computer for deep learning

#266

There's some irony in the fact that this website reads as extremely NOT AI-generated, very human in the way it's designed and the tone of its writing. Still, this is a great idea, and one I hope takes off. I think there's a good argument that the future of AI is in locally-trained models for everyone, rather than relying on a big company's own model. One thought: The ability to conveniently get this onto a 240v circu…

A typical U.S. 240V circuit is actually just two 120V circuits. Fairly trivial to rewire for that.

Yes, if you have a 240V US split-phase circuit you could make a little sub-panel with a 40A breaker feeding two 20A 120V circuits and plug the two power supplies into each side. (1600W would need a 20-A breaker because 13.3A would be too much of a 15A circuit). But it would probably make more sense to just plug them both into the same 40A 240V circuit. If you use NEMA 6-20, make sure you label it appropriately and probably color it red.

In Europe, you could plug the two power supplies into an appropriately sized 240V circuit.

In an apartment you can't rewire, you could set it up in your kitchen, which in the modern US code should have two separate 20A circuits. You will need to put it to sleep while you use appliances.

Re: Tinybox – A powerful computer for deep learning

#267

Earlier quoted context omitted.

Filling out an onboarding form is an example of what he's not willing to do, not the only thing he isn't willing to do. > we don't offer any customization to the box or ordering process Every B2B deal of that size that I've ever seen requires at least weeks of meetings between the customer and vendor, in which every detail is at least discussed if not negotiated. That would certainly constitute a "customization" to t…

Then if they succeed, I guess you're going to see a different process for the first time in your life. On a website where we frequently talk about disruptive business models, this whole attitude kinda stinks.

> Then if they succeed, I guess you're going to see a different process for the first time in your life.

Sure, I guess. Far more likely that they won't succeed, and it will be because of their pointless refusal to cooperate with others. I'm curious why you think we should "disrupt" companies putting a little due diligence into massive purchases.

> On a website where we frequently talk about disruptive business models, this whole attitude kinda stinks.

I could say the same thing about making a comment like this on a website where groupthink is rightfully mocked.

Re: Tinybox – A powerful computer for deep learning

#268

Earlier quoted context omitted.

I think you're forgetting the wires? If you have one outlet with a 15-20A 120V circuit, then the wiring is almost certainly rated for 15-20A. If you just "combined" two 120V circuits into a 240V circuit, you still need an outlet that is rated for 30A, the wires leading to it also need to be rated for 30A, and it definitely needs a neutral. So you still need a new wire run if you don't have two 120V circuits right whe…

I think you might've misread GP. (Or maybe I did?) He's not saying you would use it as two separate 120v circuits sharing a ground but rather as a single 240v circuit. His point is that it's easy to rewire for 240v since it's the same as all the other wiring in your house just with both poles exposed. Of course you do have to run a new wire rather than repurpose what's already in the wall since you need the entire ci…

The wiring (at least in the US) to the 120V outlets is just one half of the split-phase 240V. If you want to send 240V down a particular wire, you can do that, by changing the breaker, but then you lose the neutral. You also make the wires dangerous to people who don't realize that the white wire is now energized at 120V over ground. (Though it's best to test to be sure anyway, as polarity gets reversed by accident, etc.) Live wires should be black or red.

Re: Tinybox – A powerful computer for deep learning

#270
post #173

$12,000 for the base model is insane. I have an Apple M3 Max with 128GB RAM that can run 120B parameter models using like 80 watts of electricity at about 15-20 tokens/sec. It's not amazing for 120B parameter models but it's also not 12 grand.

M3 max tflops is tiny compared to the 12k box. It's not even comparable.

It is very comparable if you work out the $/tok/s on inference. I did some napkin math and it looks like you’re getting roughly 3x the performance for 3x the cost. Red v2 vs Mac Studio M3 Ultra 96GB.

If you compare tokens/kWh efficiency then my math has Mac Studio being about 1.5x more efficient.

Post reply on HN