Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Tinybox – A powerful computer for deep learning

tinygrad.org

Post reply on HN
Print view View original

231–240 of 372 posts

Re: Tinybox – A powerful computer for deep learning

#231

Post by jen729w »

roarcher wrote: post #221

> In order to keep prices low and quality high, we don't offer any customization to the box or ordering process. If you aren't capable of ordering through the website, I'm sorry but we won't be able to help. Has this guy never worked on a B2B product before? Nobody is going to order a $10 million piece of infrastructure through your website's order form. And they are definitely going to want to negotiate something ,…

Your framing of this section is misleading. On the site it's preceded by a FAQ-style 'question':

> Can you fill out this supplier onboarding form?

That's very important context, as anyone who has been asked to fill out a supplier onboarding form (hi) will attest.

Re: Tinybox – A powerful computer for deep learning

#232

Post by all2 »

adrianwaj wrote: post #191
ivraatiems wrote: post #12

There's some irony in the fact that this website reads as extremely NOT AI-generated, very human in the way it's designed and the tone of its writing. Still, this is a great idea, and one I hope takes off. I think there's a good argument that the future of AI is in locally-trained models for everyone, rather than relying on a big company's own model. One thought: The ability to conveniently get this onto a 240v circu…

"locally-trained models for everyone" Wouldn't there be a massive duplication of effort in that case? It'll be interesting to see how the costs play out. There are security benefits to think about as well in keeping things local-first.

There are multiple efforts for 'folding at home' but for AI models at this point. I get the impression that we will see a frontier model released this year built on a system like this.

Re: Tinybox – A powerful computer for deep learning

#233

Post by all2 »

KeplerBoy wrote: post #66
Lerc wrote: post #43

Earlier quoted context omitted.

I am a little surprised that they openly solicit code contributions with "Invest with your PRs" but don't have any statement on AI contributions. Maybe the volume for them is ok that well-intentioned but poor quality PRs can be politely(or otherwise, culture depending) disregarded and the method of generation is not important.

Tinygrad sure shared a few opinions on AI PRs on Twitter. I believe the gist was "we have Claude code as well, if that's all you bring don't bother".

That's a pretty excellent take, IMO. Just an undirected AI model doesn't do much, especially when the core team has time with the code, domain expertise, _and_ Claude.

Re: Tinybox – A powerful computer for deep learning

#236

Post by razingeden »

amluto wrote: post #207
reactordev wrote: post #125

Earlier quoted context omitted.

This. It definitely comes in at a higher voltage.

Sort of? It’s 120V RMS to ground.

yes, this is accurate for US and “works” but it’s against code here. you’ll get mildly shocked by metallic cabinets and fixtures especially if you’re barefoot and become the new shortest path to ground.

old construction in the US sometimes did this intentionally (so old, the house didn’t have grounds. Or to “pass” an inspection and sell a place) but if a licensed electrician sees this they have to fix it.

I’m dealing with a 75 year old house that’s set up this way, the primary issue this is causing is that a 50amp circuit for their HVACs are taking a shorter path to ground inside the house instead of in the panel.

As a result the 50 amp circuit has blown through several of the common 20amp grounds and neutrals and left them with dead light fixtures and outlets because they’re bridged all over the place.

If an HVAC or two does this, I’d advise against this for your 3200 watt AI rig.

EU, you don’t want to try to energize your ground. They use step down transformers or power supplies capable of taking 115-250 (their systems are 240-250V across the load and neutral lines. Not 120 across the load and neutral like ours.)

in the US. you’re talking about energizing your ground plane with 120v and I don’t want to call that safe… but it’s REALLY NOT SAFE to make yourself the shortest path to ground on say. a wet bathroom floor. with 220V-250v.

Re: Tinybox – A powerful computer for deep learning

#237

Post by paxys »

nine_k wrote: post #147
paxys wrote: post #110

The problem with all these "AI box" startups is that the product is too expensive for hobbyists, and companies that need to run workloads at scale can always build their own servers and racks and save on the markup (which is substantial). Unless someone can figure out how to get cheaper GPUs & RAM there is really no margin left to squeeze out.

Would a hedge fund that does not want to trust to a public AI cloud just buy chassis, mobos, GPUs, etc, and build an equivalent themselves? I suspect they value their time differently.

Why do you think a hedge fund can't hire a couple of IT guys? Most of the larger ones have technical operations that would put big tech to shame.

Re: Tinybox – A powerful computer for deep learning

#238

Post by razingeden »

trollbridge wrote: post #27
ivraatiems wrote: post #12

There's some irony in the fact that this website reads as extremely NOT AI-generated, very human in the way it's designed and the tone of its writing. Still, this is a great idea, and one I hope takes off. I think there's a good argument that the future of AI is in locally-trained models for everyone, rather than relying on a big company's own model. One thought: The ability to conveniently get this onto a 240v circu…

A typical U.S. 240V circuit is actually just two 120V circuits. Fairly trivial to rewire for that.

A US circuit is.

But this is re: European 240/250 which is 240 between its load and neutral

I’d say don’t energize either systems ground plane, but , really, don’t do this in EU

Re: Tinybox – A powerful computer for deep learning

#239

Post by jrflowers »

roarcher wrote: post #227
jrflowers wrote: post #223

Earlier quoted context omitted.

I imagine that the FAQ might get updated when there’s actually a $10M machine for sale

Maybe. Frankly I'd be very surprised if any business ordered a $65k machine that way either.

Yeah it’s a little odd. Maybe they are meant to be really really cool toys? People regularly spend more than $65k on things like cars to show off, so it could be like that.

I have no use for these but I might buy one anyway if I won the lottery. ¯\_(ツ)_/¯

Re: Tinybox – A powerful computer for deep learning

#240

Post by roarcher »

jen729w wrote: post #231
roarcher wrote: post #221

> In order to keep prices low and quality high, we don't offer any customization to the box or ordering process. If you aren't capable of ordering through the website, I'm sorry but we won't be able to help. Has this guy never worked on a B2B product before? Nobody is going to order a $10 million piece of infrastructure through your website's order form. And they are definitely going to want to negotiate something ,…

Your framing of this section is misleading. On the site it's preceded by a FAQ-style 'question': > Can you fill out this supplier onboarding form? That's very important context, as anyone who has been asked to fill out a supplier onboarding form (hi) will attest.

Filling out an onboarding form is an example of what he's not willing to do, not the only thing he isn't willing to do.

> we don't offer any customization to the box or ordering process

Every B2B deal of that size that I've ever seen requires at least weeks of meetings between the customer and vendor, in which every detail is at least discussed if not negotiated. That would certainly constitute a "customization" to this guy's prescribed ordering process, which is to "Buy it now" [1] through the website at the stated price like you're ordering a jar of peanuts on Amazon. This is not "framing", it's what the guy said. If it isn't what he meant then he needs to fix his copy.

[1] Yes, there is an actual "Buy it now" button for a $65,000 business purchase that takes you to a page that looks just like a Stripe form. There isn't even a textbox for delivery instructions. Wild.

Post reply on HN