Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

"Tinyboxes finally have a buy it now button"

twitter.com

Post reply on HN
Print view View original

91–100 of 138 posts

Re: "Tinyboxes finally have a buy it now button"

#91

Post by StrangeDoctor »

anon389r58r58 wrote: post #86
andersa wrote: post #85

Earlier quoted context omitted.

I don't think they're intended for rack usage like that. More like for people to put under their desks... there would be no reason to build the giant case with fancy silent-ish cooling if you're going to put them next to your other jet engines.

Fully agree, and I think the tinybox is great if you put only one of them somewhere in your local office. I just don't think it makes sense to connect multiple of them into a "cluster" to work with bigger models, as the networking bandwidth isn't good enough and you'd have to fit multiple of these big boxes into your local space. Then I might as well put up a rack in a separate room.

there's an ocp 3.0 mezzanine, so no need to remove a card and you'd get 200gbps, unless I've missed something about needing to remove a card to access it. But yeah stacking these or racking them seems less than ideal.

Re: "Tinyboxes finally have a buy it now button"

#92

Post by omikun »

andersa wrote: post #85
anon389r58r58 wrote: post #82

Earlier quoted context omitted.

For that you'd probably be better off removing one of the GPUs, and replacing it with a networking card. The problem of the form factor will remain. The tinybox is 15U big for compute that you'd normally expect to find in a 4U form factor.

I don't think they're intended for rack usage like that. More like for people to put under their desks... there would be no reason to build the giant case with fancy silent-ish cooling if you're going to put them next to your other jet engines.

3kW under your desk... no need to turn on the heat in the winter!

Re: "Tinyboxes finally have a buy it now button"

#93

Post by StrangeDoctor »

andersa wrote: post #83
StrangeDoctor wrote: post #78

Earlier quoted context omitted.

I think the idea is you network them together if you need more and most models can be split nicely.

Most models actually can't be split nicely by 6. There's a reason nvidia builds nodes with 4 and 8 GPUs.

I don't see why 6 is inherently worse than 4 or 8, not all of the layers are exactly equal or a power of 2 in count. 2^2, 2^3, vs 2^1*3^1 might give you more options.

The main issue I run into mainly is flops vs ram in any given card/model.

Re: "Tinyboxes finally have a buy it now button"

#94

Post by whamlastxmas »

bob1029 wrote: post #66

I had a preorder in for this but I canceled a few weeks back. My experience trying to run machines this powerful in residential settings has been extremely poor. All of the Seasonic power supplies that go beyond 1kW or so will trip my shitty (i.e. probably defective) Siemens AFCI breakers. Not even the same circuit all the time. Even after violating local electrical code, I have found that living with a 1500w+ monste…

Could you not duct the heat through a hose and out a window? Like with portable AC units

Re: "Tinyboxes finally have a buy it now button"

#95

Post by oceanplexian »

andersa wrote: post #68
oceanplexian wrote: post #62

Earlier quoted context omitted.

Imagine dropping $15k on this but not wanting to spend $800 on an electrician to properly wire a 50A circuit so you run extension cords across the room creating a fire hazard. As for the datacenter (I’ve racked many things with A/B power) the entire point is redundancy which this defeats the purpose of since each PSU is not properly rated. Seems incredibly bizarre to me in so many ways.

Why is it a fire hazard if the extension cords are properly rated for this load?

Extension cords are only supposed to be used for 90 days or so, you're technically violating the NEC if you're using them in a permanent installation.

Re: "Tinyboxes finally have a buy it now button"

#96

Post by andersa »

StrangeDoctor wrote: post #93
andersa wrote: post #83

Earlier quoted context omitted.

Most models actually can't be split nicely by 6. There's a reason nvidia builds nodes with 4 and 8 GPUs.

I don't see why 6 is inherently worse than 4 or 8, not all of the layers are exactly equal or a power of 2 in count. 2^2, 2^3, vs 2^1*3^1 might give you more options. The main issue I run into mainly is flops vs ram in any given card/model.

Usually you want to split each layer to run with tensor parallelism, which works optimally if you can assign each kv head to a specific GPU. All currently popular models have a power of 2 number of kv heads.

Re: "Tinyboxes finally have a buy it now button"

#97

Post by oasisbob »

bombela wrote: post #59
michaelt wrote: post #54

Earlier quoted context omitted.

Most likely what they actually mean is: This server has two IEC C20 connectors, rated for ~16 amps, each feeding a PSU rated for 1600W (i.e. 16A @ 100v) If you're plugging in to 110v you shouldn't plug them both into the same outlet, as a 20A circuit can't supply 32A. As each PSU is rated for 1600W you'll have to plug both in to get 3200W even if you're running on 220v - although they'd only draw ~7.2A each in that c…

You can feed a US outlet the split phase 240V and get two 120V@20A each. It used to be done in kitchens in the US, back when appliances were power hungry. I have done so in my workshop for the same reason. Houses are wired in split phase 240V, with the neutral in the middle. That is, you have two opposite 120V phases, around the same neutral. This is a clever way to double the power, while adding a single wire. In th…

GFCI requirements will interfere with the legality of many modern-day multi-wire branch circuit plans, yeah?

Re: "Tinyboxes finally have a buy it now button"

#98

Post by Hellolearning »

apexalpha wrote: post #35
jagrsw wrote: post #13

Earlier quoted context omitted.

This thing could run off a single US outlet (1600W) with some throttling, if I'm not mistaken? Shame it wasn't designed for EU sockets. 230V*16A = 3700W, or double that on separate breakers!

3200W seems perfect for a EU socket. Seperate breakers aren't really a thing here, at least in my country, usually if you need more power you draw 400V

No it doesn't. A standard EU Socket is not certified for 24/7 3.2kW.

You should max. pull 2.7kW.

For everything else you need a blue eu socket or camper socket.

I learned this due to my EV which is able to be charged through a normal socket but it regulates it down due to this on purpose and has a temperature sensor build in as well.

Re: "Tinyboxes finally have a buy it now button"

#100

Post by xxpor »

Hellolearning wrote: post #98
apexalpha wrote: post #35

Earlier quoted context omitted.

3200W seems perfect for a EU socket. Seperate breakers aren't really a thing here, at least in my country, usually if you need more power you draw 400V

No it doesn't. A standard EU Socket is not certified for 24/7 3.2kW. You should max. pull 2.7kW. For everything else you need a blue eu socket or camper socket. I learned this due to my EV which is able to be charged through a normal socket but it regulates it down due to this on purpose and has a temperature sensor build in as well.

US circuits are the same way. "Sustained use" (over 3 hours IIRC) has to be de-rated to 80% of max. So an EV can draw 40A on a 50A circuit.
Post reply on HN