What is the most profitable thing I can do with 10 of these fine Tinybox boxes?
Sell them and invest the money
At least that’s what geo decided is the most profitable thing to do
"Tinyboxes finally have a buy it now button"
71–80 of 138 posts
Re: "Tinyboxes finally have a buy it now button"
#72Earlier quoted context omitted.
Most likely what they actually mean is: This server has two IEC C20 connectors, rated for ~16 amps, each feeding a PSU rated for 1600W (i.e. 16A @ 100v) If you're plugging in to 110v you shouldn't plug them both into the same outlet, as a 20A circuit can't supply 32A. As each PSU is rated for 1600W you'll have to plug both in to get 3200W even if you're running on 220v - although they'd only draw ~7.2A each in that c…
Imagine dropping $15k on this but not wanting to spend $800 on an electrician to properly wire a 50A circuit so you run extension cords across the room creating a fire hazard. As for the datacenter (I’ve racked many things with A/B power) the entire point is redundancy which this defeats the purpose of since each PSU is not properly rated. Seems incredibly bizarre to me in so many ways.
> As for the datacenter (I’ve racked many things with A/B power) the entire point is redundancy which this defeats the purpose of. Seems incredibly bizarre to me in so many ways.
Yes - often for the data centre you'd end up with something like [1] with 4x 2700W power supplies, providing redundancy and ample power at the same time. It does mean you need four 220v power feeds though.
[1] https://www.supermicro.com/en/products/system/gpu/4u/sys-421...
Re: "Tinyboxes finally have a buy it now button"
#73I had a preorder in for this but I canceled a few weeks back. My experience trying to run machines this powerful in residential settings has been extremely poor. All of the Seasonic power supplies that go beyond 1kW or so will trip my shitty (i.e. probably defective) Siemens AFCI breakers. Not even the same circuit all the time. Even after violating local electrical code, I have found that living with a 1500w+ monste…
> All of the Seasonic power supplies that go beyond 1kW or so will trip my shitty (i.e. probably defective) Siemens AFCI breakers. Not even the same circuit all the time.
I don’t know much about US electrical standards but aren’t your residential circuits rated for 1800w or 2400w? Here in New Zealand they are 2400w and people regularly plug in 2400w fan heaters without issue.
> The HVAC solutions in most residences were not designed for this kind of heat load. It would be like running your oven with the door hanging open all day. For those of us in places like Texas, this machine simply would not be feasible to run for half the year.
Yes it wouldn’t be pleasant running this 24/7 in summer in any living space. But you could install a heatpump with 7kw of cooling capacity which should handle it (adding to the electricity bill).
Re: "Tinyboxes finally have a buy it now button"
#74I had a preorder in for this but I canceled a few weeks back. My experience trying to run machines this powerful in residential settings has been extremely poor. All of the Seasonic power supplies that go beyond 1kW or so will trip my shitty (i.e. probably defective) Siemens AFCI breakers. Not even the same circuit all the time. Even after violating local electrical code, I have found that living with a 1500w+ monste…
> All of the Seasonic power supplies that go beyond 1kW or so will trip my shitty (i.e. probably defective) Siemens AFCI breakers. Not even the same circuit all the time. I don’t know much about US electrical standards but aren’t your residential circuits rated for 1800w or 2400w? Here in New Zealand they are 2400w and people regularly plug in 2400w fan heaters without issue. > The HVAC solutions in most residences w…
In the US the National Electric Code caps draw at 80% of rated load. So a 15A circuit is permitted a 1440W load even though it should handle 1800W.
Re: "Tinyboxes finally have a buy it now button"
#75I had a preorder in for this but I canceled a few weeks back. My experience trying to run machines this powerful in residential settings has been extremely poor. All of the Seasonic power supplies that go beyond 1kW or so will trip my shitty (i.e. probably defective) Siemens AFCI breakers. Not even the same circuit all the time. Even after violating local electrical code, I have found that living with a 1500w+ monste…
> All of the Seasonic power supplies that go beyond 1kW or so will trip my shitty (i.e. probably defective) Siemens AFCI breakers. Not even the same circuit all the time. I don’t know much about US electrical standards but aren’t your residential circuits rated for 1800w or 2400w? Here in New Zealand they are 2400w and people regularly plug in 2400w fan heaters without issue. > The HVAC solutions in most residences w…
> I don’t know much about US electrical standards but aren’t your residential circuits rated for 1800w or 2400w?
The residential AFCI issue I describe isn't about the wattage directly. It's about transient currents generated by large switch-mode power supplies being detected as arc faults. Similar concern as with induction motors.
Re: "Tinyboxes finally have a buy it now button"
#76"tinybox red is 6x 7900XTX, tinybox green is 6x 4090" So the red is ~$5k in gpu's - where is the other $10k going?
Motherboard and CPU, memory, NVMe drives, PSUs, SlimSAS cables and breakouts, a custom machined case, assembly, support.
You're free to try building one yourself for cheaper. If you consider your time for researching/assembling/testing it to be worthless, and are happy with a contraption in a miner frame, then you can probably do it.
Re: "Tinyboxes finally have a buy it now button"
#77Earlier quoted context omitted.
a 220 volt 20 amp circuit should be good for over 3500 watts constant load in North America. Why is it requiring two circuits?
IIRC USA is 110V, not 220V?
Most homes have a 240V supply with a neutral wire (V1, V2, N). This allows for split phase 120V power (V1+N, V2+N). You can also get 240V (V1+V2).
It's common for EVs, clothes dryers, ovens, and hot water heaters to use 240V while most other appliances are 120V.
Re: "Tinyboxes finally have a buy it now button"
#78I thought to myself this morning: "boy, that $15k pricetage is tempting." Then I thought to myself "how many times have I downloaded a github repo only to hand-replace cuda with mps, and then tried to figure out if there's a version of xformers that will work this week with my m3?" and then I thought "boy, that $25k is tempting." (15k: Radeon / 25k: Nvidia). For those wondering, 3200W power, in residential / low-end…
You can't fine tune a 70B model with this. It barely even fits the weights before it runs out of vram. Need a bigger machine.
I think the idea is you network them together if you need more and most models can be split nicely.
Re: "Tinyboxes finally have a buy it now button"
#79> The $15k tinybox red is the best perf/$ ML box in the world. It's fully networkable, so that's the metric that matters.
No it isn't. Capex is only part of the equation. Opex (power and cooling amongst other things) is important. And networking at scale isn't cheap either.
Re: "Tinyboxes finally have a buy it now button"
#80Earlier quoted context omitted.
Most likely what they actually mean is: This server has two IEC C20 connectors, rated for ~16 amps, each feeding a PSU rated for 1600W (i.e. 16A @ 100v) If you're plugging in to 110v you shouldn't plug them both into the same outlet, as a 20A circuit can't supply 32A. As each PSU is rated for 1600W you'll have to plug both in to get 3200W even if you're running on 220v - although they'd only draw ~7.2A each in that c…
These are not redundant PSUs, each PSU powers different GPUs in the same machine. Are you sure connecting them to different phases is a good idea? I've been looking for a proper answer to this for a while, because I want to build a similar machine with 8 GPUs (~4500W max load) which would need to be split between two 16A 230V circuits.
The transformers in the power supplies provide 'isolation' between the input and output - which means you can connect the outputs together, even when the inputs are on different phases.
Are you planning to build such a machine for your personal home use? If so you should be aware that (a) you might find server hardware hasn't thoroughly tested compatibility with things like suspend; (b) you might find games haven't thoroughly tested compatibility with multi-GPU setups; and (c) you might find the idle power consumption is 200W or more, even while doing nothing.