Live data from Hacker News

Ask HN: Distributed data centers in our basements

news.ycombinator.com

11–20 of 69 posts

Re: Ask HN: Distributed data centers in our basements

#11
Many reasons prevent this from being practical for any serious purposes.

1. It depends on what part of the world you are in, but many homes have cooling needs for at least part of the year. The needs to remove excess heat would go up if you are adding more heat -- and it is less efficient to do this at the scale of an individual home than it is at DC scale.

2. Power requirements: While many homelabs have UPS systems -- they lack often lack backup generators, redundant A+B power infrastructure, and don't have the required power density for higher powered servers.

3. Connectivity requirements: most homes don't have access to the connectivity that data centers do.

4. Security requirements: homes simply can't meet the security requirements of most data protection regulations -- things like barriers, access control systems, surveillance, fire protection -- are anywhere from intrusive to completely impossible in a home.

5. Access requirements: homes aren't conducive to a technician responding to an outage at 3am

And those are just the big ones.

Re: Ask HN: Distributed data centers in our basements

#12
post #4

You would have issues with providing the reliability levels (read: SLA) that we come to expect from data centers. But, if there are enough services that we don't care about if they go down for a few hours, this could be doable. It still relies on the assumption that we got enough services to justify the effort though. It is way more realistic if you set up your own homelab and provide services to your family, under t…

It turns out, if you build it correctly, you can get BETTER reliability SLAs. There's a company https://www.storj.io/ thats been doing this for years.

I doubt it, there are data centers with several decades of 100% uptime.

People often think of the large cloud providers when they think of data centers -- but their data centers are typically mediocre in terms of redundancy and uptime. Their strategy is generally to have less infrastructure redundancy and rely on software failover... e.g. failover to another AZ

Re: Ask HN: Distributed data centers in our basements

#13
I think this is exactly the future for non-giant-corpo internet

The problem is DNS and access to the IP network

So if you can figure out how to build reliable DNS access/approvals with cloudflare etc then it would work

The biggest challenge at the largest scale is political because then you’re gonna be fighting all of the ISP’s and the giant technology companies and ultimately they’re never going to allow for this

Either take it over on their own by offering their own service which people would sign up for

or they’ll just pressure every ISP or certificate authority to not recognize routes that are not going through “allowed” data centers,

most likely you would end up with a series of state bills or even a federal regulation that prevents data routing for public consumption unless it in some kind of “security standard” or whatever bullshit they come up with

Re: Ask HN: Distributed data centers in our basements

#17
post #2

> It seems like a lot of the blight of data centers is the energy to remove the heat. Not really the only issue actually, the electricity bill would be astronomical for a household and also have you heard the noise from them ? Issues with them being distributed range from Data protection to Insurance against damage, connectivity issues. Noble maybe, but it's widely unrealistic.

A half rack server in a basement isn’t going to consume a lot of power or generate that much noise. I have home servers and they are fine. Data protection is an issue, but maybe this is something that SGX and family can provide eventually. A scheme like this makes a lot of sense for distributed redundant backups. The real problem is bandwidth. Most home users still don’t have decent symmetrical bandwidth. If you coul…

A half rack in a rack of last decade is 8kw. A half rack of today's state of the art is 100kw.

A house older than 30 years typically has 100A 120V split phase power which can supply 25000 watts (you wouldn't want to ever fully load it...)

And an 8000 watt space heater will definitely be noisy, and produce too much heat for pretty much any house.

Re: Ask HN: Distributed data centers in our basements

#18
post #2

> It seems like a lot of the blight of data centers is the energy to remove the heat. Not really the only issue actually, the electricity bill would be astronomical for a household and also have you heard the noise from them ? Issues with them being distributed range from Data protection to Insurance against damage, connectivity issues. Noble maybe, but it's widely unrealistic.

A half rack server in a basement isn’t going to consume a lot of power or generate that much noise. I have home servers and they are fine. Data protection is an issue, but maybe this is something that SGX and family can provide eventually. A scheme like this makes a lot of sense for distributed redundant backups. The real problem is bandwidth. Most home users still don’t have decent symmetrical bandwidth. If you coul…

I've had a half rack in my home for many years -- if it's half empty, half powered off, and half full of low powered stuff, then it's not going to consumer a lot of power. (e.g. 'only' a few hundred watts) But 20u of 1u virtualization servers filled up -- or a single Nvidia DGX -- would easily overwhelm a normal home electrical system. The kind of workloads in datacenters are not people homelabbing for fun, but people running production workloads.

Re: Ask HN: Distributed data centers in our basements

#19

Many reasons prevent this from being practical for any serious purposes. 1. It depends on what part of the world you are in, but many homes have cooling needs for at least part of the year. The needs to remove excess heat would go up if you are adding more heat -- and it is less efficient to do this at the scale of an individual home than it is at DC scale. 2. Power requirements: While many homelabs have UPS systems…

1. Many places in the world don't ever need cooling

2. If servers are distributed then downtime is distributed, you can virtually guarantee that some of the servers over the world will be online so you can get effectively 100% uptime, something that is not possible in a data center

3. To serve tokens you need very little bandwidth, it's just text in and out

4. All of this is down to the HW and the SW itself, not the building. That is, the box that's being deployed.

5. Just switch to a different server until the problem is resolved, in this model there is no urgency. You just need redundancy which you can afford with how much cheaper this would be.

Post reply on HN