> A “starter pack” 15amp cabinet with a gigabit connection can be rented for as little as $400 per month. Link?...
Yeah, this isn't possible for a entire rack, maybe 1U if it includes network and power if it is in any decent datacenter.
Rolling your own servers with Kubernetes
131–140 of 209 posts
Re: Rolling your own servers with Kubernetes
#132> A “starter pack” 15amp cabinet with a gigabit connection can be rented for as little as $400 per month. Link?...
Yeah, this isn't possible for a entire rack, maybe 1U if it includes network and power if it is in any decent datacenter.
How much would a 48U rack like described in the article cost a month? I would guess in the thousands if not ten thousands....
Re: Rolling your own servers with Kubernetes
#133Earlier quoted context omitted.
> Ops, security, and reliability don’t go away when using EC2 either They don't go away, but you have to spend considerably fewer resources on it because Amazon does a lot of it for you. Edit: This effect is even more pronounced when you use Amazon's more specialized managed services, like S3, RDS, Lambda, etc. Then the things you mentioned almost completely go away, as you're letting Amazon completely maintain your…
What used to be behind firewalls oftentimes became accidentally public through the many, many blunders of publicly available S3 buckets that people started to use because they were frustrated with AWS IAM. This is ironic because IAM was supposed to help you secure your data and such, not make things worse for your security profile. Even with all the tooling that exists to help people write better IAM policies and fig…
It's extremely easy to prevent publically available S3 buckets, and there's even built in policies for it.
It's actually fairly difficult to make a bucket public without going through a few hoops even without that.
The only reason this is happening is sure laziness and lack of any true change control processes. It's not because it's hard.
Re: Rolling your own servers with Kubernetes
#134I use to enjoy having a cheap desktop under my table or in a closet serving traffic to people across the internet. Computers have gotten faster, software has gotten better, network has gotten faster, things have gotten cheaper. Sadly instead of seeing more of these, most of these are now being outsourced to cloud providers, we have bought and drank the kool-aid that they can do it better and cheap. Which is not true,…
> we have bought and drank the kool-aid that they can do it better and cheap
The few times I've done the analysis, cloud servers tend to cost about as much as self-hosting, when you factor in the cost of electricity.
There are reasons one may argue against cloud servers, on the basis of the internet's health, user freedom, etc. But for me and for many people they are at least both better and cheaper.
Re: Rolling your own servers with Kubernetes
#135Earlier quoted context omitted.
>In 200X lots of companies were able to maintain their own infrastructure, just like Facebook and Amazon did at the time. But my point is that companies' IT departments did not maintain infrastructure just like Amazon did. In ~2005 when companies were first experimenting with AWS cloud, they might start with dev & test servers. They click a few buttons and are amazed when new servers get spun up in minutes and their…
netflix does not depend on aws to deliver their video bits. they do it themselves based on a big network of core and edge pni and caches. this infra, that netflix has built, in datacenters, is a big competitive advantage. it would be worse performance and much higher cost to do this over something like aws cloudfront.
>this infra, that netflix has built, in datacenters,
Unless things have changed since 2015, reports say Netflix eliminated their last datacenter already.[1]
The Netflix "edge appliances" for CDN streaming are located in others' datacenters owned by Verizon,Comcast,ISPs,etc.
[1] https://arstechnica.com/information-technology/2015/08/netfl...
Re: Rolling your own servers with Kubernetes
#136Earlier quoted context omitted.
It has the same API as k8s. It's literally the same thing, OpenShift just adds some PaaS feature on top of k8s.
Which is precisely why I've run it for over 2 years now. The devs on my team love throwing a git URL into OpenShift and have a project go live in mere minutes, previously a more senior developer would need to setup a CI pipeline and deployment automation and even with experience it was a chore. It's not like I'm personally afraid of k8s or building docker images myself either, but anything to help my team be more pro…
Exactly right. I don't understand all those teams reinventing the wheel building custom k8s distributions, rather than using something like OpenShift and focusing on their core business.
Running custom k8s in production is the 2019 equivalent of using Gentoo.
Re: Rolling your own servers with Kubernetes
#137Earlier quoted context omitted.
Using publicly available costing data from last November, I see that an m4.xlarge RDS reserved instance of SQL Server Enterprise Edition with multi-AZ failover is $39,000 / year. If I have 4 DBAs at a cost of $150K / yr salary + benefits, that's the equivalent of around 15 smallish, managed SQL Server instances. My current SQL footprint is on the order of 600 instances, which works out to be a bit over $23M a year. I…
As your operation gets bigger, the scale generally starts to tip in favor of running your own hardware. But 600 SQL Server instances is fairly large—when that number is in the single digits, the cost of DBAs/DevOps dwarfs that of the hardware. So the scale of your business matters a lot, and it's not useful to generalize this to all companies. Edit: Your math seems off as well. Don't forget that you'd have to pay the…
Also you can get bulk discounts for most services if you're running a lot of instances. That probably includes RDS.
Re: Rolling your own servers with Kubernetes
#138Earlier quoted context omitted.
Yeah, this isn't possible for a entire rack, maybe 1U if it includes network and power if it is in any decent datacenter.
How much would a 48U rack like described in the article cost a month? I would guess in the thousands if not ten thousands....
It mostly goes by power not rack units, if you have 48U and only 15amps, you're not going to fill it up. 15A is not a lot.
Re: Rolling your own servers with Kubernetes
#139Earlier quoted context omitted.
How much would a 48U rack like described in the article cost a month? I would guess in the thousands if not ten thousands....
It mostly goes by power not rack units, if you have 48U and only 15amps, you're not going to fill it up. 15A is not a lot.
So, $400/mo is overkill power wise. What would the bandwidth bill look like? How much of an up front investment is it to buy 48U worth of hardware? Seems expensive...
Re: Rolling your own servers with Kubernetes
#140> A “starter pack” 15amp cabinet with a gigabit connection can be rented for as little as $400 per month. Link?...
He.net