Live data from Hacker News

We reduced our server costs by moving away from AWS

levelup.gitconnected.com

41–50 of 355 posts

Re: We reduced our server costs by moving away from AWS

#42

I'm glad to see more of these types of articles, but at the same time I'm a bit flabbergasted that this isn't obvious for so many people. These cloud providers are, by definition, charging you more than it would cost you to run it yourself. What you get in return is a guarantee of expertise and an ecosystem.

> These cloud providers are, by definition, charging you more than it would cost you to run it yourself. That is _not_ a given. They're charging you more than it costs _them_ to run it. They get: - much lower hardware prices than you - lower bandwidth prices than you - likely lower electricity costs than you

The whole idea that since they have economies of scale, they must pass those savings on to you is a misunderstanding of how companies work.

Realistically, a company will charge slightly less than whatever your alternative is, and they will provide products that restrict the number of alternatives you have.

AWS, GCP, and Azure provide several differentiated products that lock you in to higher prices on everything else. Effectively, these three have an oligopoly on "highly differentiated cloud services." They are only competing with each other on those services, and they are competing with "servers plus ingress/egress costs to our differentiated services" on their commodity products. That is the real reason why AWS egress costs are so high. It prevents you from picking and choosing where to buy each part of your cloud footprint, and locks you into buying AWS. Bandwidth costs are what keep you inside the AWS/GCP/Azure walled garden.

Lower-end providers like Linode, DigitalOcean, Vultr, and Cloudflare have parts of the differentiated offering, but not all of it. These people will have lower prices than AWS/GCP/Azure since their offering is less differentiated, but they will still charge you more than you would pay by renting a server, since they offer more products.

Finally, hardware rental providers like Hetzner and other operators are competing directly with you buying the hardware and paying for datacenter space and bandwidth. Datacenters typically charge a premium for power, even when they are in areas with low-cost power.

Notice that none of these companies are competing with large-scale server buyers who have the same hardware/bandwidth/power costs that they do. As such, they do not need to pass the savings they get onto you. That is where they get their profit.

Re: We reduced our server costs by moving away from AWS

#43
post #35

Dedicated hosting providers. I'm so amazed that somehow people completely forget that for literally decades, web host provided dedicated hosting options at fantastic prices. Yes, loooong time ago - to get your dedicated server might have taken a few hours to provision and the instant server access that AWS brought should not be discredited. But large numbers of web host today allow you to programmatically spin up a d…

> Yes, loooong time ago - to get your dedicated server might have taken a few hours to provision and the instant server access that AWS brought should not be discredited. At one point it took often days for a dedicated server to be set up. We also didn't have such nice provisioning tools. Now it just seems like cargo cult to use cloud providers as the only option. People just completely discount dedicated servers.

In most businesses I've worked in:

developer costs >> infrastructure costs

An AWS large server is around $500/year, which is about 1-2 developer hours (with taxes, overhead, etc) at the cost scales last time I priced this out. That's crazy expensive in the absolute, but if it saves a couple of hours, it makes sense.

PaaS providers cost even more. I've gone with those in the past, since it basically eliminated dev-ops. The major downside wasn't cost, so much as flexibility.

Dedicated servers start to make sense for:

- The very low end (e.g. personal use, or hosting something long-running for a small business)

- The very high end (e.g. once cloud costs start to hit hundred of thousands of dollars per year)

On the very high end, cloud providers will often cut a deal, though.

My problem with AWS, recently, has been reliability. Servers crash or have performance degradation a bit too often. That leads to developer costs, and might be what pushes me back to dedicated.

Re: We reduced our server costs by moving away from AWS

#44
I believe this is the use case Cloudflare is really targeting with R2. They recently connected Cache Reserve to R2 to make this even easier. We wrote up a breakdown for S3 vs R2 and found that R2 would be significantly cheaper when the majority of traffic is cached data, https://www.vantage.sh/blog/cloudflare-r2-aws-s3-comparison

Re: We reduced our server costs by moving away from AWS

#45
This is the Trillion Dollar Paradox described by Martin Casado. You’re crazy if you don’t start your business in the cloud, you’re crazy if you stay there.

My new startup is focused on helping application owners repatriate their workloads into their own infrastructure.

Our goal is to solve the network complexity challenges with a fully open network stack (open source software with all of the hardware options you would expect, and some you wouldn’t). The solution is designed to be turnkey and require very little network experience. It will use standard DevOps tools that you’re already using.

We’re announcing it in two weeks and will be posting info here on HN!

Re: We reduced our server costs by moving away from AWS

#46

Earlier quoted context omitted.

> These cloud providers are, by definition, charging you more than it would cost you to run it yourself. That is _not_ a given. They're charging you more than it costs _them_ to run it. They get: - much lower hardware prices than you - lower bandwidth prices than you - likely lower electricity costs than you

The whole idea that since they have economies of scale, they must pass those savings on to you is a misunderstanding of how companies work. Realistically, a company will charge slightly less than whatever your alternative is, and they will provide products that restrict the number of alternatives you have. AWS, GCP, and Azure provide several differentiated products that lock you in to higher prices on everything else…

> The whole idea that since they have economies of scale, they must pass those savings on to you is a misunderstanding of how companies work.

That idea was not expressed in the comment that you replied to. The comment you replied to was in response to a strong claim that ignored the existence of economies of scale, and therefore concluded that it's so obvious that cloud providers must always be more expensive than self-hosting.

Re: We reduced our server costs by moving away from AWS

#47

Earlier quoted context omitted.

> These cloud providers are, by definition, charging you more than it would cost you to run it yourself. That is _not_ a given. They're charging you more than it costs _them_ to run it. They get: - much lower hardware prices than you - lower bandwidth prices than you - likely lower electricity costs than you

The whole idea that since they have economies of scale, they must pass those savings on to you is a misunderstanding of how companies work. Realistically, a company will charge slightly less than whatever your alternative is, and they will provide products that restrict the number of alternatives you have. AWS, GCP, and Azure provide several differentiated products that lock you in to higher prices on everything else…

> The whole idea that since they have economies of scale, they must pass those savings on to you is a misunderstanding of how companies work.

Your parent comment wasn't saying that AWS is necessarily cheaper than running hardware yourself. It was saying that AWS is not necessarily not cheaper.

Re: We reduced our server costs by moving away from AWS

#48
They don't mention at all what services they were using (other than slight mention of S3) which makes it very hard to respond to this. If you are running everything on EC2 then you are going to have a bad time (especially if you aren't using reserved instances).

AWS (IMHO) shines with the various services they provide (S3, Lambda, CloudFront, API Gateway, SQS< SES, to name a few). AWS is a game of trying to reduce your bill and often that means using AWS-specific services. If you want to stay completely "cloud agnostic" you are going to paying more than buying into a "cloud", in that scenario then you absolutely should be looking at dedicated servers. AWS is great because you can bring existing software and just run it in EC2 (or their container stuff if your software is containerized) but the AWS magic comes from using their managed services (also spinning up/down EC2 instances as needed, but if you are running them 24/7 then consider alternatives or at least pay for reserved).

Re: We reduced our server costs by moving away from AWS

#49

Earlier quoted context omitted.

> These cloud providers are, by definition, charging you more than it would cost you to run it yourself. That is _not_ a given. They're charging you more than it costs _them_ to run it. They get: - much lower hardware prices than you - lower bandwidth prices than you - likely lower electricity costs than you

Bandwith is obviously extremely expensive on AWS. But even EC2 is easily 5x as expensive as renting a dedicated server. Of course this is a deeply unfair comparison as dedicated servers don't have the flexibility of an EC2 instance and the integration into other services. So if those matter to you then the cloud is certainly worth it. But you are paying a lot more for CPU, RAM and storage compared to other options. Y…

>"dedicated servers don't have the flexibility of an EC2 instance and the integration into other services."

I understand that there are many cases when all of that you mention is needed but for the vast majority of normal businesses having main and standby servers on Hetzner / OVH with on premises backup would cover all their needs like for ever with stellar performance. All at the fraction of the cost. Many business owners just do not know it as they're not technical and their tech stuff for some inexplicable reasons are all for doing "cool" cloud architectures at owner's expense. And of course that magical "cloud" word sells itself. So many times when I come to do something a new client I hear the owner say proudly - we are on a cloud. It takes some careful efforts to explain to them that they're just wasting money while not upsetting them in a first place.

Re: We reduced our server costs by moving away from AWS

#50
post #35

Dedicated hosting providers. I'm so amazed that somehow people completely forget that for literally decades, web host provided dedicated hosting options at fantastic prices. Yes, loooong time ago - to get your dedicated server might have taken a few hours to provision and the instant server access that AWS brought should not be discredited. But large numbers of web host today allow you to programmatically spin up a d…

Not to mention having your own datacenter, which is even cheaper (unless you do something stupid).

EDIT: to the naysayers: I worked in various companies (from tiny to huge) maintaining their own DCs and had access to financial data. And I was involved in the setting up new DCs.

Post reply on HN