Live data from Hacker News

I got pwned by my cloud costs

troyhunt.com

511–520 of 657 posts

Re: I got pwned by my cloud costs

#511

Earlier quoted context omitted.

Or simply use a proper CDN that doesn't pretend to eat all the cost for a flat fee but then sometimes does not. BunnyCDN has an amazing volume tier at half a cent per GB.

Will BunnyCDN reliably keep an 18gb file in cache without hitting origin? I use and like Bunny, but relying on that to not get a massive bill in the mail scares the shit out of me.

they also have storage feature, so they could

Re: I got pwned by my cloud costs

#512
post #23

That's the typical story. Something goes wrong and it costs you (typically a small company) a lot of money. At that time just nobody is looking at metrics. Even alarms don't help absolutely because they can also be missed. The only thing that would really help were a hard spending limit that stops all services except storage. If your site is important there will be such an amount of user feedback that it is impossibl…

> The only thing that would really help were a hard spending limit that stops all services except storage. Sadly, I haven't found a way to do that with AWS

I just looked at my AWS account and there seems to be a way to set budget, attach alerts to it and attach actions to alerts. For example there is an action to stop EC2 instances. Not sure if other AWS services have something similar, but at least you can kill your instances if something weird happens.

Actions weren't there last time I checked (few years ago).

Re: I got pwned by my cloud costs

#513
post #107

Don't put Cloudflare in front of a Cloud egress bill. i.e. don't do this: Azure|Amazon > Cloudflare Always use your own proxy where the egress is well within your free tier, i.e. do this: Azure|Amazon > Hetzner|Linode > Cloudflare Why? Because Cloudflare cache is a massively multi-tenant LRU cache and whilst hot files will be cached well (and with Cloudflare Tiered Cache even better - but this itself is a cost) anyth…

Another option if Linode's included bandwidth + overages is too much is a dedicated box from Reliable Site. I'm not a customer nor am I affiliated with them at all, I just occasionally check in on their low end prices and noticed that they've started included an unmetered 1Gbps port with every host.

https://www.reliablesite.net

(search HN and reddit for that URL, you'll see they've been around and recommended for a really long time).

Re: I got pwned by my cloud costs

#514
post #491

These stories almost always boil down to this fundamental conflict of what you want for a personal project vs a business. (though in this case yes, Troy Hunt's HIBP is larger than a lot of startup businesses) In a business setting, you want your service to stay up, at the cost of spike in costs if accidents or mistakes happen. In a personal project, you want there to be hard limit on cost, and your service to go down…

> In a business setting, you want your service to stay up, at the cost of spike in costs if accidents or mistakes happen.

No you don’t. This is absolutely not a given. Being a “business” doesn’t mean you suddenly have unlimited budget.

The vast majority of businesses are not “web scale” and are better off taking an availability outage than suddenly handling 1,000,000x the normal volume of traffic.

Re: I got pwned by my cloud costs

#515

Earlier quoted context omitted.

Looks like they have actually reduces their footprint. It not that they do run on a single webserver it's that they can run on one.

> Looks like they have actually reduces their footprint. i don't remember who said it but a quote i really like is "it's not finished when there's nothing left to add, it's finished when there's nothing left to take away"

It's commonly attributed to Antoine de Saint-Exupéry and is a lot older than I thought, from 1935 and originally in French.

https://english.stackexchange.com/q/38837/178351

Re: I got pwned by my cloud costs

#516
post #503

Earlier quoted context omitted.

Certainly the cloud providers probably make money by not having hard limits. But it's also the case that if they did implement hard limits of some sort, you'd be reading blog posts about how AWS destroyed my project just when it was going big because someone stuck a circuit breaker foot gun in some corner and everything stopped working properly when usage spiked. I do think there should probably be a hard circuit bre…

But... they do implement limits.

As far as I know, they implement billing alerts but, aside from some student and some other limited account types, they're alerts. You'll get an email that you've hit your limit but your bill will continue to go up until you shut things down.

Re: I got pwned by my cloud costs

#517
post #491

These stories almost always boil down to this fundamental conflict of what you want for a personal project vs a business. (though in this case yes, Troy Hunt's HIBP is larger than a lot of startup businesses) In a business setting, you want your service to stay up, at the cost of spike in costs if accidents or mistakes happen. In a personal project, you want there to be hard limit on cost, and your service to go down…

I don't agree with this - even for businesses there is always a limit over which there is serious trouble for bottom line. I think cloud providers should allow one to set a hard cost limit over which everything shuts down. For personal projects the limit might be $100 and for small businesses $100k, but even rich companies have it (not the same reason, but Knight Capital comes to mind).

Re: I got pwned by my cloud costs

#518
post #503

Earlier quoted context omitted.

Certainly the cloud providers probably make money by not having hard limits. But it's also the case that if they did implement hard limits of some sort, you'd be reading blog posts about how AWS destroyed my project just when it was going big because someone stuck a circuit breaker foot gun in some corner and everything stopped working properly when usage spiked. I do think there should probably be a hard circuit bre…

But... they do implement limits.

Aws doesn't, there are only alerts. Don't know about others.

Re: I got pwned by my cloud costs

#519

Ah the old cloud provider switcheroo. Yip this is the way they make money. They make it easy to setup some gigantic hugely scalable website then hit you with a gigantic scaled up bill. AWS would do this as well. Team I'm in at the moment is in the early stages of cloud adoption but the company in total has fell hook line and sinker for AWS. When I mentioned the cost there is always an excuse. The main one being that…

There's an argument to be made for quality of life for your employees. As someone who has transitioned from on-prem server management to mainly cloud work, my job happiness has skyrocketed. I haven't set foot in a data center in three years and I do not miss it one bit. Dealing with hardware failures, hardware vendors, confusing licensing, having to know SKUs, racking new cabinets, swapping hard drives, patching serv…

This reads like a software engineer being happy work caters lunch so he/she didn’t have to cook for the whole team anymore. Didn’t anyone discuss maybe hiring a cook?

Re: I got pwned by my cloud costs

#520
post #491

These stories almost always boil down to this fundamental conflict of what you want for a personal project vs a business. (though in this case yes, Troy Hunt's HIBP is larger than a lot of startup businesses) In a business setting, you want your service to stay up, at the cost of spike in costs if accidents or mistakes happen. In a personal project, you want there to be hard limit on cost, and your service to go down…

Azure (and I'm sure other cloud providers do) allow you to set email notifications for when your bill goes over a set amount so you can stop it before it happens. If you're using a cloud provider I'd highly recommend setting one of those up. In Azure it's under your Subscription and then Budgets

AWS can send you alerts when it looks like you will go over your budget for the period, before you're way over your projections, which is a nice feature.

I truly believe they want you to use a lot of their resources on a consistent, long-term basis; they don't get long-term value from people having short, one-off anomalies, so budgets and monitoring are aligned with their customers - just not total cost of ownership calculations :)

Post reply on HN