Live data from Hacker News

Accident Forgiveness

fly.io

11–20 of 310 posts

Re: Accident Forgiveness

#11
I really, really wish there was just a way to put a hard limit on how much a cloud could charge me.

I am never going to want to spend 200k of my personal money on some project on a cloud. Never. I don't even want my ant-based basket viewing project simulator to cost me 1 thousand dollars because it went viral and all clouds overcharge for bandwith.

Just let me put in a limit.

Re: Accident Forgiveness

#12
post #8

It's unfortunate that the solution to cloud pricing complexity that all providers are adopting is – add even more complexity on top. The number you see on your bill is increasingly calculated by running some black box algorithm on top of the billing events your resources generate. Was it accidental or not? What is a "weird" deployment vs a normal deployment? By what factor should the spikes on your billing graph be s…

It's far from perfect, but the large providers do give you tools for categorizing your charges (tagging, etc). There's some fuzziness, especially around data transfer, but for the most part developers can look at an application and know what the cost of each resource is. The biggest risk seems to be out-of-control auto scaling turned on without doing reasonable analysis first.

Re: Accident Forgiveness

#13
One of the things I really admire about Fly is "how human they come across". Fly is a collection of people providing a computing service to other people. As a fellow human, there is a very primitive part of my brain that will always prefer "tech from humans" over "tech".

Given that the very teleology of cloud computing is digital & ephemeral resources, having an actual human face associated with it makes it tangible in a way that is hard to place.

My little brain can briefly understand complex computer systems on a need-to-know basis, with knowledge constantly coming and going based on the demands of the day. I can never fully "understand" my cloud infrastructure. But hey, Kurt's standing there. I like Kurt. I can understand Kurt as he's a human and so am I and he's in the same exact place I am. Let's work hard and make cool stuff, what do ya say Kurt?

Re: Accident Forgiveness

#14
post #13

One of the things I really admire about Fly is "how human they come across". Fly is a collection of people providing a computing service to other people. As a fellow human, there is a very primitive part of my brain that will always prefer "tech from humans" over "tech". Given that the very teleology of cloud computing is digital & ephemeral resources, having an actual human face associated with it makes it tangible…

I should add that another way Fly distinguishes itself as a "tangible" cloud company is that their blog art is all based on physical mediums. It feels very familiar and quantifiable to my brain.

Re: Accident Forgiveness

#15

>If you do something luridly stupid and rack up costs, AWS and GCP will probably cut you a break. [...] Everyone does. If the incidents that made the rounds here in the last few months are any indication, they'll start out insisting you pay no matter what. You'll then have to write a blog post about it, post it to Twitter, HN, and Reddit, get a couple hundred comments expressing anger at the provider, and wait for so…

Another reason to be cloud agnostic. They are counting that switching cost will make you eat the bill.

If you have to be cloud, do dev in one cloud and test/prod in another.

I know, I know, easier said than done.

Re: Accident Forgiveness

#16
> and may only come within tens of dollars of accurately predicting your water bill.

Whenever I've had to water new grass seed I've always been surprised by my water bill.

Re: Accident Forgiveness

#17

>If you do something luridly stupid and rack up costs, AWS and GCP will probably cut you a break. [...] Everyone does. If the incidents that made the rounds here in the last few months are any indication, they'll start out insisting you pay no matter what. You'll then have to write a blog post about it, post it to Twitter, HN, and Reddit, get a couple hundred comments expressing anger at the provider, and wait for so…

I have personal knowledge of two cases of this happening and both were immediately dropped. One was a high school student's personal project gone awry for like $3k worth the other was a startup where it was $120k or so. Two different providers. Neither had to particularly argue their case, just ask and wait a few days.

Re: Accident Forgiveness

#18
post #7

Earlier quoted context omitted.

I’m curious what sorts of things were on the checklist. I wonder if it’s something they will share proactively?

It's been a few years, so I'm going off of memory, but it was mostly best practices stuff (enabling Cloudtrail, rotating older keys, etc). Anything to ensure that once the attackers no longer had access, removing/monitoring anything that would have longer term implications.

this makes sense; plug the hole and stop taking on water before you ask for a free cleanup.

Re: Accident Forgiveness

#19
post #11

I really, really wish there was just a way to put a hard limit on how much a cloud could charge me. I am never going to want to spend 200k of my personal money on some project on a cloud. Never. I don't even want my ant-based basket viewing project simulator to cost me 1 thousand dollars because it went viral and all clouds overcharge for bandwith. Just let me put in a limit.

I think this sounds easy, but it’s actually quite nontrivial in practice. You need special handling of such a limit for each kind of resource.

E.g. when my limit is reached to they remove the database, along with all backups, and all objects on S3? Since storage is billed, it should also be stopped when the limit is reached, right?

I think in practice among companies paying most of their revenue, there’d be zero interest in this, while it would be a lot of effort to implement.

This is really something specific to hobby projects, which just shouldn’t be using those “unlimited potential cost” services.

Re: Accident Forgiveness

#20
post #16

> and may only come within tens of dollars of accurately predicting your water bill. Whenever I've had to water new grass seed I've always been surprised by my water bill.

There's a note on the draft of this post with like 6 comments from people on our team about how the water bill is a bad example. I stand by what I wrote!
Post reply on HN