Live data from Hacker News

Fly.io Postgres cluster down for 3 days, no word from them about it

webcache.googleusercontent.com

171–180 of 493 posts

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#171

Earlier quoted context omitted.

I left digitalocean for fly because some of their tooling was excellent. I was pretty excited. I’m back on digitalocean now. I’m not unhappy about it, they’re very solid. I don’t love some things about their services, but overall I’d highly recommend them to other developers. I gave up on fly because I’d spontaneously be unable to automate deployments due to limited resources. Or I’d have previously happy deployments…

I moved from DO to Hetzner ( cheaper), I am happy about it.

I use both and am very satisfied, especially by Hetzner.

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#172
post #80

Y'all, this is going to be deeply unsatisfying, but it's what I can report personally: I have no earthly clue why this thread on our community site is unlisted. We're looking at the admin UI for it right now, and there's like, a little lock next to do the story, but the "unlist story" option is still there for us to click. The best I can say is: I'm reasonably sure there wasn't some top-down edict to hide this thread…

I don't know why the app-not-working category effectively delists threads, but until we find out, I just removed it so this thread is public again.

may be it's to avoid search engines to not scrape these threads?

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#173

Earlier quoted context omitted.

The system you describe is quite the monthly bill, off the top of my head.

I admit I didn't run the numbers before posting that. But you got me curious, so I went ahead and did it now... Render.com looks like [1] their "$0 + compute costs" plan would work out to: ∙ $25/mo for a single "Web Services" box of 1 CPU and 2GB RAM ∙ $20/mo for a single "PostgreSQL" box of 1 GB RAM, 1 CPU, and 16GB SSD ∙ TOTAL: $45/mo, and you're assuming they'll magically give you zero-downtime Those are grim numb…

Thanks for the analysis. I think you're still underestimating costs (e.g. didn't count bandwith, no AZ standby for your database, or backups etc.) and time spent, not only in the setup but especially in maintenance (security fixes, AWS agent updates, OS updates, package updates, figuring out why an instance ran out of disk etc. etc.) Not counting you have to setup and maintain your deployment system which can range from scripts to K8s.

Also I have used Terraform to set up quite a few resources and it's only overhead in a small project.

I just wanna git push and see my changes published a minute later. I don't think Render is gonna take more than 10 mins to figure out https://render.com/docs/deploy-rails-sidekiq

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#174

Earlier quoted context omitted.

IMHO it is their approach. I use Hetzner and OVH (and their other variants for lower budget clients) for our EU clients. They do not use buzz words like "deploy app server", "cloud clusters", "turbo charge this app". They are simply providing VPS and similarly configured droplets. They are also established and don't want to mess around with very modern experimental infrastructures. Same goes for Digital Ocean. No buz…

DO, OVH, and Hetzner are more stable because they don't use buzzwords?

I guess what OP is getting at is that these providers stick to the battle tested proven bedrock and nothing like "run your app where your users are" which I find interesting because that too can be done with any cloud that has a Datacenter in the region where you happen to have users.

So this "closer to your users" voodoo is a little beyond me.

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#175
post #80

Y'all, this is going to be deeply unsatisfying, but it's what I can report personally: I have no earthly clue why this thread on our community site is unlisted. We're looking at the admin UI for it right now, and there's like, a little lock next to do the story, but the "unlist story" option is still there for us to click. The best I can say is: I'm reasonably sure there wasn't some top-down edict to hide this thread…

You might be right, but in light of this whole disaster it doesn’t sound too convincing and doesn’t make your company look good.

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#178
post #118

Earlier quoted context omitted.

Is that even possible on Fly?

He may have been talking about Fly themselves. Certainly having only a single machine to serve a wealthy metropolis of 8 million people seems like amateur hour.

They certainly don't only have a single machine in SYD since I have a bunch of machines running in SYD that we're impacted by this one.

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#180
post #80

Y'all, this is going to be deeply unsatisfying, but it's what I can report personally: I have no earthly clue why this thread on our community site is unlisted. We're looking at the admin UI for it right now, and there's like, a little lock next to do the story, but the "unlist story" option is still there for us to click. The best I can say is: I'm reasonably sure there wasn't some top-down edict to hide this thread…

It looks like being authentic is valued over anything else at Fly. I can’t explain how a company responds this immaturely to incidents like these.

I'd rather take this response and see that they're working on it than "Oopsie poopsie, our machine elves have messed up!" or corporate newspeak saying nothing.
Post reply on HN