Live data from Hacker News

Fly.io outage – resolved

status.flyio.net

61–70 of 287 posts

Re: Fly.io outage – resolved

#62
post #49
post #8

My fly.io-hosted website went down for 5 minutes (6 hours ago), but then came right back up, and has been up ever since. I use a free monitoring service that checks it every 5 minutes, so it's possible it missed another short bit of downtime. But fly.io has been pretty reliable overall for me!

Would be fascinated to see your data over a period of months. Application up time is flakey, but what was worse were fly deploys failing for no clear reason. Sometimes layers would just hang and eventually fail for no particular reason; I'd run the same command an hour or two later without any changes and it would just work as expected. I'd love to make a monitoring service to deploy a basic app (i.e. run the fly dep…

[flagged]

Re: Fly.io outage – resolved

#64

This is probably 5th or 6th major outage from Fly.io that I have personally seen. Pretty sure there were many others and some just went unnoticed. I recommended the service to a friend, and within two days he faced two outages. Fly.io seriously needs to get it together. Why it hasn’t happened yet is a mystery to me. They have a good product but stability needs to be an absolute top for a hosting service. Everything e…

I get this but I think if people can give GitHub a pass for shitting the bed every two weeks maybe Fly should get a bit of goodwill here. I am not affiliated with Fly at all but I do think that people should temper their expectations when even mega corp can’t get it right I guess the secret is to be the incumbent with no suitable replacement. Then you can be complete garbage in terms of reliability and everyone will…

Who's giving GitHub a pass on shitting the bed? They go down often enough that if you don't have an internal git server setup for your CICD to hit, that's on you.

Re: Fly.io outage – resolved

#65
No surprise. About a year ago, I looked at fly.io because of it's low pricing and I was wondering where they were cutting corners to still make some money. Ultimately, I found the answer in their tech docs where it was spelled out clearly that an fly instance is hardwired to one physical server and thus cannot fail over in case that server dies. Not sure if that part still is in the official documentation.

In practice, that means if a server goes down, they have to load the last snapshot from that instance from the Backup and push it on a new server, update the network path, and pray to god that not more server fail than spare capacity is available. Otherwise you have to wait for a restore until the datacenter mounted a few more boxes in the rack.

That explains quite a bit the randomness of those outage reports i.e. my app is down vs the other is fine and mine came back in 5 minutes vs the other took forever.

As a business on a budget, I think anything else i.e. a small civo cluster serves you better.

Re: Fly.io outage – resolved

#66

I'm grateful to HN for keeping me well aware of Fly's issues. I'll never use them.

It's still 99.99+% SLA? Would you really pay 100% more for <0.01% more uptime?

No dog in this fight, all props to the Fly.io team for having the gumption to do what they are doing, I genuinely hope they are successful...

> It's still 99.99+% SLA

But this is simply not accurate. 99.99% uptime is annually of downtime. They apparently blew well through that today. Looks like they essentially had the equivalent of 4 years of 99.99% uptime equivalent this evening.

Four nines is so unforgiving that it's almost the case that if people are required to be in the loop at any point during an incident, you will blow the fourth nine for the whole year in a single incident.

Again, I know it's hard. I would not want to be in the space. That fourth nine is really difficult to earn.

In the meanwhile, to the Fly team as they work to resolve this (and hopefully get some rest).

Re: Fly.io outage – resolved

#67
post #49

Earlier quoted context omitted.

Would be fascinated to see your data over a period of months. Application up time is flakey, but what was worse were fly deploys failing for no clear reason. Sometimes layers would just hang and eventually fail for no particular reason; I'd run the same command an hour or two later without any changes and it would just work as expected. I'd love to make a monitoring service to deploy a basic app (i.e. run the fly dep…

[flagged]

What does rust have to do with fly.io?

Re: Fly.io outage – resolved

#68

No surprise. About a year ago, I looked at fly.io because of it's low pricing and I was wondering where they were cutting corners to still make some money. Ultimately, I found the answer in their tech docs where it was spelled out clearly that an fly instance is hardwired to one physical server and thus cannot fail over in case that server dies. Not sure if that part still is in the official documentation. In practic…

The status tells a story about a high-availability/clustering system failure so I think in this case the problem is rather the complexity of the HA machinery hurting the system's availability vs something like a simple VPS.

Re: Fly.io outage – resolved

#69
post #34
post #26

Earlier quoted context omitted.

There's a link to what appears to be the actual pricing page https://fly.io/docs/about/pricing/ There's also a link to the pricing calculator https://fly.io/calculator

Is that calculator hourly or monthly?

Literally says "Monthly Costs" in the green panel on the right that calculates the total.

Re: Fly.io outage – resolved

#70
post #33

I tried Fly early. I was very excited about this service, but I've never had a worse hosting experience. So I left. Coincidentally I tried it again a few days ago. Surely things must be better. Nope. Auth issues in the CLI, frustrations deploying a Docker app to a Fly machine. I wouldn't recommend it to anyone.

I find their user experience to be exceptional. The only flake I’ve encountered is in uptime and general reliability of services I don’t interface with directly. They’ve done a stellar job on the stuff you actually deal with, but the glue holding your services together seems pretty wobbly.
Post reply on HN