They seem to have a lot of issues with Consul, is it the design of Consul or the way they use it that is the problem?
Fly.io Status – Consul cluster outage
11–20 of 123 posts
Re: Fly.io Status – Consul cluster outage
#12Been a fan of fly and have had most, if not all, of my side and semi-side projects on there for some time now. But...the ratio of good/fun/snarky blog posts to reliable service has gotten a bit too large for me, starting to look for other providers at this point just in case they can't turn this trend around. Honestly been a good object lesson for me in the importance of backing up marketing/hype/"mind-share" stuff w…
Re: Fly.io Status – Consul cluster outage
#13They seem to have a lot of issues with Consul, is it the design of Consul or the way they use it that is the problem?
The former ish -- they relied on consul marketing that the hammer fit the square hole. Hashicorp has been pretty bad about marketing themselves as the right tool for any job, but they really only fit the narrowest of tasks before you find yourself needing an alternative or being compelled to buy a support contact. It's atlassian from Arkansas, just faster
Re: Fly.io Status – Consul cluster outage
#14“ We are working to build a new Consul cluster with 10x the RAM. We aren't yet sure, but believe a routine DNS change might have created a thundering herd problem causing Consul servers to immediately increase RAM usage by 500%. This is not ideal.”
_This is not ideal._
Re: Fly.io Status – Consul cluster outage
#15Re: Fly.io Status – Consul cluster outage
#16They seem to have a lot of issues with Consul, is it the design of Consul or the way they use it that is the problem?
My gut with Consul is don’t use it for high-load distributed services.
[1] https://blog.roblox.com/2022/01/roblox-return-to-service-10-...
Re: Fly.io Status – Consul cluster outage
#17Been a fan of fly and have had most, if not all, of my side and semi-side projects on there for some time now. But...the ratio of good/fun/snarky blog posts to reliable service has gotten a bit too large for me, starting to look for other providers at this point just in case they can't turn this trend around. Honestly been a good object lesson for me in the importance of backing up marketing/hype/"mind-share" stuff w…
Re: Fly.io Status – Consul cluster outage
#18It's either very smart (if they pull it off) because they will have a ginormous cost advantage or they fail.
I'm personally of the opinion that the ux on top of aws/gcp/... is worse than a doo-doo in a shoe. However, they are as stable as can be (all complex systems go down once in a while). There are very few mature projects that do not rely on aws/gcp/... managed services anyway. Might as well put in the little bit of effort to set yourself up for the future instead of painful migrations. This obviously doesn't hold for hobby projects.
In any case, I have a lot of respect for the engineering that fly does. Kudos.
Re: Fly.io Status – Consul cluster outage
#19Been a fan of fly and have had most, if not all, of my side and semi-side projects on there for some time now. But...the ratio of good/fun/snarky blog posts to reliable service has gotten a bit too large for me, starting to look for other providers at this point just in case they can't turn this trend around. Honestly been a good object lesson for me in the importance of backing up marketing/hype/"mind-share" stuff w…
Relevant response from the Fly community forums: https://community.fly.io/t/frequent-outages-is-really-demons...