Live data from Hacker News

Fly.io Postgres cluster down for 3 days, no word from them about it

webcache.googleusercontent.com

261–270 of 493 posts

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#261

Earlier quoted context omitted.

Curious to know, have you tried Render? What is the successor to Heroku in your eyes?

Render has been my drop-in successor to Heroku. No complaints except their weird team pricing, which doesn't matter for solo projects

Render didn't support Docker images last I checked, and the worst part of Heroku and cloning it was not actually having a locally reproducible build image. I want to deploy what I've built locally, not hand my source over to some magical pipeline.

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#262

Earlier quoted context omitted.

It looks like being authentic is valued over anything else at Fly. I can’t explain how a company responds this immaturely to incidents like these.

We're just people. We don't have the part of the company that keeps us from communicating like people in public. Maybe we'll grow it someday.

Please don’t.

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#263
post #29
post #13

Earlier quoted context omitted.

Yes, this. It's tough when you've already played your "we messed up but we're making it right" card, and then you continue to not have it right.

Hosting service that cannot get basics right after a decade plus of solving these problems as an industry. Are we even trying or just repeating ourselves because we don’t know what else to do? How can the entire industry keep making the same basic errors? “Let’s keep it simp… ohh nope we invented a Turing complete language and customer service is terri… wait do we have customer service?” I get the world turning again…

> Computers are so fast now,

Agreed

> enthusiasts would be better served DIY; put a beige box in a local colo

I mean, like, can I provision a zero ops bit of compute from for $20/month?

Edit: looked up colo providers in my city- “get started in 24 hours, pick a rack and amperage, schedule a call now.”. Yeaaah, no. This is why people use cloud providers instead.

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#264

Earlier quoted context omitted.

I moved from DO to Hetzner ( cheaper), I am happy about it.

Does anyone know how Hetzner pricing is half of DO yet is profitable, while DO is loss making with 6% operating margin?

I've been with them for a long time and my guesses would be:

1. Strict rules and strict customer verification. Crypto mining that wastes SSDs is not allowed. Portscans, mass emails, etc. are not allowed. They also don't offer GPUs to the general public because it has been abused in the past. You usually need to send in ID documents just to open an account. My guess is this allows them to avoid most bad actors and, thereby, waste less money on fraud.

2. Extremely long-term investments. They typically build their own hardware and then use it over 10 years. They have their own flea market where you can rent older server models for a steep discount. That means they will have a long time where the hardware is fully paid off and still generating revenue.

3. Great service. With a mid-sized company, I can call their technicians in the middle of the night. The fact that we could call them in case of a crisis has generated A LOT of good will. But I would be truly surprised if they didn't make a profit off those phone calls, as they charge roughly 4x the salary cost.

4. High-margin managed services. In addition to just the cheap servers, they also offer a managed service where they will do OS and security upgrades for you. It's roughly 2x the price of the server and it appears to be almost fully automated. I know some freelance web designers who will insist on using Hetzner Managed for deployment for their clients, because it is just so convenient. You effectively pass off all recurring maintenance for €300 a month and your client is happy to have an emergency phone number (see #3) in case the box goes down.

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#265
post #112

You know what's interesting? It feels like history is repeating itself with Fly.io, just like it did back when I first encountered Heroku. Back in the day, I was super excited about Fly.io – it had that same fresh, exciting vibe that Heroku had when it burst onto the scene. I remember being blown away by Fly.io's simplicity and how easy it was to use. It was like hosting made simple, and I couldn't help but think, "T…

I feel the same way. Do you think its related to scale? As in, once a company has enough paying customers to become profitable/investable, it has also accrued enough issues to where it starts feeling fresh and exciting like you said, and gradually becomes like the older competitor it once wanted to replace? This is my experience at least. Once the company goes from a few pizzas to "we've booked a venue", entropy cree…

The skillset of successfully founding a company and the skillset of successfully scaling a company are not the same. The latter is a hard thing to do that requires understanding both customers (current and potential) that you never speak to and employees that you barely speak to.

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#266
post #229

Earlier quoted context omitted.

They run their own data centres and have for a while. There is a pretty big industry for that sort of thing as an alternative to “the cloud” here in Europe. We used to use nianet to house our hardware in Denmark. Basically these companies does hardware renting and they also do hardware renting with more steps which is where you rent rack space but own the hardware. They provide the place for the hardware and they als…

Couldn't agree more, I think Hetzner is probably Europe's best bet on a hyperscaler. One of the more telling indicators IMO is their growing market share outside of the EU/DACH. To add on to the comments about Hetzner building their own custom hardware, they also custom built their own software stack. They rejected the hype that was OpenStack and worked diligently on their own hypervisor platform (that they are incre…

Could you please elaborate how and what you know about managed Kubernetes on Hetzner?

I am asking for this since a while and was told there is no way Hetzner would offer such a service. Certain Posts on Social Media have also never been answered with any kind of indication that they are actually working on it.

Please provide some Details on this.

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#267
post #242
post #229

Earlier quoted context omitted.

They run their own data centres and have for a while. There is a pretty big industry for that sort of thing as an alternative to “the cloud” here in Europe. We used to use nianet to house our hardware in Denmark. Basically these companies does hardware renting and they also do hardware renting with more steps which is where you rent rack space but own the hardware. They provide the place for the hardware and they als…

commendable to plan a few years ahead, but betting on the state of cloud business 26years from now seems a bit over the top

I think multi-national energy sector should be working toward the goals without the regulations. The more prep done before the change the smoother the transition.

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#268
post #132

Not a sarcastic or rhetorical question - how come the three big A clouds or even smaller ones (Hetzner,my favorite) are mostly so stable (give or take some outages) and anyone knows their internal engineering, architecture and practices to keep systems that much stable?

Scale the technical difficulty and innovation of the product with the size and competency of the team. The market will always say they want more and the job of the company leaders is to know when to say no. AWS did not begin with everything it offers now but rather started with fairly boring things (even for the time) that they expanded over time. This was after a decade of learning how to do this internally so they weren't starting from scratch.

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#269
post #112

You know what's interesting? It feels like history is repeating itself with Fly.io, just like it did back when I first encountered Heroku. Back in the day, I was super excited about Fly.io – it had that same fresh, exciting vibe that Heroku had when it burst onto the scene. I remember being blown away by Fly.io's simplicity and how easy it was to use. It was like hosting made simple, and I couldn't help but think, "T…

It was a bit alarming to see Fly offering significant resources for free (and encourage using them in the docs, subtly making them a feature and a reason to switch) back then. I wondered if they overestimated the conscientiousness of the industry: as with Heroku, surely once the word is out in the wider world plenty of people would flock over just to not pay. Guess what happened next…

Heroku was a new thing back then, so it took a while for abuse to ramp up—but every subsequent attempt at being generous should not even be considered without either a vicious and expensive anti-fraud department in place or deep pockets to compensate for the initial lack of said department by throwing enough hardware that the minority of honest users don’t notice the overhead.

My impression suggests that Fly does not score high on either of the above. Which is partly why I like them—the above seems like megacorp type bullshit, and they seem to be strictly no-megacorp-bullshit—but I wouldn’t be surprised if engineers at Fly had to spent most of their time dealing with fires or optimizing resource allocation and auto-limiting freeloading cryptominers, scammers, and other abusers rather than focusing on longer term infrastructure reliability or DX.

Re: Fly.io Postgres cluster down for 3 days, no word from them about it

#270

Earlier quoted context omitted.

I left digitalocean for fly because some of their tooling was excellent. I was pretty excited. I’m back on digitalocean now. I’m not unhappy about it, they’re very solid. I don’t love some things about their services, but overall I’d highly recommend them to other developers. I gave up on fly because I’d spontaneously be unable to automate deployments due to limited resources. Or I’d have previously happy deployments…

I moved from DO to Hetzner ( cheaper), I am happy about it.

Same, tried a bunch before moving completely to Hetzner. I'm super happy with their service.
Post reply on HN