Live data from Hacker News

InfluxDB Cloud shuts down in Belgium; some weren't notified before data deletion

community.influxdata.com

11–20 of 278 posts

Re: InfluxDB Cloud shuts down in Belgium; some weren't notified before data deletion

#11
I wonder if they’re open in other EU regions? If you wanted to shut down a region, as a database provider, is it even possible to send snapshots to another region without user consent?

It feels like that could be a good practice, or not, depending on the laws in question.

Re: InfluxDB Cloud shuts down in Belgium; some weren't notified before data deletion

#12

I wonder if they’re open in other EU regions? If you wanted to shut down a region, as a database provider, is it even possible to send snapshots to another region without user consent? It feels like that could be a good practice, or not, depending on the laws in question.

Their migration guides does include help for customers to migrate data from one region to another EU region (Frankfurt).

They might not have been able to do it automatically as the region name were hardcoded in the hostname.

Re: InfluxDB Cloud shuts down in Belgium; some weren't notified before data deletion

#13
post #4

> According to the support, the notification emails to the users were sent on Feb 23, Apr 6 and May 15th. However, we did not receive those at all. If true, this is concerning. One message getting lost in spam understandable. But three over 6 months would imply they're being blacklisted and/or their mail sender is simply broken. Do serious companies not have canaries or other checks in place to ensure their notificat…

If a spam service erroneously marks one email as spam, chances are it will also marks other very similar emails as spam. So it's not too surprising all three were marked.

For these kind of automated emails getting all emails consistently being delivered to everyone is really hard, almost impossible.

The problem here isn't really that emails weren't being delivered, it's that they seem to have tried only one method to contact people, didn't check how successful that was (e.g. by seeing how many customers were still on those regions), and seemingly never tried anything else (such as notifications on the dashboard, a temporary brown-out to alert people, etc.) – "we tried one way to contact you and that didn't work, so we just deleted your service sucks to be you lol kthxfuckitybye"

Re: InfluxDB Cloud shuts down in Belgium; some weren't notified before data deletion

#14
Wow, the incredibly callous 3-word explanation of the issue by pointing to a docs link with no other context. Really gives off "it's your fault for not reading the wiki." Is this how InfluxDB treats their customers?

Incidentally at work we've been evaluating a new hosted observability provider, looks like we can rule out Influx as an option.

Re: InfluxDB Cloud shuts down in Belgium; some weren't notified before data deletion

#15
This seems really poor. They should have been able to see what customers are still using the service in that region, send them additional reminders that they need to get off, and only after several of those and a grace period remove access. Maybe even have a phase of read-only access before full removal.

Re: InfluxDB Cloud shuts down in Belgium; some weren't notified before data deletion

#16
post #9
post #8

This kind of thing really does need a cooling off period. Assume that your users won't see your emails. How do you help them avoid data loss when you shut down a service like this? One option that I like is to take the service down (hence loudly breaking things that were depending on it) but keep backed up copies of the data for a while longer - ideally a month or more, but maybe just two weeks. That way users who di…

you start with reliability brownouts. first fail 0.1% requests, then after a week 1%, then after a month 5%.

That seems like the worst of both worlds, during the brown-out you have to keep paying for the compute while your customers don't get a reliable service, even if they have a plan to migrate.

Also you probably can't keep charging customers for that period since you offer a crippled service on purpose.

Re: InfluxDB Cloud shuts down in Belgium; some weren't notified before data deletion

#17
It's tough to believe that the turning off of the service couldn't have involved at least a week of 'soak' time, where if you contacted them they then helped you move to another location. After all the additional cost/benefit ratio of keeping the VMs around, but not using CPU or bandwidth vs. retaining a few customers would indicate it is the right thing to do for both the customers and the business.

Re: InfluxDB Cloud shuts down in Belgium; some weren't notified before data deletion

#18
post #9
post #8

This kind of thing really does need a cooling off period. Assume that your users won't see your emails. How do you help them avoid data loss when you shut down a service like this? One option that I like is to take the service down (hence loudly breaking things that were depending on it) but keep backed up copies of the data for a while longer - ideally a month or more, but maybe just two weeks. That way users who di…

you start with reliability brownouts. first fail 0.1% requests, then after a week 1%, then after a month 5%.

Much better is to stop the service but add button "Resume" that re-enables service for two more weeks with no data loss. That way you give users opportunity to gracefully migrate away.

Stopping service and immediately delete data is just callous.

Re: InfluxDB Cloud shuts down in Belgium; some weren't notified before data deletion

#19

It's almost like using bullshit hype-hype-hype databases, especially their cloud offerings, is a horrible idea.

Nobody is complaining about the database, they're complaining about poor communication. It could happen with anything that depends on a 3rd party.

Re: InfluxDB Cloud shuts down in Belgium; some weren't notified before data deletion

#20

Wow, the incredibly callous 3-word explanation of the issue by pointing to a docs link with no other context. Really gives off "it's your fault for not reading the wiki." Is this how InfluxDB treats their customers? Incidentally at work we've been evaluating a new hosted observability provider, looks like we can rule out Influx as an option.

> Really gives off "it's your fault for not reading the wiki." Is this how InfluxDB treats their customers?

I don't see any indication that the person who posted that is associated with InfluxDB. In fact, it doesn't seem like any staff member has posted in that forum in the past week. Up to you if you consider that better or worse.

Post reply on HN