Live data from Hacker News

Linode Outage in Dallas, Fremont, Atlanta, Newark, and Toronto Data Centers

status.linode.com

51–60 of 106 posts

Re: Linode Outage in Dallas, Fremont, Atlanta, Newark, and Toronto Data Centers

#51

They were just bought by Akamai so unfortunately things like this are bound to happen if they are trying to integrate with Akamai the way they'd need to successfully keep growing. I'm not talking just software integration but process and people integration as well. We'll see I guess!

The Akamai acquisition has had me kind of stressed to be honest. Here in Oceania there aren't a whole lot of established "cloud" hosts to pick from that host locally. Linode is fantastic and I have loved them for 10+ years. Digital Ocean doesn't host here, nearest is Singapore. Vultr does but I have had poor experiences with them. The other options are AWS and Google which are potentially unbounded expenses which is…

These guys are in Australia amongst other locations: https://www.ovhcloud.com/

Re: Linode Outage in Dallas, Fremont, Atlanta, Newark, and Toronto Data Centers

#52

I think "Outage" as stated is a bit over-the-top. We run significant operations in most of these DCs, and we have seen zero impact. YMMV of course, but I think it's a big disingenuous to say this is a full outage.

For what it's worth I have around 25 Linodes active, mostly in Newark but a few in Atlanta and Dallas as well.

Of those I had two in Newark which actually had their leases expire before we were aware of what was going on and then found three more (two Atlanta, one Newark) once we knew what to look for which were failing to renew. All five of those machines already had network helper enabled as Linode suggests but were unable to get a lease even with manual operation of the DHCP client until they were rebooted.

Re: Linode Outage in Dallas, Fremont, Atlanta, Newark, and Toronto Data Centers

#53

They were just bought by Akamai so unfortunately things like this are bound to happen if they are trying to integrate with Akamai the way they'd need to successfully keep growing. I'm not talking just software integration but process and people integration as well. We'll see I guess!

I don't think many users will be affected by dhcp outage. Most linodes have fixed IPs. Mine don't seem to be affected

> Most linodes have fixed IPs.

We run some Windows instances, which were DHCP out of laziness. [edit: It's a PITA to fire up a Windows instance on Linode. Once working, switching out of DHCP is near the bottom of the todo list.]

Re: Linode Outage in Dallas, Fremont, Atlanta, Newark, and Toronto Data Centers

#54

They were just bought by Akamai so unfortunately things like this are bound to happen if they are trying to integrate with Akamai the way they'd need to successfully keep growing. I'm not talking just software integration but process and people integration as well. We'll see I guess!

The Akamai acquisition has had me kind of stressed to be honest. Here in Oceania there aren't a whole lot of established "cloud" hosts to pick from that host locally. Linode is fantastic and I have loved them for 10+ years. Digital Ocean doesn't host here, nearest is Singapore. Vultr does but I have had poor experiences with them. The other options are AWS and Google which are potentially unbounded expenses which is…

Unrelated to the Linode thing, but in 15 years building and selling SaaS products, I've encountered a number of customers who nitpick prices or try to haggle. I'm not talking about non-profits with micro budgets, rather very profitable businesses.

Nowadays, whenever someone goes there, I just change my usual lighthearted tone to a serious one and say "Yeah, our prices are firm, if that's outside of your budget it's better we just move on". They 180 real fast. Every. Single. Time. Then they never mention prices again.

Re: Linode Outage in Dallas, Fremont, Atlanta, Newark, and Toronto Data Centers

#55

They were just bought by Akamai so unfortunately things like this are bound to happen if they are trying to integrate with Akamai the way they'd need to successfully keep growing. I'm not talking just software integration but process and people integration as well. We'll see I guess!

I don't think many users will be affected by dhcp outage. Most linodes have fixed IPs. Mine don't seem to be affected

Most have DHCP-fixed IPs.

The IP lease never changes but it's assigned by DHCP - check your settings (mine was in /etc/netplan/01-netcfg.yaml

dhcp4: yes

Re: Linode Outage in Dallas, Fremont, Atlanta, Newark, and Toronto Data Centers

#57

In almost 20 years with Linode, I've had nearly zero problems. Akamai buys them, and within months we have an outage. Not encouraging... On the other hand, it's only hitting my personal website, and the customer I have on Linode seems unaffected, so that's nice at least.

I'm wondering how much of this is perception...

The number of reported issues coming through has exploded since Akamai. Over the last week alone, almost every day a new networking issue for London is in my inbox. However - none of the recent ones have actually affected any one of my Linodes, even though it's possible since it falls under the service and datacenter - perhaps the change we are seeing is more transparency?

I'm not saying no one is affected... as others in this thread clearly are, and I was affected by the datacenter wide outage in London earlier in the year - but it's possible that being more upfront in notifications of issues could change the perception of what before would have been considered a collection of isolated incidents.

[edit]

I generally appreciate transparency, but when it comes to varying degrees of service disruption maybe there is a balance to be struck... right now it feels like the signal to noise ratio is low in terms of it's affect across all users even within an area.

Right now I am pretty much ignoring the Linode issues filling my inbox, if a serious one came through I'd probably miss it.

Re: Linode Outage in Dallas, Fremont, Atlanta, Newark, and Toronto Data Centers

#58

In almost 20 years with Linode, I've had nearly zero problems. Akamai buys them, and within months we have an outage. Not encouraging... On the other hand, it's only hitting my personal website, and the customer I have on Linode seems unaffected, so that's nice at least.

I’ve had a non trivial number of issues with them over the years. Enough that I moved all of my infrastructure to other (more expensive) providers.

That being said, it was probably value for money spent while it lasted.

Re: Linode Outage in Dallas, Fremont, Atlanta, Newark, and Toronto Data Centers

#59

In almost 20 years with Linode, I've had nearly zero problems. Akamai buys them, and within months we have an outage. Not encouraging... On the other hand, it's only hitting my personal website, and the customer I have on Linode seems unaffected, so that's nice at least.

Well, it appears to be fixed now (for my websites at least), so I'm not as worried about Akamai as I was a couple hours ago. If it's another decade before I have an outage, I'm satisfied. On the other hand, if this happens again any time soon, it will be time to start evaluating options, I guess.

Re: Linode Outage in Dallas, Fremont, Atlanta, Newark, and Toronto Data Centers

#60

Earlier quoted context omitted.

The Akamai acquisition has had me kind of stressed to be honest. Here in Oceania there aren't a whole lot of established "cloud" hosts to pick from that host locally. Linode is fantastic and I have loved them for 10+ years. Digital Ocean doesn't host here, nearest is Singapore. Vultr does but I have had poor experiences with them. The other options are AWS and Google which are potentially unbounded expenses which is…

These guys are in Australia amongst other locations: https://www.ovhcloud.com/

A caveat with them is that they're really trying to be price competitive, and can sometimes go overboard (like design their own custom datacenters and servers with watercooling, and skipping some things like fire suppression systems, and using cheap material such as plywood). Having a backup with a different provider, somewhere else, is always a good idea.
Post reply on HN