Live data from Hacker News

“We have been experiencing a catastrophic DDoS attack”

status.linode.com

141–150 of 151 posts

Re: “We have been experiencing a catastrophic DDoS attack”

#141
post #71
post #25

Earlier quoted context omitted.

If you live in 2002, nah. In 2016? Yes. Bandwidth is cheap and linode has high margins.

Bandwidth is cheap but attacks are cheap too.

Which is exactly why you need to be prepared for them?

Re: “We have been experiencing a catastrophic DDoS attack”

#142

Well, I had Linode shortlisted for an upcoming project. I hate to take them off the list because it is not their fault, but I don't want this kind of unreliability.

Atlanta is their smallest datacenter IIRC with their lowest bandwidth capacity. I would still recommend them as we have had great luck with their Dallas DC. It seems to be the most resilient of them all in terms of random network outages and also DDOS attacks. However the one in December did take them offline for a few hours but after which they apparently implemented more DDOS protection. Keep in mind this could hap…

How do you know atlanta is their smallest datacenter?

Is there a list somewhere that shows what the capacity of each of their datacenters is?

Atlanta got trashed the worst back in December but they beefed it up a lot. But how much? Is Dallas still bigger?

Im considering migrating everything to dallas.

Re: “We have been experiencing a catastrophic DDoS attack”

#143

Earlier quoted context omitted.

Atlanta is their smallest datacenter IIRC with their lowest bandwidth capacity. I would still recommend them as we have had great luck with their Dallas DC. It seems to be the most resilient of them all in terms of random network outages and also DDOS attacks. However the one in December did take them offline for a few hours but after which they apparently implemented more DDOS protection. Keep in mind this could hap…

How do you know atlanta is their smallest datacenter? Is there a list somewhere that shows what the capacity of each of their datacenters is? Atlanta got trashed the worst back in December but they beefed it up a lot. But how much? Is Dallas still bigger? Im considering migrating everything to dallas.

I think it was a blog post that was talking about why Atlanta had so many capacity issues with the DDOS. I just tried to find it and now cant.

Dallas has been superb though, definitely go with that if you can.

Re: “We have been experiencing a catastrophic DDoS attack”

#144

Earlier quoted context omitted.

Same here, and as long as you understand how mysql replication works it's not too much effort to deal with. Performing the initial sync without downtime is a bit tricky, but can be done with a well-designed database and some thought. Basically you need to at least temporarily make the bulk of your data read-only, so that you can do most of the data transfer while things are running, and then only briefly lock tables…

No need to take production offline when using the percona xtrabackup tool to set up the slave. It's super easy to use, and I've done it multiple times on databases in the hundreds of gigabytes.

That does look like a great tool! If we were on all InnoDB I'd probably try switching over to it instead of LVM snapshot-based backups right now. (Since it can do incremental, mostly.) We have a bunch of large MyISAM tables though (MyISAM used because the tables are read-only, so read speed is the only real consideration), so those would have to be handled separately. I could always xtrabackup all the innodb stuff and then just file copy the myisam tables separately though, since I know they won't be changing.

Hmm, may have to give it a try! Thanks.

Re: “We have been experiencing a catastrophic DDoS attack”

#146

Earlier quoted context omitted.

WPEngine & their customers.

This is becoming less and less true every day since last Christmas.

I've noticed! We really haven't had issues with your service since about January.

Re: “We have been experiencing a catastrophic DDoS attack”

#147
Linode is a cost effective solution comparing to AWS. But the security and DDoS issues could raise eyebrows and bring confidence issues with customers. This has happened even after they posted about enhanced DDoS mitigation strategies like procuring more bandwidth etc.

If you look at the history of Linode discussions under HN, most of them were related to DDoS attacks and service downtimes. https://news.ycombinator.com/from?site=linode.com

I hope they will recover soon and make the service stable.

Re: “We have been experiencing a catastrophic DDoS attack”

#148

Earlier quoted context omitted.

How do you know atlanta is their smallest datacenter? Is there a list somewhere that shows what the capacity of each of their datacenters is? Atlanta got trashed the worst back in December but they beefed it up a lot. But how much? Is Dallas still bigger? Im considering migrating everything to dallas.

I think it was a blog post that was talking about why Atlanta had so many capacity issues with the DDOS. I just tried to find it and now cant. Dallas has been superb though, definitely go with that if you can.

How was the recent attack in Dallas? Labor day weekend Atlanta went down for about 25 minutes until they squashed it. Then I saw dallas came under attack. How did it handle the DDOS this time?

Re: “We have been experiencing a catastrophic DDoS attack”

#149

Earlier quoted context omitted.

I think it was a blog post that was talking about why Atlanta had so many capacity issues with the DDOS. I just tried to find it and now cant. Dallas has been superb though, definitely go with that if you can.

How was the recent attack in Dallas? Labor day weekend Atlanta went down for about 25 minutes until they squashed it. Then I saw dallas came under attack. How did it handle the DDOS this time?

We had a few seconds of latency tacked onto our normal response time for about 40 mins but everything stayed up. Here is a graph from our monitoring tool (grafana with WorldPing) http://tomschlick-screenshots.s3.amazonaws.com/RKRIJQ9Q

Re: “We have been experiencing a catastrophic DDoS attack”

#150

Earlier quoted context omitted.

How was the recent attack in Dallas? Labor day weekend Atlanta went down for about 25 minutes until they squashed it. Then I saw dallas came under attack. How did it handle the DDOS this time?

We had a few seconds of latency tacked onto our normal response time for about 40 mins but everything stayed up. Here is a graph from our monitoring tool (grafana with WorldPing) http://tomschlick-screenshots.s3.amazonaws.com/RKRIJQ9Q

Very interesting. Looks like Dallas can still handle a DDOS better. Got news that Atlanta is increasing their bandwidth 6X real soon. Its scheduled this month. They handled this DDOS pretty good. Although we actually had downtime. Adding 6X bandwidth should make a huge difference. Not sure which datacenter should be my primary though after the 6X upgrade. Oh wait, linode just responded to me. They are recommending atlanta for ddos over dallas after the 6x upgrade. Hmmmmm.
Post reply on HN