DNS Outage at DigitalOcean

#1

Post by finne » Thu, Mar 24, 2016, 3:34 PM UTC

DNS Outage at DigitalOcean
status.digitalocean.com

Re: DNS Outage at DigitalOcean

#2

Post by pmalynin » Thu, Mar 24, 2016, 3:37 PM UTC

Yeah, tried to access our site and it was down. Really was expecting more out of Digital Ocean than to fuck up such an integral part of their infrastructure. In the future we'll be transitioning away from their DNS solution because this is unacceptable.

Re: DNS Outage at DigitalOcean

#3

Post by yakshaving_jgt » Thu, Mar 24, 2016, 3:57 PM UTC

This is the second time recently their AMS region has gone down, which is where I host my email. What a pain.

Re: DNS Outage at DigitalOcean

#4

Post by grej » Thu, Mar 24, 2016, 3:59 PM UTC

This is causing huge huge pain for us, Digital Ocean.

Re: DNS Outage at DigitalOcean

#5

Post by karlgrz » Thu, Mar 24, 2016, 3:59 PM UTC

This is the first DNS outage I've experienced with them in 3+ years, then again I host everything in their NY regions.

Re: DNS Outage at DigitalOcean

#6

Post by chronid » Thu, Mar 24, 2016, 3:59 PM UTC

DNS is hard. Very hard.

It may seems trivial when it works (hint: it's not), but some of the biggest fuck ups I've seen in my professional life were caused by strange DNS things happening or DNS servers going kaboom.

I feel the pain of the DO engineers trying to mitigate this issue. I really do.

Re: DNS Outage at DigitalOcean

#7

Post by coreyp_1 » Thu, Mar 24, 2016, 4:06 PM UTC

Does anyone know of a good strategy for DNS failover?

Re: DNS Outage at DigitalOcean

#8

Post by showerst » Thu, Mar 24, 2016, 4:08 PM UTC

Feeling the pain here too. What DNS providers do others use and like? Route53?

Re: DNS Outage at DigitalOcean

#9

Post by joejoebob » Thu, Mar 24, 2016, 4:10 PM UTC

showerst wrote: post #8

Feeling the pain here too. What DNS providers do others use and like? Route53?

Where I work we use Rotue53. For my personal domains I just use my registrar, Namecheap.

Re: DNS Outage at DigitalOcean

#10

Post by Thaxll » Thu, Mar 24, 2016, 4:12 PM UTC

chronid wrote: post #6

DNS is hard. Very hard. It may seems trivial when it works (hint: it's not), but some of the biggest fuck ups I've seen in my professional life were caused by strange DNS things happening or DNS servers going kaboom. I feel the pain of the DO engineers trying to mitigate this issue. I really do.

It's not hard, the problem is everything relies on DNS so when DNS goes down or has problems you have cascading failure.