Cloudflare Network Performance Issues • Hacker News Board

Re: Cloudflare Network Performance Issues

#191

Post by nullify88 » Tue, Jul 02, 2019, 2:17 PM UTC

buildbuildbuild wrote: post #152

Cloudflare: Your status page showed "all systems operational" for over 20 minutes while your primary domain was returning a 502 error. Please change this to update automatically, many other engineering teams depend on you. https://i.imgur.com/qHBM2JW.png

We saw an update within 5 minutes of our sites going down. Are you doing caching somewhere?

Re: Cloudflare Network Performance Issues

#192

Post by btown » Tue, Jul 02, 2019, 2:17 PM UTC

Heliosmaster wrote: post #175

buildbuildbuild wrote: post #152

Cloudflare: Your status page showed "all systems operational" for over 20 minutes while your primary domain was returning a 502 error. Please change this to update automatically, many other engineering teams depend on you. https://i.imgur.com/qHBM2JW.png

Are you sure it wasn't cached? For us it was showing correctly the incident...

If cloudflarestatus.com isn't serving text content as Cache-Control: no-cache, that's itself an egregious bug.

Re: Cloudflare Network Performance Issues

#193

Post by dalore » Tue, Jul 02, 2019, 2:18 PM UTC

pmlnr wrote: post #72

Good. I'm tired of people not learning that trusting a single gateway with 50% of the internet is bad. Yes, I know, free DDOS protection. There has to be another way of doing this, some mesh based DDOS protection or so.

9.6% not 50%

Re: Cloudflare Network Performance Issues

#194

Post by chasd00 » Tue, Jul 02, 2019, 2:18 PM UTC

deadalus wrote: post #49

8chan, 4chan down as well. Damn, this is big. https://cloudflare.com itself is gone.

that's bad news, i like 4chan being up because it keeps them all in one place and they don't start wandering around.

Re: Cloudflare Network Performance Issues

#195

Post by nielsole » Tue, Jul 02, 2019, 2:18 PM UTC

Good reminder for us of why you want to mirror all code dependencies required during autoscaling :/

Re: Cloudflare Network Performance Issues

#196

Post by johnxie » Tue, Jul 02, 2019, 2:18 PM UTC

johnxie wrote: post #30

Looks like everyone is impacted. We are seeing 502 Bad Gateway across multiple domains and regions on https://taskade.com

Back up and running!

Re: Cloudflare Network Performance Issues

#197

Post by oxfordmale » Tue, Jul 02, 2019, 2:18 PM UTC

This is resulting in build failures in our AWS CodePipeline as we can't pull some Docker images from Dockerhub

Re: Cloudflare Network Performance Issues

#198

Post by _wmd » Tue, Jul 02, 2019, 2:19 PM UTC

lkbm wrote: post #142

pmlnr wrote: post #72

Good. I'm tired of people not learning that trusting a single gateway with 50% of the internet is bad. Yes, I know, free DDOS protection. There has to be another way of doing this, some mesh based DDOS protection or so.

This seems like a case for putting more of the internet through a single gateway. Having my downtime correlated with everyone else's means users will be more forgiving because they'll perceive it as "the Internet's down" rather than "lkbm's site is broken". (We saw this with CloudFlare. Some users were pissed, and others jumped in with "it's not their fault; AWS is down". That doesn't happen when our stuff specifical…

Centralizing more of the Internet to help people align their excuses is probably the worst reasoning I've ever read

Re: Cloudflare Network Performance Issues

#199

Post by bpicolo » Tue, Jul 02, 2019, 2:19 PM UTC

hu3 wrote: post #179

heavymark wrote: post #55

Holy crap, cloudflare down, and seemingly all the covers. Major sites such as Digitalocean are all down, and no way to easily disable cloudflare since their site is down.

https://www.digitalocean.com/ frontpage working for me: https://i.imgur.com/8yJRXVI.png

The outage appears to have ended between that post and your post.

Re: Cloudflare Network Performance Issues

#200

Post by buildbuildbuild » Tue, Jul 02, 2019, 2:19 PM UTC

nullify88 wrote: post #191

buildbuildbuild wrote: post #152

Cloudflare: Your status page showed "all systems operational" for over 20 minutes while your primary domain was returning a 502 error. Please change this to update automatically, many other engineering teams depend on you. https://i.imgur.com/qHBM2JW.png

We saw an update within 5 minutes of our sites going down. Are you doing caching somewhere?

Interesting, I was command+shift+R refreshing and also tried from a VPN in another region. Perhaps our CF-hosted sites returned 502s in my region sooner than yours, causing me to check the status page sooner.