Live data from Hacker News

Cloudflare had a partial outage

cloudflare.com

321–330 of 448 posts

Re: Cloudflare had a partial outage

#321
post #129

I wasted a bunch of time debugging the HTTP 500 errors on my site before I realized everything is 100% OK on my end, and that it's Cloudflare returning the error not my servers.

Ditto - I'm sitting here, wtf I'm not running Nginx on my blog, but I'm getting an Nginx response, hit IP directly....oooh.... right that doesn't make sense it's working fine. Cloudflare can't be down, that's next to, wait, status page (to their credit it's got a status note). HN here we go...

Sorry about that.

Re: Cloudflare had a partial outage

#322
post #275
post #225

Earlier quoted context omitted.

The way I read their complaint was that they should have something on their website to indicate they were down. Anyway, at the time they complained, the status page also already said that the issue was identified and a fix was being rolled out.

Their post was saying that the dedicated status domain should be the first place to get useful information. There were multiple new threads on HN before the status page was updated at all. I'm sure there are legal reasons, but it's not ideal. Then there was the CTO's (appreciated!) comment prior to the status page's second update with information suggesting this would be resolved soon (which IMO is the information ev…

Possibly.. you seem to have a lot more insight into what GP meant instead of what they said, so I'll defer to you on this one.

Re: Cloudflare had a partial outage

#323
post #317

I really dislike that they are editing their status messages. Entry[1] dated "Jun 21, 2022 - 06:43 UTC" has been edited to include more detail after they posted another entry at 06:57 UTC. There seems to be no indication that the message has been altered. Currently text on the status page may suggest that they identified the problem immediately but it took about 15 minutes. Previously there was a text stating that cu…

Strongly agree. Such whitewashing puts all previous incident reports in doubt - can I trust CF summaries of outages, or did they rewrite that history too.

I understand your point, but CloudFlare generally is very transparent, including root cause analysis and their CTO reaching out directly. It could also be a mistake or not so well thought about instead of assuming bad intentions.

Re: Cloudflare had a partial outage

#324
post #265

It's time to start discussing a fail-open option for us CF users. Most of my sites are using CF for global performance rather than DDoS protection and security. I'd be fine with them changing DNS to point to the origin (or any other user defined IPs) in case of issues (even if it would take hours to return to normal). This is also important for countries with limited connectivity to the Internet, if the PoP in that c…

Wouldn't this expose the origin IPs to attack?

The origin IP's are already open to attack for most users.

It's trivial to scan the whole IPv4 internet to find out which IP you are hosting your site on.

Re: Cloudflare had a partial outage

#325
post #225
post #198

Earlier quoted context omitted.

The comment on HN had more useful information (that the issue was understood and a fix coming) before that status page then updated. I think that's their point. Prior to that, it was some time (in the "all my sites are wrecked" timescale) before the status page had any indication of an outage.

The way I read their complaint was that they should have something on their website to indicate they were down. Anyway, at the time they complained, the status page also already said that the issue was identified and a fix was being rolled out.

Actually, it was backdated: https://news.ycombinator.com/item?id=31821335

Re: Cloudflare had a partial outage

#326
post #129

Earlier quoted context omitted.

Ditto - I'm sitting here, wtf I'm not running Nginx on my blog, but I'm getting an Nginx response, hit IP directly....oooh.... right that doesn't make sense it's working fine. Cloudflare can't be down, that's next to, wait, status page (to their credit it's got a status note). HN here we go...

Sorry about that.

Would it be possible to adjust that 500 page to include an indication that it originates from Cloudflare, for the case that an outage like this happens again in the future?

Re: Cloudflare had a partial outage

#327
post #294

Kind of ironic, there was a big "cloudflare is bad and a central point of failure" article on the front page just a couple days ago. Found it, https://news.ycombinator.com/item?id=31801947 edit: Not that I necessarily agree with the article even in light of there being an outage, cloudflare has been pretty good for us. Just thought it was interesting.

But web2 is going (really) great once you depend on Cloudflare. And it is certainly not re-centralizing the whole internet with a provider that is a single point of failure. /s

I can't tell if you're being cynical or actually mean it.

Care to clarify so I could take the mandatory contrarian approach?

Re: Cloudflare had a partial outage

#328

GitLab.com is impacted too as they are also behind Cloudflare.

GitLab team member here. Thanks for sharing.

Incident: https://status.gitlab.com/pages/incident/5b36dc6502d06804c08... with the latest update:

[Monitoring] Services seem to be back to normal, and we continue monitoring. Details in https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7...

Re: Cloudflare had a partial outage

#329
post #152
post #24

This should hopefully drive home the idea of why HN shouldn't be cheering on Cloudflare's slow takeover of the internet.

Out of interest, what competitors are available? Clodufare protects against DDOS? Does it do other stuff?

DDoS-Guard is the goto if Cloudflare decides it can't take you as a customer.

Re: Cloudflare had a partial outage

#330
post #156
post #67

Hackernews is my new status page. All others are useless.

I first checked DownDetector which is really good for individual services. Except they are now also down...

I too went to downdetector to see what was going on and funnily enough is was also down. They also had a funny error message.

Edit:- Found it from another user.,

Downdetector: ಠ_ಠ Well, this is awkward...

Post reply on HN