Earlier quoted context omitted.
Hacker News is an excellent status page for those cases.
Out of curiosity, done HN use any CDN or other way of DDOS protection? dang?
[deleted]
Cloudflare was down
271–280 of 499 posts
Re: Cloudflare was down
#272Earlier quoted context omitted.
Yes its really odd that core backbone providers can go down and everything works like its supposed to. Even trans-pacific cables can be cut and things will usually work with only increased latency. But there is not much redundancy for many companies at this layer; having redundant DNS providers is I'm sure possible but not something we think about very often, and of course many of the sites that are down are dependin…
I imagine most people would never expect something like this to happen, so having a fallback option when Cloudflare has a huge interruption of service like this is just unthinkable.
All the major cloud infrastructure providers have had outages of varying severity at one point or another...it's something you'd want to take into account for, say, a system that remote controls life-critical devices, but likely isn't worth the engineering time and added complexity for a productivity or social app with a small userbase. Working on many of the latter over the years I've generally said "well if {major cloud provider} is down, the internet is going to be all messed up for a bit anyway, so we'll accept the risk of being down when they're down, and reassess whether that keeps making sense as we grow."
Re: Cloudflare was down
#273Discord is entirely down right now, both the website and the app itself. Amusingly, a lot of the sites that normally track outages are also down, which made me think it was my internet at first. Downdetector, monitortheinternet, etc. Lots of other big sites that are down: Patreon, npmjs, DigitalOcean, Coinbase, Zendesk, Medium, GitLab (502), Fiverr, Upwork, Udemy Edit: 15 min later, looks like things are starting to…
Kudos to the people at Discord. Just a few minutes after I got disconnected they already tweeted about the issue. Some minutes later and they have a message in their desktop app confirming it's an issue with Cloudflare. All while Cloudflare's statuspage says there are 'minor outages'.
Re: Cloudflare was down
#274Having DNS issues. Had to switch to Google's DNS (8.8.8.8/8.8.4.4) as 1.1.1.1/etc were not resolving anything.
Same. Had to go through the entire troubleshooting process --- is it my internet connection? my DNS resolver? firewall? ISP starting to filter DoT queries somehow?
Only last in my mental list was the possibility that Cloudflare would be down.
Hope they publish a detailed post-mortem. It's always fun to read (but certainly very painful for those directly involved in writing it).
Re: Cloudflare was down
#275Our TPU management page is also down: https://www.tensorfork.com/tpus Seems cloudflare took out a good chunk of the internet temporarily. Doesn’t HN use cloudflare? Why did it survive? (I haven’t looked for about a year, but I seem to remember HN being proxied behind CF at one point.)
HN allegedly still runs on one machine running a single-threaded Lisp webserver.
Re: Cloudflare was down
#276Earlier quoted context omitted.
We're dealing with a deeper level problem here. Since a lot of the internet is relying on Cloudflare DNS at some part or another, even many backup solutions fail. Since so much of DNS is centralised in so few services, such outages hit the core infrastructure of the internet.
A sudden disruption on a large number of services for everybody at once doesn't look like a DNS problem to me, with all the caching in DNS. It would fail progressively and inconsistently.
DNS absolutely was an issue. I changed DNS manually from Cloudflare's 1.0.0.1 (which is what DHCP was giving me) to 8.8.8.8 (Google) and most things I'm trying to reach work. There may be other failures going on as well, but 1.0.0.1 was completely unreachable.
Re: Cloudflare was down
#277Earlier quoted context omitted.
I've never even heard of the site before. Nor have I searched for "attorney" any time recently.
It looks like you mistyped it and landed on a domain with spammy redirects. They have all kinds of weird URLs and there's not always any connection to anything you did other than go to the wrong domain.
I didn't mis-type. I press 'd' and Firefox fills-in the site for me.
If I type 'e' I get 'en.wikipedia.org'.
I was redirected.
Re: Cloudflare was down
#278Discord is entirely down right now, both the website and the app itself. Amusingly, a lot of the sites that normally track outages are also down, which made me think it was my internet at first. Downdetector, monitortheinternet, etc. Lots of other big sites that are down: Patreon, npmjs, DigitalOcean, Coinbase, Zendesk, Medium, GitLab (502), Fiverr, Upwork, Udemy Edit: 15 min later, looks like things are starting to…
> Amusingly, a lot of the sites that normally track outages are also down, which made me think it was my internet at first. That is why if you have this question, you should go to google.com My guess is that there are more resources invested in making sure google.com stays up than for any other site on the internet.
Depending on what part we're talking about, it varies. But yeah, just a few.
Re: Cloudflare was down
#279Earlier quoted context omitted.
Out of curiosity, done HN use any CDN or other way of DDOS protection? dang?
It's hosted on AWS, you don't need DDoS protection, just a big wallet.
Hacker News is self-hosted: https://news.ycombinator.com/item?id=22767439. Let me see if I can find a better link where the specs are discussed.
Re: Cloudflare was down
#280Discord is entirely down right now, both the website and the app itself. Amusingly, a lot of the sites that normally track outages are also down, which made me think it was my internet at first. Downdetector, monitortheinternet, etc. Lots of other big sites that are down: Patreon, npmjs, DigitalOcean, Coinbase, Zendesk, Medium, GitLab (502), Fiverr, Upwork, Udemy Edit: 15 min later, looks like things are starting to…
Kudos to the people at Discord. Just a few minutes after I got disconnected they already tweeted about the issue. Some minutes later and they have a message in their desktop app confirming it's an issue with Cloudflare. All while Cloudflare's statuspage says there are 'minor outages'.
Every company rushes to report an outage when they can blame another vendor, well that might be hyperbolic but it's sure a lot easier!