Live data from Hacker News

Cloudflare API, dashboard, tunnels down

cloudflarestatus.com

81–90 of 93 posts

Re: Cloudflare API, dashboard, tunnels down

#81

Downtime happens - no one is happy about it but it comes with the job and downtime will happen whether you use cloud or run on prem. Cloudflare at least accurately reflects the incident on their status page. Often dashboards will show everything green despite the service being down. In these moments communication is critical and Cloudflare does it well especially as we all know when it comes to the post mortem. They…

True. It's also nuts that this downtime according to creation of the post -> resolved in comments, was only 27 minutes... I've literally been on standby to get an answer what happened with a huge cloud provider for 3 weeks now and today they got back with static assets that weren't reachable ( ico's ???) They don't even know what happened since it's not logged in their logging, since it's using middleware and because…

> was only 27 minutes...

I was affected by the tunnel outage. It was down for closer to 3 hours, not 27 minutes. (Their status page does accurately reflect this time)

Re: Cloudflare API, dashboard, tunnels down

#82

Downtime happens - no one is happy about it but it comes with the job and downtime will happen whether you use cloud or run on prem. Cloudflare at least accurately reflects the incident on their status page. Often dashboards will show everything green despite the service being down. In these moments communication is critical and Cloudflare does it well especially as we all know when it comes to the post mortem. They…

True. It's also nuts that this downtime according to creation of the post -> resolved in comments, was only 27 minutes... I've literally been on standby to get an answer what happened with a huge cloud provider for 3 weeks now and today they got back with static assets that weren't reachable ( ico's ???) They don't even know what happened since it's not logged in their logging, since it's using middleware and because…

> The only time we had a downtime with cloudflare, they gave a detailed description and it was related to our cloud provider and not Cloudflare

Hah. Cloudflare's rise to fame was them proudly announcing how their servers were running but the users misconfigured their site, by "defacing" the users' non-resonse.

Re: Cloudflare API, dashboard, tunnels down

#83

Earlier quoted context omitted.

Ok, and...? (Edit: Not to be snarky, but really, so what if that happens? Same thing happens if there's a power outage in your neighborhood. Is it a big deal?)

Are power outages even a thing? My PC at home (germany) is always on, so I'd notice, and I'm involved with energy at our data center (Frankfurt, Germany) and home and external data center had no outage for the last 20 years, at a minimum.

Yes, rural communities exist.

Re: Cloudflare API, dashboard, tunnels down

#84

Earlier quoted context omitted.

I'd appreciate if you'd elaborate on that. (Edit: I see you elaborated somewhat in another comment posted before I finished this comment) I tend to think centralization is more about people's tendencies than it is internet design. As I see it, centralization on the internet happens as the emergent behavior of all of the elements in the system and the forces that exist. In other words, it's the natural result of incen…

True; but let's imagine everyone self-hosted. Perfectly decentralized. As I edited another comment to reflect, imagine if you took out just three companies. Level 3 Communications / Lumen; AT&T; Verizon Enterprise. With those three, you've knocked 2.35 million km, or 1.46 million miles, of fiber optic offline. That's over half of the US backbone in those three companies. Comcast "only" has 0.15 million miles for the…

I don't think this is more centralized, because it requires taking out multiple companies services. To take down three of these networking companies at once is something we've never actually seen, and that's the level needed to be comparable to a CloudFlare failure.

Re: Cloudflare API, dashboard, tunnels down

#85

Earlier quoted context omitted.

Ok, and...? (Edit: Not to be snarky, but really, so what if that happens? Same thing happens if there's a power outage in your neighborhood. Is it a big deal?)

Are power outages even a thing? My PC at home (germany) is always on, so I'd notice, and I'm involved with energy at our data center (Frankfurt, Germany) and home and external data center had no outage for the last 20 years, at a minimum.

Germany has an average of 30 minutes of downtime per person per year, Amerika seems to be around 8 hours

Could not find data how this is distributed..

Re: Cloudflare API, dashboard, tunnels down

#86
post #81

Earlier quoted context omitted.

True. It's also nuts that this downtime according to creation of the post -> resolved in comments, was only 27 minutes... I've literally been on standby to get an answer what happened with a huge cloud provider for 3 weeks now and today they got back with static assets that weren't reachable ( ico's ???) They don't even know what happened since it's not logged in their logging, since it's using middleware and because…

> was only 27 minutes... I was affected by the tunnel outage. It was down for closer to 3 hours, not 27 minutes. (Their status page does accurately reflect this time)

Okay, thanks for the correction! Didn't knew that.

I checked the author post. Normally it's pretty quick to post here as soon as something is "noticed".

Re: Cloudflare API, dashboard, tunnels down

#87

Earlier quoted context omitted.

True. It's also nuts that this downtime according to creation of the post -> resolved in comments, was only 27 minutes... I've literally been on standby to get an answer what happened with a huge cloud provider for 3 weeks now and today they got back with static assets that weren't reachable ( ico's ???) They don't even know what happened since it's not logged in their logging, since it's using middleware and because…

> The only time we had a downtime with cloudflare, they gave a detailed description and it was related to our cloud provider and not Cloudflare Hah. Cloudflare's rise to fame was them proudly announcing how their servers were running but the users misconfigured their site, by "defacing" the users' non-resonse.

?

Cloudflare detects downtime of the underlying cloud/host.

You'll literally see a cloudflare error page and think it would be related to them, while it's actually the underlying provider.

Re: Cloudflare API, dashboard, tunnels down

#88
post #28

Earlier quoted context omitted.

What's the impact for most sites if they go down a few times a year due to AWS/CloudFlare?

Whats the impact if the entire internet is down for a couple of hours? What if its more than a few hours because theres a natural monopoly and a dearth of capable people to run systems independently - thus no strong external incentive for rapid response outside of punitive SLAs? How much soft power do you think such an entity would have on the world stage.

> Whats the impact if the entire internet is down for a couple of hours?

Okay, so obviously a lot of "important" stuff happens via the Internet. You could come up with some financial impact if the Internet went down for some time.

Harder to measure: A lot of people would be inconvenienced or suffer. Some number of people would die indirectly, e.g. due to emergencies/lack of communication.

People are inconvenienced and suffer and die all of the time. It's part of life.

I'm not advocating for more death and suffering, but I am saying that, as another comment said, "life goes on".

---

Put another way, if the Internet disappeared for a week, month, year, what would happen? It'd suck and we'd adjust, but we (humanity as a whole) would be fine.

Re: Cloudflare API, dashboard, tunnels down

#90
post #77
post #50

Earlier quoted context omitted.

I think the solution here isn’t “don’t use Cloudflare” … IMO if you need high availability and can’t tolerate downtime, then deploy and split load between 2 or more providers (e.g. Cloudflare, Fastly) and 2 or more clouds. The centralization around AWS and GCP and Azure is more concerning to me than the centralization around Cloudflare. It’s not obvious to me why lots of people using Cloudflare is any worse than lots…

>then deploy and split load between 2 or more providers (e.g. Cloudflare, Fastly) How does this work when most edge providers manage your DNS to point at the available servers they have? Also, if you "HAVE" to be online, then you're the type of target that's at big risk of DDOS which complicates this even further.

Usually each one will give you a CBAME, your DNS or Cedexic decides, sometimes per client. It's a pretty common setup although can complicate config changes and taking advantage of new features.
Post reply on HN