Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Route Leak Impacting Cloudflare

cloudflarestatus.com

Post reply on HN
Print view View original

71–80 of 164 posts

Re: Route Leak Impacting Cloudflare

#71

Post by nikisweeting »

filistar wrote: post #35

Does anyone know which global sites were unavailable because of Cloudflare crash?

You're not going to be able to get a solid list, this is a different category of problem than something like CloudBleed, and even then the list wasn't solid. This issue is affecting AWS, Cloudflare, Cloudflare DNS, Google DNS, and the tens of thousands of other services that depend on them, but it's region specific and will break different things for different users as the leak propagates.

Re: Route Leak Impacting Cloudflare

#72

Post by spdionis »

lesmond wrote: post #55
jgrahamc wrote: post #9

This appears to be a routing problem. All our systems are running normally but traffic isn't getting to us for a portion of our domains. 1128 UTC update Looks like we're dealing with a route leak and we're talking directly with the leaker and Level3 at the moment. 1131 UTC update Just to be clear this isn't affecting all our traffic or all our domains or all countries. A portion of traffic isn't hitting Cloudflare. L…

I guess we are in that 3% then! But 50% of our traffic has gone! Hopefully you are still working on it!

We're also seeing 60%+ of our traffic missing. It intermittently comes back up.

Re: Route Leak Impacting Cloudflare

#74

Post by awinder »

lordelph wrote: post #69

We've been evaluating Cloudflare mainly for doing failovers faster than DNS. This morning I ran some tests to generate graphs to show the typical delay incurred in preparation for a show-and-tell with some key people. I started seeing delays of up to 300 seconds! At best there was a 1 second delay. I wondered if I was going to have present "Why we've decided not to go with Cloudflare!" Any longtime Cloudflare users c…

I had to switch off 1.1.1.1 for the first time because of this, can’t speak to their enterprise stuff but if dns resolver is a good test this is the first event I’ve hit since launch

Re: Route Leak Impacting Cloudflare

#76

Post by shdon »

lordelph wrote: post #69

We've been evaluating Cloudflare mainly for doing failovers faster than DNS. This morning I ran some tests to generate graphs to show the typical delay incurred in preparation for a show-and-tell with some key people. I started seeing delays of up to 300 seconds! At best there was a 1 second delay. I wondered if I was going to have present "Why we've decided not to go with Cloudflare!" Any longtime Cloudflare users c…

Things like this are not unique to CF and actually originate from outside their network. It does happen every once in a while, but I have far more confidence in CF's ability to resolve it than my own. They have the clout in the industry, the connections and the expertise to deal with this kind of thing. I've been with CF since late 2011 and am quite satisfied with their services.

Re: Route Leak Impacting Cloudflare

#77

Post by imglorp »

ryanworl wrote: post #65
jgrahamc wrote: post #56

Earlier quoted context omitted.

We're definitely still working on it. Sorry you're affected by this. We're talking with the network providers involved. If anyone from the Verizon NOC is online... call me!

I've had FiOS issues in PA since around 6:30AM impacting a decent fraction of sites. YouTube was down for about 5 minutes. Slack still very flaky. A client who hosts a 5-figure number of domains on Cloudflare still unavailable to me, but the pagers didn't start going off so presumably it is isolated. Thanks for all the updates.

Another PA Fios user, same here. 8.8.8.8 is mostly ok, 1.1.1.1, intermittent high latency in general, cloudflarestatus.com not loading.

Re: Route Leak Impacting Cloudflare

#78

Post by shacharz »

Hi Shachar from Peer5 here, we're operating a MultiCDN. Cloudflare is actually one of the best performing CDNs. All CDNs encounter issues small to big - that's why using multiple providers and intelligently routing between them is critical for high resilience.

Re: Route Leak Impacting Cloudflare

#80

Post by q3k »

jgrahamc wrote: post #66
emilstahl wrote: post #59

“AS396531 "Allegheny Technologies Incorporated" is leaking a better-reachable route for AS13335 "Cloudflare, Inc." towards AS701 "Verizon Business/UUnet" explaining the current LSE going on.” https://twitter.com/OhNoItsFusl/status/1143117619106652160

They aren't the original leaker. Update: sorry, I may have been wrong. Hard to see clearly in the fog of BGP.

Can you elaborate?
Post reply on HN