Live data from Hacker News

Route Leak Impacting Cloudflare

cloudflarestatus.com

41–50 of 164 posts

Re: Route Leak Impacting Cloudflare

#41

Earlier quoted context omitted.

Thanks for the updates. I wish I could get this information somewhere other than hacker news though. :(

We use downdetector.com because status pages tend to take up to an hour or so to update, if they ever do.

1042 UTC First alert of global traffic problem 1057 UTC Internal group chat room up and running 1102 UTC Status page updated

So, first alert to status page was 20 minutes.

Re: Route Leak Impacting Cloudflare

#42

Earlier quoted context omitted.

Thanks for the updates. I wish I could get this information somewhere other than hacker news though. :(

The team is updating the status page but not with granular detail because they'd have to spend time discussing what to say. I'm giving you the blow by blow.

HN, the place to be if you’re anything in the tech community.

Re: Route Leak Impacting Cloudflare

#43
It’s definitely all countries, just for a specific range of anycast IPs.

Our CloudFlare stuff isn’t even pingable. Sometimes it’ll return an echo from a far away DC.

It’s been like this for over an hour now and your status page doesn’t even acknowledge it apart from “Network performance issues”.

Re: Route Leak Impacting Cloudflare

#44

It’s definitely all countries, just for a specific range of anycast IPs. Our CloudFlare stuff isn’t even pingable. Sometimes it’ll return an echo from a far away DC. It’s been like this for over an hour now and your status page doesn’t even acknowledge it apart from “Network performance issues”.

It was updated a few minutes ago confirming that it's a route leak.

Re: Route Leak Impacting Cloudflare

#46

Earlier quoted context omitted.

BGP route/prefix leaks. BGP is the protocol that deals with routing across the various internet backbones (known in the protocol as "autonomous systems", identified by an AS number). On that protocol, the various systems broadcast what prefixes they can route, which then affects the rest of the networks' routing decisions. By error or malice, a system can report a prefix they cannot or should not route, causing other…

At 3-4 major leaks per year it seems like we should probably fix BGP one of these days...

The way I understand it it's not BGP, it's mostly human error, or malicious intent.

The protocol is fine.

Re: Route Leak Impacting Cloudflare

#47

Earlier quoted context omitted.

BGP route/prefix leaks. BGP is the protocol that deals with routing across the various internet backbones (known in the protocol as "autonomous systems", identified by an AS number). On that protocol, the various systems broadcast what prefixes they can route, which then affects the rest of the networks' routing decisions. By error or malice, a system can report a prefix they cannot or should not route, causing other…

At 3-4 major leaks per year it seems like we should probably fix BGP one of these days...

We'll get right on that after everyone has IPv6 deployed.

Re: Route Leak Impacting Cloudflare

#49
post #9

This appears to be a routing problem. All our systems are running normally but traffic isn't getting to us for a portion of our domains. 1128 UTC update Looks like we're dealing with a route leak and we're talking directly with the leaker and Level3 at the moment. 1131 UTC update Just to be clear this isn't affecting all our traffic or all our domains or all countries. A portion of traffic isn't hitting Cloudflare. L…

Thanks for the updates. I wish I could get this information somewhere other than hacker news though. :(

I’m cross posting to NANOG

Re: Route Leak Impacting Cloudflare

#50

It’s definitely all countries, just for a specific range of anycast IPs. Our CloudFlare stuff isn’t even pingable. Sometimes it’ll return an echo from a far away DC. It’s been like this for over an hour now and your status page doesn’t even acknowledge it apart from “Network performance issues”.

It was updated a few minutes ago confirming that it's a route leak.

Yeah but they just wasted an hour of everyone’s lives trying to figure out WTF was going on at 3:34am.

(The average CF user has no idea what a route leak is, tbh.)

Post reply on HN