Packets or frames? The report mentions both (including "packet frames", which, ugh)
CenturyLink 911 outage was caused by a single network card sending bad packets
51–60 of 166 posts
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#52Someone was displeased - https://fuckingcenturylink.com/ I'd love to see an in-depth technical analysis of the outage.
This is probably the same guy from fuckinglevel3.com. We used level3 for years and sent each other that link almost daily. I guess he had to update after CL bought them :] Don't expect a technical report from CL/L3. We had 60+ mpls/vpls circuits from them and all our reports were very high level. Source: am neteng
“Probably”? Fuckinglevel3.com redirects to fuckingcenturylink.com right now.
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#53I once took down an entire network with a Dev node running a misconfigured DHCP server. Second time with a snmp v2 ddos.
If your network isn't properly configured these things can happen easily.
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#54Earlier quoted context omitted.
centurylink fiber is pretty great as well
Yeah, my experience with Clink's fiber offerings has been a good one. It's definitely "Gigabit" — there are many fiber splitters in play, which means (a) your downstream traffic is broadcast to everyone on the same splitter network in plaintext and filtered at individual ISP-owned termination devices, much like cable networks, and (b) you definitely never reach 1000 Mbps down, but often can reach 900 Mbps up. Typical…
Hi, I'm on centurylink's fiber offering and have the same experience as you getting much faster upload than download (though download speed increases quite a bit during sleeping hours). Are you saying this is because the DL is congested during the day hours? Or is there some other technological block in play?
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#55They’re now filtering bad packets so this can’t happen again. No mention of fixing the design flaw in the system that allows a single piece of malfunctioning hardware to knock out 911 service for millions of users for two days .
Worth giving some credit though - mitigation is important for something as critical as 911 service. Hopefully they're also tracking the design flaws, and yes that's worth following (and asking whether they're planning to do so?), but bear in mind people have limited time and resources, so don't be too hard on them (or they'll be less willing to help and investigate in future).
I completely disagree. Mitigation with a patch applied in a few hours is acceptable, but mitigation DAYS after a multi-day outage of critical services that have life or death consequences is completely unacceptable.
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#56They’re now filtering bad packets so this can’t happen again. No mention of fixing the design flaw in the system that allows a single piece of malfunctioning hardware to knock out 911 service for millions of users for two days .
I don't have any inside info. But it sounds like either a control plane or a mesh/fabric board that was messing with all the other such boards in their system.
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#57Earlier quoted context omitted.
If cut-through is enabled in the switch, it won't even drop on bad checksum, since by the time the switch can tell the checksum is wrong, it has already forwarded the entire packet.
It is really unfortunate that the checksum is on the opposite end of the frame from the routing information on Ethernet frames.
Why? If it was at the start it’d remain useless until the whole frame was received anyway.
Makes sense to have it at the end.
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#58Packets or frames? The report mentions both (including "packet frames", which, ugh)
These terms are interchangeable. Although typically one or other is used when speaking about a specific technology.
Also see datagram, cell and probably others I’m forgetting right now.
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#59Earlier quoted context omitted.
At least in my area Century Link business is the only isp I can get at my house that doesnt come with a data cap. Both CenturyLink home and our cable provider have data caps that are enforced. And working from home along with Netflix and YouTube blow me through the 80gb limit every month. Causing me to have to raise my plan. And I’m not paying $200 a month for unlimited bandwidth.
Your cable options have an 80gb limit?! WTF!! Comcast has data caps (which is stupid) but it's 1TB and I think my 7 person household has only passed the halfway mark once, so it's meh. But 80GB?! That's insane! Destiny 2 is an 80GB download itself.
I don't know if it's widespread but at least here in WA you can pay Comcast an extra $50/month and they'll remove the data cap.
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#60Earlier quoted context omitted.
This is probably the same guy from fuckinglevel3.com. We used level3 for years and sent each other that link almost daily. I guess he had to update after CL bought them :] Don't expect a technical report from CL/L3. We had 60+ mpls/vpls circuits from them and all our reports were very high level. Source: am neteng
“Probably”? Fuckinglevel3.com redirects to fuckingcenturylink.com right now.
I didn't bother checking. Thanks internet gumshoe