Wonder how they found it... I bet that was some unhappy hours looking for it.
CenturyLink 911 outage was caused by a single network card sending bad packets
11–20 of 166 posts
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#12How does a single network card emitting bad packets effect other sites? > investigations into the logs, including packet captures, was occurring in tandem, which ultimately identified a suspected card issue in Denver, CO. Field Operations were dispatched to remove the card. Once removed, it did not appear there had been significant improvement; however, the logs were further scrutinized .. to identify that the source…
Packet storms are real, and they are tricky to troubleshoot. Modern tech has made it less likely to happen, but that just means when it does happen noone suspects it.
Talk about a needle in a hay stack.
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#13How does a single network card emitting bad packets effect other sites? > investigations into the logs, including packet captures, was occurring in tandem, which ultimately identified a suspected card issue in Denver, CO. Field Operations were dispatched to remove the card. Once removed, it did not appear there had been significant improvement; however, the logs were further scrutinized .. to identify that the source…
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#14How does a single network card emitting bad packets effect other sites? > investigations into the logs, including packet captures, was occurring in tandem, which ultimately identified a suspected card issue in Denver, CO. Field Operations were dispatched to remove the card. Once removed, it did not appear there had been significant improvement; however, the logs were further scrutinized .. to identify that the source…
Packet storms are real, and they are tricky to troubleshoot. Modern tech has made it less likely to happen, but that just means when it does happen noone suspects it.
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#15How does a single network card emitting bad packets effect other sites? > investigations into the logs, including packet captures, was occurring in tandem, which ultimately identified a suspected card issue in Denver, CO. Field Operations were dispatched to remove the card. Once removed, it did not appear there had been significant improvement; however, the logs were further scrutinized .. to identify that the source…
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#16Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#17How does a single network card emitting bad packets effect other sites? > investigations into the logs, including packet captures, was occurring in tandem, which ultimately identified a suspected card issue in Denver, CO. Field Operations were dispatched to remove the card. Once removed, it did not appear there had been significant improvement; however, the logs were further scrutinized .. to identify that the source…
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#18Wonder how they found it... I bet that was some unhappy hours looking for it.
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#19https://catless.ncl.ac.uk/risks/9.62.html#subj2 https://catless.ncl.ac.uk/risks/9.63.html#subj3
Re: CenturyLink 911 outage was caused by a single network card sending bad packets
#20Did the network card in question also send blue flashes up into the sky?