Live data from Hacker News

Cellular outage in U.S. hits AT&T, T-Mobile and Verizon users

cnbc.com

241–250 of 486 posts

Re: Cellular outage in U.S. hits AT&T, T-Mobile and Verizon users

#241
post #176

Using myATT app doesn't even show my wireless account anymore. My entire family account doesn't even show up as a service. Seems like a hack or internal issue that deleted accounts? Can others confirm whether they see their accounts?

Their outage status page is also completely broken. Doesn't show anything.

[deleted]

Re: Cellular outage in U.S. hits AT&T, T-Mobile and Verizon users

#243

To everyone trying to speculate on the root cause, I haven't seen enough information in any of the comments to really draw any conclusions. Having worked on several nationwide cellular issues in Canada when I worked in telecom, we saw nationwide impacts based on any number of causes. - A new route injected in the network caused the routing engines on a type of cellular specific equipment to crash nationwide. This too…

The speculation is fascinating. For most people, their guess is a reflection of themselves. Is there a term for that? This is a gross generalization, but I've seen... - Science people guessing solar flares - My "right-wing friend" guessed international hackers - I, myself, guessed it was a botched software release - Someone in this post commented their military friend says get gas And yet, like everyone else, I genui…

My speculation is: “Higher-ups kept demanding that technicians ‘do more with less’ in order to deliver on quarterly metrics and now we’re finally seeing the cumulative result of employees being stretched thin, underpaid, and overworked.”

You are welcome to infer as to why I’m thinking this way!

Re: Cellular outage in U.S. hits AT&T, T-Mobile and Verizon users

#244

I wonder if this extends to the Public Safety part of AT&T - FirstNet.

It does. I was the on call support technician for a public safety answering point (PSAP-- aka a 911 center) this morning. At 04:14 Eastern today I received a call that the law enforcement and fire mobile units on FirstNet all disconnected from the VPN. The AT&T land lines (CAMA trunks provided by the ILEC Frontier) that handle the 911 service did not fail. Only mobile service failed.

Yeah I have had to make that call myself many times in the past. Never with FirstNet but definitely with AT&T and Verizon. It would be awesome if the carriers could put out a reliable announcement to the affected accounts that there is an outage - it would definitely simplify the pre-support call triage an 1AM.

Re: Cellular outage in U.S. hits AT&T, T-Mobile and Verizon users

#245

This reminds me of the recent discussion on status pages. https://news.ycombinator.com/item?id=39099980 They need to be accurate. At&t status claims everything is fine. My wireless service is down. Down detector has tens of thousands of reports, so clearly everything is not fine.

> They need to be accurate

It would be nice if the FTC mandated this. It is exhausting when the status page is taken over by the marketing department (the infamous green check with the little "i").

Re: Cellular outage in U.S. hits AT&T, T-Mobile and Verizon users

#246
post #181

Earlier quoted context omitted.

Having bars doesn't necessarily mean calls can be made or received. Mine keeps fluctuating between 0 and 5 bars but wherever I try to make a call, it claims I'm not registered with my current carrier, which uses AT&T as its backbone.

That's something I've noticed in general with 5G - basically five bars means you've got a good connection to the tower, but you could have bad service due to a bottleneck upstream of that. (At least for data - for voice that might be more negligible.)

That’s been an issue for a lot longer than that, at least in dense metro areas. Even back in the 3G days I’d have 5 bars and no data due to tower congestion.

Re: Cellular outage in U.S. hits AT&T, T-Mobile and Verizon users

#247

Earlier quoted context omitted.

> Also fun where the towers remained just powered on enough for phones to stick to them but not be able to do anything, so 9-1-1 calls would just fail, instead of failing-over to other networks. Seems like a deficiency in the GSM spec (or Rogers SIM programming?) that I don’t think was actioned on. Actually, I think this is going to change after the Rogers outage, it's just slowly happening behind the scenes so it's…

> I do think implementations are changing a bit around this, mostly in the phones so that they give up and go into a network scan if the emergency call is failing It seems like this is a global problem, since all Rogers-subscribed devices in a Rogers reception area couldn’t make 9-1-1 calls. But could be a SIM coding issue and not afflict other providers elsewhere. I just always imagined the GSM spec was so resilient…

> I just always imagined the GSM spec was so resilient that you could always make a 9-1-1 call if a working network was available but this outage proved that wrong. Surprising to learn in 2022.

The X is broken but claims it isn't stops failover pattern is strong all over networking. It's not unusual to see it in telco root cause analysis.

Re: Cellular outage in U.S. hits AT&T, T-Mobile and Verizon users

#248

This is affecting roughly 0.02% of the US population; is it really that bad?

What percentage of the population would need to be impacted before a tech failure is relevant on a technical news site?

Seven. Exactly 7%

Re: Cellular outage in U.S. hits AT&T, T-Mobile and Verizon users

#249

Earlier quoted context omitted.

The speculation is fascinating. For most people, their guess is a reflection of themselves. Is there a term for that? This is a gross generalization, but I've seen... - Science people guessing solar flares - My "right-wing friend" guessed international hackers - I, myself, guessed it was a botched software release - Someone in this post commented their military friend says get gas And yet, like everyone else, I genui…

> Someone in this post commented their military friend says get gas The Rogers outage in Canada took out the nationwide debit card payment network because that infra depended on Rogers. Credit cards still worked, but depends on your station’s access to make the transaction. And no shortage of shops running their POS “in the cloud” and needing to close if they lose internet access. I actually did have to lend cash to…

PoS devices are usually networked. If you don't validate transactions in realtime you would later validate in batch, but that has more risk than validating at the time of transaction.

Re: Cellular outage in U.S. hits AT&T, T-Mobile and Verizon users

#250

To everyone trying to speculate on the root cause, I haven't seen enough information in any of the comments to really draw any conclusions. Having worked on several nationwide cellular issues in Canada when I worked in telecom, we saw nationwide impacts based on any number of causes. - A new route injected in the network caused the routing engines on a type of cellular specific equipment to crash nationwide. This too…

The speculation is fascinating. For most people, their guess is a reflection of themselves. Is there a term for that? This is a gross generalization, but I've seen... - Science people guessing solar flares - My "right-wing friend" guessed international hackers - I, myself, guessed it was a botched software release - Someone in this post commented their military friend says get gas And yet, like everyone else, I genui…

> And yet, like everyone else, I genuinely feel that I'm probably right

This is the thing with black swan events. The more pedestrian explanations are almost always true, but then there's a tiny fraction of the time where you're much, much better off having taken a bit of an alarmist view.

Post reply on HN