Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Verizon outages reported across U.S.

firstcoastnews.com

Post reply on HN
Print view View original

141–150 of 193 posts

Re: Verizon outages reported across U.S.

#141

Post by mmooss »

schmuckonwheels wrote: post #60
mikeweiss wrote: post #50

For those who weren't aware: Verizon got a new CEO late last year and laid off 15% of the workforce (15,000 people). This included people working in network, IT and cyber security.

Is there a substantive connection? Like all the doom and gloom after the Twitter layoffs predicting the site would implode and go permanently offline "within a month" which...never happened. It's also ironic in the sense it implies the indignant people were so bad at their jobs they designed and built a system so fragile it would collapse without constant intervention from thousands of individuals. You do realize it'…

> the doom and gloom after the Twitter layoffs predicting the site would implode and go permanently offline "within a month" which...never happened.

Many think Twitter has imploded, though it's online.

> You do realize it's possible for an organization to be overstaffed?

It's possible to be understaffed or appropriately staffed. Anything is possible!

Re: Verizon outages reported across U.S.

#142

Post by mmooss »

drnick1 wrote: post #131
johnfn wrote: post #78

Earlier quoted context omitted.

This is really taking the whole "I could build Dropbox in a weekend" style comments to a new level.

It's well known that big tech companies are overstaffed. You probably can't build Dropbox in a weekend starting from scratch, but a smaller scale cloud-based storage solution can be deployed very quickly if you start from existing open source components. And a small team of experienced web devs can certainly build a cloud storage thing in a matter of weeks from scratch too.

> It's well known that big tech companies are overstaffed.

To who? What evidence is there either way?

Is it an often-repeated story online? That sort of information is both well known and unreliable - it's well-known misinformation.

Re: Verizon outages reported across U.S.

#144

Post by charonn0 »

SoftTalker wrote: post #134
syntaxing wrote: post #25

Earlier quoted context omitted.

I’m somewhat surprised you’re still using your ISP’s DNS when there’s ton of better free or paid options.

Comcast doesn't let you change your DNS unless you run your own router. And they also rate limit you if you do.

Pretty sure you can do it at the individual device level, in the OS's network settings.

Re: Verizon outages reported across U.S.

#145

Post by observationist »

_nickwhite wrote: post #123

It's also weird that some people here in the office on Verizon work fine, and others are on SOS. No correlation between phone versions or hardware that I could deduce. I also see the same on X: https://x.com/CPTholen/status/2011520566159982758 It came up for around 5-10 minutes at 15:00 EST, but is currently still down.

If they're on different phones, they could be on different bands, different towers, and different paths, one or more of which could be impacted by whatever the underlying problem is. iPhone vs Android would be the most blatant tell that something like this is at fault, but it could also be different configurations from different stores causing them to interact with the cellular network in different ways.

Something like a routing configuration, BGP failure, or underlying network misconfiguration would cause seemingly bizarre results with some phones working and some not with no obvious correlation. Compare Access Point Names under Mobile Settings on android, and whatever the equivalent is on iPhones, and check things like whether 5G allowed and data roaming is enabled.

If it's a cyber attack of some sort, then there's all sorts of different attack vectors that would cause these outcomes.

Re: Verizon outages reported across U.S.

#146

Post by mmooss »

_nickwhite wrote: post #29

At 2:14PM EST, Verizon said: "Verizon engineering teams are continuing to address today's service interruptions. Our teams remain fully deployed and are focused on the issue. We understand the impact this has on your day and remain committed to resolving this as quickly as possible." As someone responsible my whole career for uptime and network response, I really feel for the engineers, at the same time hoping my ser…

No ETA yet, not even an underpromised one.

Re: Verizon outages reported across U.S.

#147

Post by zamalek »

Meekro wrote: post #133
apitman wrote: post #110

I got sniped away from Visible (Verizon MVNO) by US Mobile (multi-carrier MVNO) during a Black Friday sale. USM has an interesting thing where you can actually get a separate eSIM for each of the major carriers, and switch between them. I was curious so I signed up for all 3. It's been interesting to see how the signals vary from location to location, and at least a couple times I've been able to get significantly be…

I'm considering switching to US Mobile from Verizon-- it seems way cheaper, and you can still use the Verizon network. Any downsides I should know?

I started mid last year and haven't run into any problems. Haven't needed to switch off of Dark Star yet.

I was previously on Google Fi, and MVNO roaming is bloody fantastic - I always had reception.

Re: Verizon outages reported across U.S.

#148

Post by montjoy »

schmuckonwheels wrote: post #104
happytoexplain wrote: post #74

Earlier quoted context omitted.

This is unrealistic and seems to be biased by some kind of broad un-focused hostility. Yes, maybe they were overstaffed. But it's reasonable to suspect that leadership overcut, given the current climate and the number being 15,000. Your characterization of Twitter predictions relies on cherry-picking and ignores the actual impacts, and there's no evidence that the system goes down without "constant" intervention from…

>Your tone also implies that large, complex systems, even if designed well, don't normally require a lot of maintenance from many people. That's correct. In the case of Twitter, it was disclosed that many of their systems were running out of date EOL software, to the point of being a security liability, which raises the question: if the systems weren't being maintained, wtf were all those people doing? Taste-testing…

> many of their systems were running out of date EOL software, to the point of being a security liability

This is more likely a management problem rather than a staffing problem. Lower level management knows about these kind of things but often they are not incentivized to make them a priority due to a culture focused on growth and “winning”.

Re: Verizon outages reported across U.S.

#149

Post by syntaxing »

noAnswer wrote: post #138
syntaxing wrote: post #109

Earlier quoted context omitted.

That’s really weird that’s the case. DNS simply resolves “google.com” to an IP address (8.8.8.8 or something). Shouldn’t impact anything download related. I’m pretty sure DNS isn’t used for geolocating either

I wanted to correct you but than I stopped myself because I'm not sure if you meant that sarcastically. Because with a /s at the end your post makes sense.

Nope, not sarcastic. Would love to know where my understanding is incorrect!

Re: Verizon outages reported across U.S.

#150

Post by SoleilAbsolu »

IncandescentGas wrote: post #72
Nextgrid wrote: post #70

Earlier quoted context omitted.

If you’ve got 100k people to run something that should run essentially on autopilot, you’ve got much deeper problems where merely laying off selected chunks of people will no longer help. The whole company is rotten and the only way is to start from scratch and not make the mistakes that led you to accumulate 100k people. I can't even begin to imagine what those 100k people actually do. For starters, none of the telc…

Telco infra runs on autopilot?

Erlang fault-tolerance FTW! ;-)
Post reply on HN