Live data from Hacker News

Millions of customers in Australia hit by mobile phone and internet outage

abc.net.au

41–46 of 46 posts

Re: Millions of customers in Australia hit by mobile phone and internet outage

#41
post #23

Earlier quoted context omitted.

I worked for a large Telco (not Optus) and was constantly shocked by how little the management knew about anything. They hired a new Director of "Core Network", and in her first all-hands meeting she loudly asked what IPV6 was. (serious, she had never heard of it). The Director of IT had me setup her home wifi because she had no idea what DHCP was. The VP of "IT/Internet" literally had other people make her Powerpoin…

Technical people have a blind spot where they think technical competence and expertise is what helps someone up the food chain. The truth is it’s who you know not what you know. Especially in these larger types of companies.

> Technical people have a blind spot where they think technical competence and expertise is what helps someone up the food chain. The truth is it’s who you know not what you know. Especially in these larger types of companies.

100% spot on, I couldn't agree more. That was the biggest thing I learned during my time there. It was painful at times, but a very important lesson to learn.

Re: Millions of customers in Australia hit by mobile phone and internet outage

#42
post #39

Earlier quoted context omitted.

Technical people have a blind spot where they think technical competence and expertise is what helps someone up the food chain. The truth is it’s who you know not what you know. Especially in these larger types of companies.

> they think technical competence and expertise is what helps someone up the food chain. The truth is it’s who you know not what you know. Well, technical competence and expertise does not necessarily translate to managerial competence and expertise. It's two distinct skill sets. Getting machines to work is very different than getting people to work.

> Well, technical competence and expertise does not necessarily translate to managerial competence and expertise.

This can't be overstated. The best engineer could be the worst manager.

That said, managers should have at least some level of technical knowledge on what they're managing. I'm a security engineer that once worked under a CISO who had very little technical knowledge and it showed. Having to explain things to him multiple times got frustrating. We're talking on the level of "Hey, our nmap scans are showing we have port 443 open on our web app. We should have all ports closed." and then trying to explain why that would make our web app completely inaccessible.

Re: Millions of customers in Australia hit by mobile phone and internet outage

#43
post #23

Earlier quoted context omitted.

I worked for a large Telco (not Optus) and was constantly shocked by how little the management knew about anything. They hired a new Director of "Core Network", and in her first all-hands meeting she loudly asked what IPV6 was. (serious, she had never heard of it). The Director of IT had me setup her home wifi because she had no idea what DHCP was. The VP of "IT/Internet" literally had other people make her Powerpoin…

Technical people have a blind spot where they think technical competence and expertise is what helps someone up the food chain. The truth is it’s who you know not what you know. Especially in these larger types of companies.

> Technical people have a blind spot where they think technical competence and expertise is what helps someone up the food chain.

Being a technical person myself, and working in a small company most of my life I was blissfully unaware and then shocked. I guess it's true that closeted existence did leave me blind. But I don't think that is a consequence of being technical or an engineer - it was just because the smaller companies I preferred to work for would go broke if they made dumb decisions or failed to learn. The shock came from the small company I worked for being taken over by a huge, word wide company. And then watching that huge company roll over all their internet links to Optus.

All technical people get to know what it's like to deal with the big two telco's in Australia. They all eventually figure out the smaller ones provide much better service and a sharper price, and then avoid the big ones like the plague. So we knew what would happen when we went to Optus, and it panned out pretty much as expected. That's perhaps an exaggeration, as them leaking most of their customer credentials onto the internet wasn't "expected", but then level of engineering incompetence that lead to the leak wasn't a surprise either.

What was a shock was seeing first hand how Optus won the business. All the rules that engineers live by, like basing decisions on empirical data, "trust but verify" and so on weren't part of it. Instead it was smooth talking salesman, mandatorily weekly meetings with implementation teams who contribution seemed to be to presenting spreadsheets proclaiming how much progress that had made, paid trips to holiday destinations for upper managers and cases of wine being sent to lower managers. Later came the lies, and when we called out the lies and dug up older versions of spreadsheets to prove things weren't going a planned white anting. The white anting worked - we were threatened with dismissal.

Those tactics only work for so long of course, and eventually the exec's that threatened us with dismissal ordered us to get rid of Optus, at any cost. Fawning turned into literal hatred. They could away such displays of corporate disloyalty only because by that time all the managers who championed the charge to Optus had gone.

But despite that experience, they moved to Telstra. Telstra is the other large telco in Australia, and is just as bad. I had left by then, but I assume the decision was made by a new cohort of managers who will also be gone in a few years.

At this point I'm no longer blind, just flummoxed.

Re: Millions of customers in Australia hit by mobile phone and internet outage

#44
post #32

Earlier quoted context omitted.

Many phones support a second line with an SIM/eSIM setup. As most people still use a SIM in Australia, I wonder if having a second line with an eSIM on a very basic pre-paid plan would work for those people. In theory, you could have line 1 forward to line 2 when 'unreached'. Of course you'd want the second line to be different network.

As far as I know you only get and eSIM with a full on plan with the 3 big telcos. So all prepaid users can't get an eSIM

That's true, even Telstra was slow getting to it (was only available for prepaid services for a long while). I think Aussie telcos need a bit of kick to really go in on eSIM, such as Apple releasing eSIM only iPhone's in the USA. You can't even get a add-on SIM for an Apple/Android Smartwatch from anyone except the big three here still.

It would be good to have regulation surrounding eSIM, because telcos will always find a way to make it awful. E.g. able to do 24x7, max 1hr processing time, no cost to user, able to do via self-service options.

Re: Millions of customers in Australia hit by mobile phone and internet outage

#45

From an interview with ABC (Australian public broadcaster/news network) with the Optus CEO --- ABC: Can you tell us why the system's gone down? Optus CEO: Unfortunately, I don't have more information to give at this stage. We have had issues since 4am. The team has tried a number of parts of restoration and so far we have not had the results that we have hoped for. And we're pursuing every avenue to get everybody bac…

Optus was down in most of Sydney for over 10 hours. Some country/outlying areas were back online a little before then. In response to hours of silence from Optus executives (in that they weren't able to string two words together about the technical issues or the source of the fault) one caller to ABC Local Radio in Sydney asked whether the fault was in Australia or in Singapore which was an excellent question as Optu…

Addendum. Well, as predicted, the Government announced it's holding an inquiry into Optus. That's less than 24 hours after the event and has to be a speed record for Govt. Such speed gives a good indication of how big this kerfuffle was and how bad the public's perception of Optus and Govt. is for allowing the failure to happen. The questions everyone is asking is why wasn't there a backup plan and why did the emergency phone numbers also fail as they are supposed to be protected (isolated) when such outages happen.

Many are saying Govt. is largely at fault and asleep at the wheel for not keeping stricter tabs on these telcos.

Given there are three major networks in Australia and a few minor ones and that only Optus went down the level of disruption was alarming. Essentially, much of the country was in turmoil for better part of a day.

If a comparatively small outage can cause such disruption to a country then just imagine the chaos that'll follow when the next Carrington Event hits us.

Re: Millions of customers in Australia hit by mobile phone and internet outage

#46
post #32

Earlier quoted context omitted.

Many phones support a second line with an SIM/eSIM setup. As most people still use a SIM in Australia, I wonder if having a second line with an eSIM on a very basic pre-paid plan would work for those people. In theory, you could have line 1 forward to line 2 when 'unreached'. Of course you'd want the second line to be different network.

As far as I know you only get and eSIM with a full on plan with the 3 big telcos. So all prepaid users can't get an eSIM

I have a Telstra prepaid esim.
Post reply on HN