Live data from Hacker News

Rogers network outage across Canada hits banks, businesses and consumers

reuters.com

281–290 of 403 posts

Re: Rogers network outage across Canada hits banks, businesses and consumers

#281
post #7

Looks very similar to Facebook's outage. A combination of BGP and DNS problems that started with a configuration change. https://blog.cloudflare.com/october-2021-facebook-outage/

https://radar.cloudflare.com/asn/812?date_filter=last_24_hou... look at the IPV4 vs IPV6 traffic, when there is IPV4, there is no IPV6 and vice versa. Issues announcing IPV6 BGP prefixes and IPV4 at the same time?

Re: Rogers network outage across Canada hits banks, businesses and consumers

#282

I believe this is a Russian hack. Some group took credit for it. It's an act of war. I'm wary we may not find out for a long time. Debit cards were out, huge swaths of wireless and internet, this was a huge failure.

Do you have a source you could use to convince readers why you believe this? As written, your source is "trust me, bro"

It's my bad, I found the quote - it was about the Canadian outage, but at the bottom they wrote:

"Hours before the Rogers outage began, an apparent cyberattack took down the U.S. Congress website. According to Fox News, the pro-Russia hacking group Killnet took credit for crashing the website around 10 p.m. Thursday evening."

I didn't see the first part, i.e. hackers taking credit for the US Congress attack.

So I don't see anyone actually taking credit for it.

That said - this major attack is happening 1) at the very same moment US Congress is attacked, and, 2) Canada is at this very moment deciding on whether or not to return gas turbines to Russia as part of a maintenance agreement. The Turbines are part of the 'banned goods' but Germany wants the gear to go back to Russia for a key pipeline. Canada announced today they will send the gear to Russia.

So it's hugely speculative, but I'm still inclined to believe this was a hack - it's just too hugely suspicious.

[1] https://theparadise.ng/canada-suffering-massive-nationwide-i...

Re: Rogers network outage across Canada hits banks, businesses and consumers

#284
post #2

I was hoping there would be a discussion of this here with some inside baseball, but then HN was down.

The Cloudflare blog suggests it's BGP problems: https://blog.cloudflare.com/cloudflares-view-of-the-rogers-c...

How does that relate to the Rogers cell service outage, though? Surely SMS doesn't require BGP?

It feels like there's a big, fundamental problem affecting a variety of Rogers infra, where BGP and cell problems are just symptoms we can observe. CloudFlare says it looks more like a failure than an attack; I'm not entirely convinced.

Re: Rogers network outage across Canada hits banks, businesses and consumers

#285

Earlier quoted context omitted.

The Cloudflare blog suggests it's BGP problems: https://blog.cloudflare.com/cloudflares-view-of-the-rogers-c...

this is pretty far outside my area of expertise so maybe i'm missing something, but isn't the cloudflare blog just describing what they're seeing from the perspective of somebody who monitors BGP traffic, rather than assigning the blame to BGP? it seems like the BGP traffic signature of any isp-level outage, regardless of the cause, would look like this. they went down, so they stopped advertising that they could acc…

Yes, exactly. BGP withdrawal is likely a symptom, not the cause.

Re: Rogers network outage across Canada hits banks, businesses and consumers

#286
post #34

In Toronto, here's a small and non-exhaustive list of affected services: - Point of sale machines. Supermarkets are accepting only cash. - ATMs. Several banks are incapable of dispensing cash. - Public transit ticketing systems. The TTC is effectively running for free, today. - Public bicycle rental stations. - Public parking locations. How long before the public realizes that we are not Rogers' customers, but its ho…

Also, the CRTC helpline and Service Canada and CRA account logins. We were unable to access government services.

Re: Rogers network outage across Canada hits banks, businesses and consumers

#287

https://www.cbc.ca/news/business/rogers-outage-cell-mobile-w... "we're getting very close to understanding the root cause of the of the failure. And we're taking actions along with our network vendors to recover the situation." "We don't understand how the different levels of redundancy that we build across the network coast to coast have not worked," he said.

Translate: "We have no idea what's wrong or how to fix it. But we've almost decided who to blame."

Re: Rogers network outage across Canada hits banks, businesses and consumers

#288

The utterly inefficient and overpriced Canadian telecoms exist only because we allow one specific behavior: 1. A new local player comes to town, builds their own infrastructure (e.g. connects one building to fiber) and starts offering competitive service. 2. Rogers/Shaw/Bell/Telus immediately offer better terms for the residents of that building. 3. The competitor runs out of money and leaves. 4. The telecoms revert…

It definitely won't happen in Toronto, seeing as John Tory was, and still is, in bed with Rogers.

https://www.theglobeandmail.com/news/national/john-a-tory-a-...

Re: Rogers network outage across Canada hits banks, businesses and consumers

#289
post #197

Earlier quoted context omitted.

Acknowledge that internet / phone service works much better as a utility and nationalize or highly regulate (i.e. fixed pricing schemes) the telecom companies.

The CRTC does dictate a fixed pricing scheme for mobile phones: https://crtc.gc.ca/eng/phone/mobile/occa.htm Near the bottom it states that those companies are supposed to promote those plans. They didn't the last time I tried looking them up. Regulation is meaningless if there is a lack of enforcement. (Note: I'm not saying that the pricing scheme is particularly good since it leaves the needs of many people unaddre…

I thought I'd dive in and look for these plans, and as expected they're not at all easy to find.

For Telus, I had to go to four different plan/pricing pages before I found a link mentioning that cheaper plans are only available on Koodo (their lower priced brand). And then, the $35 plan is as lousy as they can make it and still comply with the CRTC - 3GB of data at 3G (only 2 generations ago, awesome) speeds, with overage costs of $13/100MB. Just absurdly bad. Or maybe you want something more reasonable, let's cut out that data access, you just want talk and text? That'll save you a whopping $3, at $32/month.

So that's the telecom situation in Canada; the first 3GB cost you $3, the next 3GB cost you $390.

Re: Rogers network outage across Canada hits banks, businesses and consumers

#290
post #287

https://www.cbc.ca/news/business/rogers-outage-cell-mobile-w... "we're getting very close to understanding the root cause of the of the failure. And we're taking actions along with our network vendors to recover the situation." "We don't understand how the different levels of redundancy that we build across the network coast to coast have not worked," he said.

Translate: "We have no idea what's wrong or how to fix it. But we've almost decided who to blame."

Here in BC Rogers came back about 4pm, but went down again around 7pm.
Post reply on HN