Live data from Hacker News

Facebook-owned sites were down

facebook.com

541–550 of 1001 posts

Re: Facebook-owned sites were down

#541

Discord [1] is taking a toll from the increased traffic as well: "We're noticing an elevated level of usage for the time of day and are currently monitoring the performance of our systems. We do not anticipate this resulting in any impact to the service. We have temporarily disabled typing notifications. We expect these to be re-enabled soon." [1] https://discordstatus.com/

Yeah, it seems like a lot of places online are facing the same. Even here has been bad for me

Re: Facebook-owned sites were down

#542

It seems it has caused DNS servers crash for one of biggest Czechia's internet provider - Vodafone. Can be unrelated but I doubt it ( https://twitter.com/BlazejKrajnak/status/1445063232486531099 ). Think of it - half the country doesn't have internet because of this crash, that's terrifying. (Switching DNS servers obviously works but that's not something the general population will do)

All most people have to do now is install an app and it takes care. But messaging need to go from media and news.

Re: Facebook-owned sites were down

#543

Reddit r/Sysadmin user that claims to be on the "Recovery Team" for this ongoing issue: > As many of you know, DNS for FB services has been affected and this is likely a symptom of the actual issue, and that's that BGP peering with Facebook peering routers has gone down, very likely due to a configuration change that went into effect shortly before the outages happened (started roughly 1540 UTC). There are people now…

Also, equally important to note, there was a massive expose on FaceBook yesterday that is reverberating across social media and news networks, and today, when I tried to make a post including the tag #deletefacebook, my post mysteriously could not be published and the page refreshed, mysteriously wiping my post... This is possibly the equivalent of a corporate watergate if you ask me... Just my personal opinion as a…

So what you're saying is facebook... deleted itself?

The singularity is happening. It realized it would end society, so it ended itself.

Re: Facebook-owned sites were down

#544

Reddit r/Sysadmin user that claims to be on the "Recovery Team" for this ongoing issue: > As many of you know, DNS for FB services has been affected and this is likely a symptom of the actual issue, and that's that BGP peering with Facebook peering routers has gone down, very likely due to a configuration change that went into effect shortly before the outages happened (started roughly 1540 UTC). There are people now…

So, does anyone know where to one can buy an LTE gateway with a serial port interface? Asking for a friend.

These are readily available, OpenGear and others have offered them forever. I can't believe fb doesn't have out of band access to their core networking in some fashion. OOB access to core networking is like insurance, rarely appreciated until the house is on fire.

Re: Facebook-owned sites were down

#545
It's not hyperbole to say that this is going to literally save lives.

Cutting off Facebook's firehouse of hate and misinformation for just a couple hours is going to have a obvious positive effect on millions of people. At this scale, at least one person will get vaccinated today because they didn't see the wall of ignorance that is FB's news feed.

Maybe we should introduce "digital blue laws", where one day a week, social media is shut down for the overall good of society.

Re: Facebook-owned sites were down

#546
post #493

Earlier quoted context omitted.

And there his account went poof, thanks for archiving.

They were quoted on multiple news sites including Ars Technica. I would imagine they were not authorized to post that information. I hope they don't lose their job. Shareholders and other business leaders I'm sure are much happier reporting this as a series of unfortunate technical failures (which I'm sure is part of it) rather than a company-wide organizational failure. The fact they can't physically badge in the pe…

I'm not sure why shareholders are lumped in here. A lot of reasons companies do the secret squirrel routine is to hide their incompetence from the shareholders.

Re: Facebook-owned sites were down

#549

Reddit r/Sysadmin user that claims to be on the "Recovery Team" for this ongoing issue: > As many of you know, DNS for FB services has been affected and this is likely a symptom of the actual issue, and that's that BGP peering with Facebook peering routers has gone down, very likely due to a configuration change that went into effect shortly before the outages happened (started roughly 1540 UTC). There are people now…

Interesting that they published stuff about their BGP setup and infrastructure a few months ago - maybe a little tweak to roll backs is needed. "... We demonstrate how this design provides us with flexible control over routing and keeps the network reliable. We also describe our in-house BGP software implementation, and its testing and deployment pipelines. These allow us to treat BGP like any other software componen…

    # todo: add rollbacks

Re: Facebook-owned sites were down

#550
post #277
post #36

For Facebook and WhatsApp it looks like a DNS issue, name resolution fails with SERVFAIL: $ dig facebook.com ; > DiG 9.16.21 > facebook.com ;; global options: +cmd ;; Got answer: ;; ->>HEADER

Thank god we have DoH.

It's DNS over HTTPS. It relies on the same system as plain DNS, so DoH won't really help in this case...
Post reply on HN