Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta outage

metastatus.com

Post reply on HN
Print view View original

431–440 of 902 posts

Re: Meta outage

#431

Post by binaryblitz »

lazide wrote: post #310
dv_dt wrote: post #214

Well, I've been spitballing 1-3 years for effects of layoffs to affect company performance, so this timeframe is about right

Yup. That it’s related to the elections is also predictable, due to stress. Made worse in big corp due to affirmative action + lack of enough qualified candidates meeting diversity criteria. Which is inevitable when you have coarse criteria applied to such a large industry this way so quickly, as it takes decades for anyone to be qualified for the senior roles, and many years for junior/mid level, even if there were…

Blaming an outage on DEI... Man that's a new one for me.

Could you let us know where you work? I want to make sure I never apply there.

Re: Meta outage

#432

Post by bandwidth »

chongli wrote: post #229
ink_13 wrote: post #60

Earlier quoted context omitted.

Meta doesn't do that. For one thing, "Patch Tuesday" is a Windows thing, and 0% of production traffic is served from Windows there. For another, they are constantly and always redeploying. More likely that someone bungled a deploy of user auth. No doubt they are rolling back as we speak.

More likely that someone bungled a deploy of user auth How would that affect YouTube?

Surplus load from Meta users flocking to other platforms

Re: Meta outage

#433

Post by barkingcat »

passwordoops wrote: post #416
jgehrcke wrote: post #305

Might be related to this event? > The cut lines include Asia-Africa-Europe 1, the Europe India Gateway, Seacom and TGN-Gulf, Hong Kong-based HGC Global Communications said. It described the cuts as affecting 25% of the traffic flowing through the Red Sea. https://apnews.com/article/red-sea-undersea-cables-yemen-hou... https://www.bbc.com/news/world-middle-east-68478828.amp

I'm 95% sure it'll turn out to be a mundane config error somewhere

It will be DNS related.

Re: Meta outage

#435

Post by nuz »

boring_twenties wrote: post #392
bigwheeler wrote: post #334

Tip for Meta engineers: when your service is failing, don't just log people out and prevent logins. Display a cute image that shows that the service is drastically failing (like a whale or something), and then people will know to stop trying to repeatedly log in. The public might even come up with a catchy name for the whale.

Beyond unbelievable that going on an hour later, they're still showing "incorrect password" errors. How many hundreds of millions of people have wasted time frantically trying (in vain) to reset their passwords and pointlessly freaking out that their account might be compromised? What a bunch of careless, incompetent excuses for engineers.

Imagine how many hundreds of millions of users waste their time using instagram and facebook on a daily basis. Safe to say they don't mind wasting their customers time

Re: Meta outage

#437

Post by marcosdumay »

101008 wrote: post #11
jonnycomputer wrote: post #6

It logged me out and told me that my credentials were incorrect; I thought my credentials had been stolen, so I'm kinda personally glad that it seems to be happening to a lot of other people too. I know that's a bit selfish, but :shrug:

I panicked the same. Even when I tried to recover my password, it said my email address wasn't associated to any account. I thought I lost it forever

That's the natural endgame of the "user-facing services must not stop, if something they depend upon stops, they must only degrade" philosophy.

Re: Meta outage

#438

Post by Kalium »

matsemann wrote: post #408
Kalium wrote: post #365

Earlier quoted context omitted.

You are absolutely correct. That would be a much better experience. That said, getting there strikes me as pretty challenging. Automatically detecting a down state is difficult and any detection is inevitably both error-prone and only works for things people have thought of to check for. The more complex the systems in question, the greater the odds of things going haywire. At Meta's scale, that is likely to be nearl…

But there's something off here. I wouldn't expecting to be shown as logged out when the services are down. I'd expect calls to fail with something aka 500 and an error showing "something happen edited on our side". Not all the apps going haywire.

At the scale of Meta, "down" is a nuanced concept. You are very unlikely to get every piece of functionality seizing up at once. What you are likely to get is some services ceasing to function and other services doing error-handling.

For example, if the service that authenticates a user stops working but the service that shows the login form works, then you get a complex interaction. The resulting messaging - and thus user experience - depend entirely on how the login page service was coded to handle whatever failure the authentication service offered up. If that happens to be indistinguishable from a failure to authenticate due to incorrect credentials from the perspective of the login form service, well, here we are.

At Meta's scale, there's likely quite a few underlying services. Which means we could be getting something a dozen or more complex interactions away from wherever the failures are happening.

Re: Meta outage

#439

Post by TulliusCicero »

fmsf wrote: post #292

I was considering buying the Quest 3 this morning, this outage is timely. The fact that I can't use my perfectly working headset to play an offline game because facebook is down, makes me wonder if I should go for a different provider. Any recommendations? Excluding apple vision pro since it is too expensive.

The Quest 3 is kind of the obvious mainstream consumer choice for a VR headset.

Standalone wireless headset, reasonably powerful chipset, can optionally stream from a PC either wired or wireless, good optics/resolution, decent controllers/tracking, large game library, large suite of features (including hand tracking and color passthrough), all for a reasonable price. Not sure any other headset really competes on all those things at once.

Post reply on HN