Live data from Hacker News

Facebook, Instagram, and WhatsApp outages

independent.co.uk

151–160 of 254 posts

Re: Facebook, Instagram, and WhatsApp outages

#151
post #18

One interesting thing I've noticed from this (not sure if this is just my experience or if others noticed as well) but none of the ads seem to be impacted by this. Certainly makes me wonder if those are on a more prioritized and entirely separate infra and SLA that is designed to be more resilient and highly available.

> Certainly makes me wonder if those are on a more prioritized and entirely separate infra and SLA that is designed to be more resilient and highly available. There's absolutely no doubt that the ads are served differently. Think about it this way: - Ads: Small number, each served to many people, funded with real cash, but you can't get the cash if you don't serve the ads. - Photos: Large number, each served to few p…

Images:. Serve requested image.

Ads:. Conduct an auction in milliseconds between hundreds of parties between hundreds of millions of ad creatives with lots of very large in-memory machine learning systems, all to decide which ad to serve to maximize revenue.

Different problem entirely.

Re: Facebook, Instagram, and WhatsApp outages

#152
post #150

Earlier quoted context omitted.

Could they be in your own browser's cache? Or maybe in your ISP's cache? Considering the type of content Facebook, WhatsApp, and Instagram host, I'd imagine the cache hit rates to be pretty low for media. They'd be effective for JavaScript/CSS though, which might also be served from the same system

No, I checked if it was my own cache, and it's all HTTPS so it couldn't have been my ISP's cache either. I compared a few celebrity's instagrams with accounts of friends with many fewer followers. Celeb's images loaded but less and less as you scroll back through time, friends images all 503'd. Still seems to be the case.

By ISP cache, I meant fbcdn running off a dell server in a rack at your ISP...

Re: Facebook, Instagram, and WhatsApp outages

#153
post #49

Looks like Facebook image store is having issues. Facebook, Instagram and WhatsApp use the same image store, so all the services are affected.

However image metadata service seems to be up, this is what I see for most images on FB now. https://imgur.com/a/uC2L354

I'm pretty sure this data is kept in MySQL and memcached.

Re: Facebook, Instagram, and WhatsApp outages

#154
post #6

I find the outages of the last few days a curious coincidence : Slack, Google, Cloudflare, Azure, now FB. edit : added Slack after @kache_ mentioned it, added Azure after stevehubertron mentioned it.

I agree that the probability of these occurring so close together is very unlikely. Separately, this is a huge blow for Instagram/Facebook since this is one of the busiest social media sharing weeks in the US. I bet a lot of their engineers are answering pagers on vacation.

A lot of my vacation destinations don't even have cellular signal. Taking a laptop is often not an option on some trips either.

Re: Facebook, Instagram, and WhatsApp outages

#155
post #150

Earlier quoted context omitted.

No, I checked if it was my own cache, and it's all HTTPS so it couldn't have been my ISP's cache either. I compared a few celebrity's instagrams with accounts of friends with many fewer followers. Celeb's images loaded but less and less as you scroll back through time, friends images all 503'd. Still seems to be the case.

By ISP cache, I meant fbcdn running off a dell server in a rack at your ISP...

Ah, sure. Down detector's map suggests it's global: https://downdetector.com/status/facebook/map/

Instagram also doesn't seem to be serving hot and cold content from different hostnames/IPs for me, so it couldn't be that either.

Also check out the official status update at https://developers.facebook.com/status/issues/34337305659485... and https://developers.facebook.com/support/bugs/610822019411772...

Re: Facebook, Instagram, and WhatsApp outages

#156

Earlier quoted context omitted.

Parent is referring to the holiday tomorrow in the United States.

I think GP understood quite well and wanted to express their dissatisfaction with the assumption that everyone is American.

If that's the case, then they should have make that critique directly rather than beat around it with questions that they didn't actually need answered.

Re: Facebook, Instagram, and WhatsApp outages

#157
post #85

Earlier quoted context omitted.

Has there ever been a major bitcoin or ethereum, or stellar outage?

Facebook's more akin to an exchange for Libra, isn't it? There's 28 companies partnering up for the system.

They have one wallet. But there is no reason for a wallet to depend on facebook being online, and presumably there will be 100 points of failure for the ledger on launch

Re: Facebook, Instagram, and WhatsApp outages

#158

Earlier quoted context omitted.

You don't have to imagine - Wells Fargo was down for several hours earlier this year and no one could send or receive any money. People couldn't pay bills, transfer money and some couldn't even buy gas.

> some couldn't even buy gas. How culture changes perspectives! Over here in Europe I was thinking "doesn't sound so bad". Then I realised over in the US, gas means petrol, and without petrol America doesn't work. I'll reply to any replies after I've taken the electric train home.

You're not being fair to Europe's very impressive contributions. After all, European companies lead the way in the production of rolling pollution machines, aka ICE vehicles.

Besides, the US has cleaner air than most of Europe, thanks to the intense diesel particulate pollution across European cities. Who can forget the infamous Paris smog photos from a few years ago (which is still an ongoing problem)?

Don't worry though, the US invented the modern electric car, twice, in the form of GM's EV1 and Tesla. We'll lead the European automakers out of the dark ages - underway right now as they all chase Tesla - and take care of the problem of the ICE automobile that Europe was heavily responsible for. In the process cities like Paris will be smog free again, finally.

Re: Facebook, Instagram, and WhatsApp outages

#159
post #6

I find the outages of the last few days a curious coincidence : Slack, Google, Cloudflare, Azure, now FB. edit : added Slack after @kache_ mentioned it, added Azure after stevehubertron mentioned it.

Imagine if Google is next

They were down yesterday

Re: Facebook, Instagram, and WhatsApp outages

#160

Earlier quoted context omitted.

If you have your work with you, it isn't a vacation.

If it's emergencies only and you get compensated handsomely many people will feel it's worth it. Of course reality often looks different.

depends on how you value your vacation time with family/friends/to yourself.
Post reply on HN