Live data from Hacker News

Facebooks crawls every page recorded by its tracking pixel

news.ycombinator.com

11–20 of 75 posts

Re: Facebooks crawls every page recorded by its tracking pixel

#11
If security of sensitive information depends on tokens in the URL, don't just give those URLs to a third party, how would that ever be a reasonable thing to do? (especially since the third party apparently hasn't given you any guarantees on how they treat that, otherwise we wouldn't be having this conversation?)

Do your users, your broken software and yourself a favor and don't put Facebook tracking crap everywhere.

Re: Facebooks crawls every page recorded by its tracking pixel

#12
I don't mind Facebook crawling pages as long as it respects robots.txt, but for the last few weeks we've been hammered by requests from Facebook-owned IP addresses (millions of hits daily, 50+ for the same URL at times). They don't even set the User-Agent header.

There's a bug report regarding the missing header here: https://developers.facebook.com/bugs/1654459311255613/

Unfortunately it seems impossible to get in touch with Facebook devs directly.

Re: Facebooks crawls every page recorded by its tracking pixel

#13
post #3

Shocking! Abuse of power and shady tracking techniques by Facebook? Unheard of! Seriously, this cannot be surprising after learning that the Messenger app listens to everything you do, all the time. That's just off the top of my head. They are doing this and much more.

I've heard a lot of anecdotal reports of the messenger app listening to what you do. So much so that I've uninstalled the app.

However, I've never seen a non-anecdotal source or even a source that gathers all anecdotes and gives a decent meta-analysis. Would you happen to have one?

Re: Facebooks crawls every page recorded by its tracking pixel

#14
post #3

Shocking! Abuse of power and shady tracking techniques by Facebook? Unheard of! Seriously, this cannot be surprising after learning that the Messenger app listens to everything you do, all the time. That's just off the top of my head. They are doing this and much more.

Please get your facts straight before posting here.

https://www.wired.com/story/facebooks-listening-smartphone-m...

Re: Facebooks crawls every page recorded by its tracking pixel

#15
post #11

If security of sensitive information depends on tokens in the URL, don't just give those URLs to a third party , how would that ever be a reasonable thing to do? (especially since the third party apparently hasn't given you any guarantees on how they treat that, otherwise we wouldn't be having this conversation?) Do your users, your broken software and yourself a favor and don't put Facebook tracking crap everywhere.

That's because our industry is full of hopelessly under qualified people who somehow manage to create software by randomly throwing together bits of code from stackoverflow / books and tweaking it until it "works".

Re: Facebooks crawls every page recorded by its tracking pixel

#16
post #11

If security of sensitive information depends on tokens in the URL, don't just give those URLs to a third party , how would that ever be a reasonable thing to do? (especially since the third party apparently hasn't given you any guarantees on how they treat that, otherwise we wouldn't be having this conversation?) Do your users, your broken software and yourself a favor and don't put Facebook tracking crap everywhere.

That's because our industry is full of hopelessly under qualified people who somehow manage to create software by randomly throwing together bits of code from stackoverflow / books and tweaking it until it "works".

That's true. But also trackers (especially big ones) deliberately try to make it as easy as possible to accidentally include them in your page. e.g: the if you use their cdn for fonts/style sheets, if you include a fb like button etc.

A friend of mine covers this more extensively in this blog post which I found a very interesting read: https://remusao.github.io/posts/static-comments.html

So I think it's still concerning that once they're in, they start crawling. Although not very surprising I have to say... That's their business after all.

Re: Facebooks crawls every page recorded by its tracking pixel

#17
post #12

I don't mind Facebook crawling pages as long as it respects robots.txt, but for the last few weeks we've been hammered by requests from Facebook-owned IP addresses (millions of hits daily, 50+ for the same URL at times). They don't even set the User-Agent header. There's a bug report regarding the missing header here: https://developers.facebook.com/bugs/1654459311255613/ Unfortunately it seems impossible to get in t…

Send a cease and desist to the CTO. Wait 30 days, then sue under the CFAA. LinkedIn did it

Re: Facebooks crawls every page recorded by its tracking pixel

#18
post #5

> 1. they are crawling potentially sensitive information granted by links with tokens Don't put Facebook tracking on sensitive pages. Actually as a service to your users don't put it anywhere where it doesn't add value. > 2. they are triggering potentially harmful and/or confusing actions in your website by repeating links They only perform idempotent[0]* requests which should not have any negative effect if performe…

GET is only idempotent in theory. Way too many people abuse GET when creating websites.

Re: Facebooks crawls every page recorded by its tracking pixel

#19
post #7
post #2

Isn't it obvious? For which reason, if not tracking and information gathering, would such a feature even exist? Best solution is still to block Facebook's infrastructures, as always.

I disagree, it's not at all obvious. Pixels are used for conversion tracking (cookie pixels/cookieless pixels). Crawl isn't necessary for a pixel to function.

If you're trying to transmit trusted information in clientside js, then one common pattern is to have a user's browser to fire the data initially, then crawl to obtain a trusted copy. The last company I worked for did this, but skipped the second step, which led to all kinds of XSS attacks.

Re: Facebooks crawls every page recorded by its tracking pixel

#20
post #18
post #5

> 1. they are crawling potentially sensitive information granted by links with tokens Don't put Facebook tracking on sensitive pages. Actually as a service to your users don't put it anywhere where it doesn't add value. > 2. they are triggering potentially harmful and/or confusing actions in your website by repeating links They only perform idempotent[0]* requests which should not have any negative effect if performe…

GET is only idempotent in theory. Way too many people abuse GET when creating websites.

As an example of the problem, see the "Issues and criticism" of the related topic "Link prefetching" in Wikipedia - https://en.wikipedia.org/wiki/Link_prefetching#Issues_and_cr... .
Post reply on HN