Huh, but why? I can totally understand scanning a PDF for links to look for malicious links to protect users. But that wouldn't involve actual HTTP requests to them. I'm struggling to imagine what purpose this could have.
Facebook crawls links in PDFs you send in Messenger
11–20 of 165 posts
Re: Facebook crawls links in PDFs you send in Messenger
#12Could someone effectively DOS another site using this method by including a bunch of links that generate a lot of load? Would be interesting to see if Facebook has a maximum number of links it'll follow.
I remember something like this was possible back in the day with Google Sheets. You could embed a URL as if it was an image in each cell of a sheet and it would make thousands of requests. I don't remember the details.
Re: Facebook crawls links in PDFs you send in Messenger
#13Huh, but why? I can totally understand scanning a PDF for links to look for malicious links to protect users. But that wouldn't involve actual HTTP requests to them. I'm struggling to imagine what purpose this could have.
Re: Facebook crawls links in PDFs you send in Messenger
#14Could someone effectively DOS another site using this method by including a bunch of links that generate a lot of load? Would be interesting to see if Facebook has a maximum number of links it'll follow.
Re: Facebook crawls links in PDFs you send in Messenger
#15Sidenote i wonder why FB doesnt launch a search engine since they crawl most of the web anyways
That would let people leave the Facebook platform and explore the open web.
Re: Facebook crawls links in PDFs you send in Messenger
#16Re: Facebook crawls links in PDFs you send in Messenger
#17Re: Facebook crawls links in PDFs you send in Messenger
#18Huh, but why? I can totally understand scanning a PDF for links to look for malicious links to protect users. But that wouldn't involve actual HTTP requests to them. I'm struggling to imagine what purpose this could have.
How do you know if they're malicious if you don't make HTTP requests to them? One of the things that phishers and others do is use link wrapping and other services to hide malicious links. So, I get something.wordpress.com/something-clean. I then put in an HTML or JS redirect on that page to something malicious. Given that browsers don't warn about HTTP, HTML, or JS redirects, it's an easy way for scammers to get aro…
Re: Facebook crawls links in PDFs you send in Messenger
#19Sidenote i wonder why FB doesnt launch a search engine since they crawl most of the web anyways
That would let people leave the Facebook platform and explore the open web.
Re: Facebook crawls links in PDFs you send in Messenger
#20Earlier quoted context omitted.
How do you know if they're malicious if you don't make HTTP requests to them? One of the things that phishers and others do is use link wrapping and other services to hide malicious links. So, I get something.wordpress.com/something-clean. I then put in an HTML or JS redirect on that page to something malicious. Given that browsers don't warn about HTTP, HTML, or JS redirects, it's an easy way for scammers to get aro…
But in this case, that doesn't help at all because facebook's crawler uses a predictable user agent string. You give a clean result to the facebook crawler and a malicious result to everyone else.