I'm surprised this post makes it to the homepage... They've been doing that for ever, no need to look at your logs to figure this out. How else would they find and display an image form the page you're providing a link to.
Hello Facebook Crawler
11–20 of 37 posts
Re: Hello Facebook Crawler
#12Earlier quoted context omitted.
+1. not sure how a post like this can make it to the front page.
There was a period where Hacker News consisted primarily of people on the right-hand side of the spectrum. People who were working inside of startups or had lots of experience with the web and our industry. Pretty much everyone knew what sharding was, and MongoDB wan't very popular. These days we've got a lot more people and they show up all across the board. Clearly if this is on the homepage, it was voted there by…
Even so, for those who are up to that point, that headline could give the implication that Facebook is getting into the search business.
Re: Hello Facebook Crawler
#13Earlier quoted context omitted.
+1. not sure how a post like this can make it to the front page.
There was a period where Hacker News consisted primarily of people on the right-hand side of the spectrum. People who were working inside of startups or had lots of experience with the web and our industry. Pretty much everyone knew what sharding was, and MongoDB wan't very popular. These days we've got a lot more people and they show up all across the board. Clearly if this is on the homepage, it was voted there by…
i'm just not so sure if the direction this is heading to is good. and also the headline of that article is miserable (as omarchowdhury already pointed out).
Re: Hello Facebook Crawler
#14This reminds me of a recent experience I had with the Bing bot. This most recent YC round, my co-founder and I used Skydrive to edit our application. Skydrive integrates pretty nicely with Word, even on a Mac, to allow for collaborative editing. It's like the best parts of Sharepoint, minus all the crap, and inside of a modern UI. I'm a diehard Apple user, but I also subscribe to the "right tool for the job" principl…
You assume they were indexing skydrive documents. It could well be that one of the people who visited the link had a Bing toolbar installed.
Either way, all publicly accesible documents will get indexed sooner or later.
Re: Hello Facebook Crawler
#15I would imagine they're checking the URL for malware as well.
Re: Hello Facebook Crawler
#16This reminds me of a recent experience I had with the Bing bot. This most recent YC round, my co-founder and I used Skydrive to edit our application. Skydrive integrates pretty nicely with Word, even on a Mac, to allow for collaborative editing. It's like the best parts of Sharepoint, minus all the crap, and inside of a modern UI. I'm a diehard Apple user, but I also subscribe to the "right tool for the job" principl…
You assume they were indexing skydrive documents. It could well be that one of the people who visited the link had a Bing toolbar installed. Either way, all publicly accesible documents will get indexed sooner or later.
You may be right, but I can't help but smirk at the thought of PG or Buchheit downloading and installing the Bing Toolbar ;)
Re: Hello Facebook Crawler
#17By looking at the headers you now have a great way of writing some analytics tools to see how much your website is shared on Facebook...
I would imagine that they cache the page contents and hence hit a URL only once in a certain period of time, thus skewing any analytics built around this.
[deleted]
Re: Hello Facebook Crawler
#18Earlier quoted context omitted.
I would imagine that they cache the page contents and hence hit a URL only once in a certain period of time, thus skewing any analytics built around this.
Yeah it's cached by Facebook. That's why if you want to change your meta and/or open graph tags info, you need to feed your page to Facebook's Url Linter ( https://developers.facebook.com/tools/lint/ ).
you can also programmatically force it to refresh the cache via a POST to https://graph.facebook.com/?id=http://google.com&scrape=...
Re: Hello Facebook Crawler
#19I wish I had enough karma to down vote this.
Re: Hello Facebook Crawler
#20This reminds me of a recent experience I had with the Bing bot. This most recent YC round, my co-founder and I used Skydrive to edit our application. Skydrive integrates pretty nicely with Word, even on a Mac, to allow for collaborative editing. It's like the best parts of Sharepoint, minus all the crap, and inside of a modern UI. I'm a diehard Apple user, but I also subscribe to the "right tool for the job" principl…
You assume they were indexing skydrive documents. It could well be that one of the people who visited the link had a Bing toolbar installed. Either way, all publicly accesible documents will get indexed sooner or later.
This was before the document had been sent to anyone. It was still being edited, only my friend and I were working on it. Also, the documents were not public.