61–69 of 69 posts
I'd be interested in seeing what happens when you bucket citations by domain instead of URL. Google Analytics counts over a thousand unique referring SO pages to Cocoa Controls ( http://www.cocoacontrols.com ) this year alone. But, of course, most of the links back to my site are long tail.
Great idea, will try and look at that next.
This is nicely done, but so far isn't returning anything interesting for me. All the results are very basic (Django docs, PHP docs, etc), which makes sense, the most often cited will be the most general. What about a change in algorithm to try and add some discovery here. What if you look at votes for answers vs cites? So things that have a high average vote:cite ratio rank?
Thanks. Yea i agree our initial use case was to provide an interface to the dataset and to allow us to explore what kinds of things developers were sharing on SO. For the next version we are working on new ranking metrics that will improve the discover aspect, vote:cite and view:cite are 2 we are looking at.
Ha, the top result for C is the spec. Every other language is a popular library. I wonder if there are more RTFM-type responses for C than other languages.
Does this scrape links from the comments posted to questions as well?
i dunno... 11 of the top 14 links under the "Javascript" tag are about jquery (which has it's own tag). I suppose it's not a flaw in your algorithm, just not really very interesting results.
Does this scrape links from the comments posted to questions as well?
No just the post bodies (question and answers) at the moment, but we are working parsing the comments and the post history, those datasets are about 4 times the size of the posts! So there are probably a lot more URLs in there, although we will have to decide if we treat all URLs the same or if we differentiate between URLs in post bodies contained in the dump, URLs in the post history (that may have been removed fro…
Can't wait to see the updated stats.
If you could make "more" load more than just a few more records, though, that'd make it a lot easier to dig deeper.