Live data from Hacker News

A personal link mill

corte.si

11–19 of 19 posts

Re: A personal link mill

#11
good idea..corte.si... I think adding a machine learning method on reordering/prioritizing the links would be a plus...the input data for the machine learning system would be the links user clicks to read as well as links to which user clicks as favorite... or may be pulling the keywords/tags from a given link's page and then checking how many links are clicked under a certain tag will surely help ordering the links by tags...its just my idea on how to help user to read his preferred links/topics....your inputs are welcome!

Re: A personal link mill

#14
post #3

Funny thing. I'm currently building one right now - disturbingly close to your product idea. It's currently a "generalized feed consumer" that presents a user with "stream of [de-duplicated] links to consume..." I'm just starting to use it for most of my content consumption, so that I have a nice corpus of data about my preferences. The goal is to eventually develop a predictive model to start filtering content with.…

It's an idea I've kicked around for a long time too. Building a simple Bayesian system would be neat; as you read, you should be able to tag items easily, and in a way that doesn't pigeonhole you into only seeing one side of an argument (I'd like to still see the opposition's view in, say, a political discourse for instance).

I've got too much else to work on currently, but I'd love to see what you come up with :).

Re: A personal link mill

#15
I built a really hacky version of this when I was fresh out of university and looking for jobs. Searching for jobs by keyword sucks so I just chucked a whole bunch of feeds into a database, de-duped them and presented them through a bayesian filter with a like-dislike button. It worked well enough to be an improvement on subscribing to search results in an rss reader.

https://github.com/jamii/pipes

Most of what the OP describes could probably be done pretty easily in yahoo pipes. Especially if it could call out to external services for ML recommendations.

Re: A personal link mill

#16
It would be really great if you would have some way to tie this into WordPress or any other CMS, so you can publish your personal links for the day.

Re: A personal link mill

#17
I built something like this in 2005[1], got distracted[2] and still wish I had the tool today. My database was organized around links rather than feeds/items. Two stories that included links to the same thing were considered to be talking about the same thing and would be presented together as one part of the conversation. This was a low rent (but more accurate) version of what Google News does where they assume two articles are about the same subject by comparing the terms used in the articles.

I also used Bayesian classification to determine which articles were ones you were more likely to be interested in reading.

[1]: the marketing pages are still online for this ancient piece of code: http://blazingthings.com/zestynews/tour1.html

[2]: I created the TurboGears web framework while creating Zesty News, and ultimately decided to pursue the framework rather than Zesty News.

Re: A personal link mill

#19
This project seems alright enough for a mini hackathon. I would be interested in building such a site, however I lack some knowledge in a few things that are needed.

Subscribing to Hacker News I have figured out it being simply parsing the RSS feed to generate links. How do I go about doing it for the other types of feeds? Does Twitter and Google+ feeds require integration with their individual APIs? Any help is greatly appreciated!

Post reply on HN