Live data from Hacker News

SeenBefore: A search engine for what you have seen before

seenbefore.com

91–97 of 97 posts

Re: SeenBefore: A search engine for what you have seen before

#91

Beat me to it! This was something I had been planning to build on my own for a while, but didn't get around to . Congrats! Whenever I have tech discussions with friends I would recall something mentioned in a article I read via HN. But it would take me a whole lot of effort to get that link. Oftentimes I simply couldn't get hold of the link even after an hour of searching. Please do get the Firefox extension out. Wou…

cofounder here. Our first version spidered out for the content but a far more efficient way was to upload compressed version of the data from the user as we can then do hash checks for reference counting. Chrome extension has been used in the wild for last 3 months on 6 continents. Firefox extension too unstable at the moment(also Mozilla ten day review process), but hope to get it out with 1-2 weeks. Would love any…

You need to work on stemming and clustering terms, I think... I've visited a number of Postgres related pages, and some of them contains only "Postgres" while others contains only "PostgreSQL", and searching for Postgres will only give me the former pages. It confused me for a little bit.

Re: SeenBefore: A search engine for what you have seen before

#92

Earlier quoted context omitted.

cofounder here. Our first version spidered out for the content but a far more efficient way was to upload compressed version of the data from the user as we can then do hash checks for reference counting. Chrome extension has been used in the wild for last 3 months on 6 continents. Firefox extension too unstable at the moment(also Mozilla ten day review process), but hope to get it out with 1-2 weeks. Would love any…

Few annoyances I noted in the FAQ "What Google search sites does it support?" section. google.co.in is by default in English, you would have to explicitly set it to another language [1]. "Indian" is not a language (Hindi, Malayalam, Bengali etc. is [2]). Farsi is not spelt Farsai [3] [1] https://www.google.co.in/?hl=ml [2] http://en.wikipedia.org/wiki/Languages_of_India [3] http://en.wikipedia.org/wiki/Persian_langua…

Fixed. Switched example to Turkish and Iranian, as that is were most of your traffic came from this post. Just read an 800 page book on India, can't believe I made that mistake.

Re: SeenBefore: A search engine for what you have seen before

#93

Earlier quoted context omitted.

If they selected them in a properly random way and had an effect close to 40% then yes, that probably does count as a sample.

As someone who signed up to coursera stats 101, err... Why 40%?

I am making some assumptions here absolutely, but because 40% is a large effect you don't need as many samples to be confident.

The other way of looking at it is that maybe it's actually 35% or 45% but either way, that's still interesting, even with a rougher approximation of the actual "answer". If, for some reason, you needed to know if it was 40% or 40.01% because that mattered to you then you would absolutely be annoyed at the small sample size.

If the finding was 2% then we would care about the uncertainty of +/- 5% since the finding is dwarfed by the error rate. That's a smaller effect size so you would need more samples to separate reality from the noise.

I am, by the way, pulling all of these numbers out my ass. Your stats 101 class will teach you the formulas to calculate the actual error bars at work here as well as the assumptions you need to make about the distribution of the data to use those formulas.

Re: SeenBefore: A search engine for what you have seen before

#94

Yes, I have seen it before! I have build a personal search engine MindRetrieve back in 2005. http://mindretrieve.net Specifically I'm not comfortable for big web company to keep the history of my web activity. So I make it work completely locally. My project did not get much uptake, probably my lackluster marketing and other assorted issues are to blame. So good luck on this one!

Mac version? Planned six years ago?

Re: SeenBefore: A search engine for what you have seen before

#95

Earlier quoted context omitted.

Few annoyances I noted in the FAQ "What Google search sites does it support?" section. google.co.in is by default in English, you would have to explicitly set it to another language [1]. "Indian" is not a language (Hindi, Malayalam, Bengali etc. is [2]). Farsi is not spelt Farsai [3] [1] https://www.google.co.in/?hl=ml [2] http://en.wikipedia.org/wiki/Languages_of_India [3] http://en.wikipedia.org/wiki/Persian_langua…

Fixed. Switched example to Turkish and Iranian, as that is were most of your traffic came from this post. Just read an 800 page book on India, can't believe I made that mistake.

It's, unfortunately, a common mistake.

Re: SeenBefore: A search engine for what you have seen before

#97

Earlier quoted context omitted.

Vinny Glennon, One of the founders here. Thanks very much for the up votes. The Chrome extension does not work in private browsing. I have a set of porn sites(1.7 million stored in redis) that I check if incoming links are a member of. You can selectively block sites ( https://www.seenbefore.com/blacklist_items ).

Where did you get your list from, and can you share it?

Perhaps http://www.shallalist.de/ ?
Post reply on HN