Yes, I have seen it before! I have build a personal search engine MindRetrieve back in 2005. http://mindretrieve.net Specifically I'm not comfortable for big web company to keep the history of my web activity. So I make it work completely locally. My project did not get much uptake, probably my lackluster marketing and other assorted issues are to blame. So good luck on this one!
SeenBefore: A search engine for what you have seen before
61–70 of 97 posts
Re: SeenBefore: A search engine for what you have seen before
#62Co-founder here. This took us by surprise, we were planning to have Firefox and Safari support done by launch. At this stage, it is priceless to know if we are solving a real problem people have. Also, is this something people would pay for (loops back to if this is enough of a pain point). From the moment we start charging, is the moment we start learning.
Yeah I could code/hack together something myself and have been thinking of doing it [for fun], but ya know :p
So, yeah, count me in as being interested.
Re: SeenBefore: A search engine for what you have seen before
#63Who am I handing my data over to? I can't find this anywhere on the site.
Re: SeenBefore: A search engine for what you have seen before
#64Obvious point to raise: the reason people regularly delete their browser history is because they watch porn without turning on private browsing. How do you propose to deal with this? You'd need to provide at least the ability to selectively delete portions of the history. But you can selectively delete portions of your browser history too, and people don't - because it would be too easy to miss something. Instead, th…
The noise introduced by phrasing my query differently is a real problem in search that Google hasn't fixed yet.
Re: SeenBefore: A search engine for what you have seen before
#65Obvious point to raise: the reason people regularly delete their browser history is because they watch porn without turning on private browsing. How do you propose to deal with this? You'd need to provide at least the ability to selectively delete portions of the history. But you can selectively delete portions of your browser history too, and people don't - because it would be too easy to miss something. Instead, th…
Wouldn't one simply use one specific browser, say either safari or firefox or chrome, and only that browser for their... unsavory activities? I think that is a great way to keep accounts separate and keep "bad" sites from knowing about "good" sites and vice versa. Just saying. Not that I partake in any such unsavory activities.
The same could be done for a "Porn" profile too I guess, sand-boxing any history, extensions and bookmarks to that profile. You could even associate tie it to a Google account for portability.
Re: SeenBefore: A search engine for what you have seen before
#66Earlier quoted context omitted.
Do you store the entire set of 1.7 million entries in redis? Or is redis an index to data stored elsewhere, in a relational DB perhaps? I was under the impression that redis wouldn't be all that useful to store a lot of data. Would be great if something as quick as redis could work with large data sets.
Storing a list of 1.7 million strings for us takes 70mb stored in memory. Testing for membership is an O(1) op. Very happy with it. We use mongo as a dumb data store as well as a bunch of other infrastructure tools, like http://circleci.com we could have only dreamt of years ago.
Re: SeenBefore: A search engine for what you have seen before
#67Do you store just the URL and depend on Google returning the results? How does it work exactly?
Re: SeenBefore: A search engine for what you have seen before
#68Beat me to it! This was something I had been planning to build on my own for a while, but didn't get around to . Congrats! Whenever I have tech discussions with friends I would recall something mentioned in a article I read via HN. But it would take me a whole lot of effort to get that link. Oftentimes I simply couldn't get hold of the link even after an hour of searching. Please do get the Firefox extension out. Wou…
cofounder here. Our first version spidered out for the content but a far more efficient way was to upload compressed version of the data from the user as we can then do hash checks for reference counting. Chrome extension has been used in the wild for last 3 months on 6 continents. Firefox extension too unstable at the moment(also Mozilla ten day review process), but hope to get it out with 1-2 weeks. Would love any…
How do you deal with 2 users looking at the same URL but seeing different things? example.com/me would be different for user1 and user2.
Some pages would be very dynamic, eg. Facebook. And not everyone browses facebook/twitter behind https (which you do not index). Do you not index social networks?
I like the fact that the extension requires no user input and works silently in the background. Has some trade-offs, but worth it. Cannot comment on the search quality yet because Chrome is only my secondary browser; not enough history to search for anything meaningful.
Re: SeenBefore: A search engine for what you have seen before
#69Earlier quoted context omitted.
Do you store the entire set of 1.7 million entries in redis? Or is redis an index to data stored elsewhere, in a relational DB perhaps? I was under the impression that redis wouldn't be all that useful to store a lot of data. Would be great if something as quick as redis could work with large data sets.
Storing a list of 1.7 million strings for us takes 70mb stored in memory. Testing for membership is an O(1) op. Very happy with it. We use mongo as a dumb data store as well as a bunch of other infrastructure tools, like http://circleci.com we could have only dreamt of years ago.
Curious how. O(1) an array index lookup, not a string lookup, I thought.
Re: SeenBefore: A search engine for what you have seen before
#70Beat me to it! This was something I had been planning to build on my own for a while, but didn't get around to . Congrats! Whenever I have tech discussions with friends I would recall something mentioned in a article I read via HN. But it would take me a whole lot of effort to get that link. Oftentimes I simply couldn't get hold of the link even after an hour of searching. Please do get the Firefox extension out. Wou…
cofounder here. Our first version spidered out for the content but a far more efficient way was to upload compressed version of the data from the user as we can then do hash checks for reference counting. Chrome extension has been used in the wild for last 3 months on 6 continents. Firefox extension too unstable at the moment(also Mozilla ten day review process), but hope to get it out with 1-2 weeks. Would love any…
[1] https://www.google.co.in/?hl=ml