Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

YaCy takes on Google with open source search engine

theregister.co.uk

Post reply on HN
Print view View original

11–18 of 18 posts

Re: YaCy takes on Google with open source search engine

#11

Post by gubatron »

their idea is good, but the way that it's executed trumps its growth.

instead of having people install this on their computer, they should make it instead so that sysadmins run nodes and put ads on their node search results.

the end user would just go to a .com site, and search. everyone running nodes make money, more nodes are installed. The network would be larger than google in a short amount of time.

wonder why the hell they haven't thought of this.

people aren't going to be typing http://localhost:port to make a search and keep an engine running, also uptime and firewall configurations leaves a lot of the desktop nodes out of the equation if they can't do NAT traversal to participate in the network.

me #facepalms to still see them doing this, going to yacy.net is the most frustrating thing ever to the curious non-techie user.

Re: YaCy takes on Google with open source search engine

#12

Post by 4ad »

So I have to install software on my computer to use it? No, thanks. They claim an advantage: "no content can be censored and no search results can be recorded and analyzed on central servers", this is extremely important for some applications, but for searching source code, I couldn't care less. It just raises the bar of adoption to the point I'm not interested in it.

General purpose client side software is dead. Client side software makes sense only for niche applications.

Re: YaCy takes on Google with open source search engine

#13

Post by 4ad »

harryf wrote: post #10

IMO what's missing in the search space is a web search engine with an API, especially with access to the raw crawled content. Amazon used to do this was the Alexa web crawl data ( see http://www.readwriteweb.com/archives/alexa_turned_in.php ) but later withdrew that part of the service.

I have a gut feeling that we won't see something like that soon due to legal implications.

Re: YaCy takes on Google with open source search engine

#14

Post by halfasleep »

wilkenm wrote: post #8
ramanujan wrote: post #7

The intranet search engine concept is interesting and will help this grow. Anyone know of anything else which is a search engine in a box, basically an open source competitor to the various Google Search Appliances?

The distributed search model that YaCy uses would never work in a large scale enterprise. Security, safe harbor, etc are all difficult enough using a traditional, centralized approach. Trying to imagine this done in a distributed way across the enterprise is giving me a headache. And the closest thing to open source, turnkey search is gluing together Apache SOLR and a web crawler. Lucid Imagination offers this (plus…

I was playing with YaCy a little, and there is an "Intranet" mode. As far as I can make out, this can operate in a distributed way, but behind the firewall. I didn't look into how to set it up in great detail yet though, was playing with web search.

Re: YaCy takes on Google with open source search engine

#16

Post by xtracto »

I (among quite a lot of people I guess) have thought about using P2P for web search.

In fact, P2P protocols like KAD have been using to search for quite some time. What I would like to see is a search system composed of a client:

1. Implemented in Javascript (so that the user does not need to download a program to use it). 2. Defining a file format which describes one URL, with any extra useful metadata (document type, last crawling date, text content, etc) 2. Share those files using a P2P protocol like KAD 3. Is able to search in the content of the URL file for words, phrases, etc

As gubatron said, having an online "frontend" would be optimal. In addition to that, people could embed the "crawling" client in their webpage (which might double as ad server) to help the crowling effort.

Re: YaCy takes on Google with open source search engine

#17

Post by danmaz74 »

This could be a good idea, IF there was a way to stop all kinds of malicious people to tamper with the search results in so many ways. Google already has to deal with the manipulation of the signals about page relevance, just think if you had to also deal with tampering with the ranking system itself...

Re: YaCy takes on Google with open source search engine

#18

Post by danssig »

gubatron wrote: post #11

their idea is good, but the way that it's executed trumps its growth. instead of having people install this on their computer, they should make it instead so that sysadmins run nodes and put ads on their node search results. the end user would just go to a .com site, and search. everyone running nodes make money, more nodes are installed. The network would be larger than google in a short amount of time. wonder why t…

Well... you've thought of it... and they're open source...
Post reply on HN