Live data from Hacker News

Show HN: Open-source search engine with 2bn-page index

deusu.org

1–10 of 148 posts

Re: Show HN: Open-source search engine with 2bn-page index

#4

What makes this better than https://duckduckgo.com ?

Not saying that it's better but one of the main selling-points of DeuSu seems to be that it's fully open source and independent search index. Duckduckgo, if I remember correctly, is not 100% open source and get their search index from Yahoo (or maybe Bing, not sure)

Re: Show HN: Open-source search engine with 2bn-page index

#6
Alternative general purpose search engines are an exciting idea.

It seems a lot like we're about the time when yahoo was dominant and searching was sort of awful. When you searched, what ranked highest was market-driven sorts of stuff.

Right now, for topics normal people search for - not techies -all you get are content farm sites with js-popups asking for your email address. Try searching for anything health related, for example. We've regressed.

My own half-solution is to look only for sites that are discussions - reddit, hn, etc. It could be better. A search engine that favored non-marketing content could really steal some thunder.

This doesn't look like that, but maybe its a start?

Re: Show HN: Open-source search engine with 2bn-page index

#7

Strange, Wikipedia article is not on the first page and don't blame me for searching something non German thing :) https://deusu.org/query?q=berlin

It's pretty obvious that Google et al. do a lot of "custom" filtering like prioritising Wikipedia, removing porn from "obviously non-porn" searches etc. (That "Berlin" search gives porn as the 8th result.)

Re: Show HN: Open-source search engine with 2bn-page index

#8
post #4

What makes this better than https://duckduckgo.com ?

Not saying that it's better but one of the main selling-points of DeuSu seems to be that it's fully open source and independent search index. Duckduckgo, if I remember correctly, is not 100% open source and get their search index from Yahoo (or maybe Bing, not sure)

If it's not good, the it doesn't matter if it's OSS or not.

Re: Show HN: Open-source search engine with 2bn-page index

#9
They need to filter porn out of their search results (even for common queries like "hat", there's only porn) and perhaps be more resilient to SEO techniques since it looks like there's lot of spam on top results. Queries with common words such as "cat" return almost only irrelevant results.

I'd really like to see that kind of project working as a good alternative to Google, but as it is it's not really usable.

Re: Show HN: Open-source search engine with 2bn-page index

#10
Fun, but overal quality seems a bit lacking.

When I search myself; the top 10 results don't even have my last name ('Kusters') and just shows pages that have the word 'Nick'. I suppose you don't use a form of LSA to score the search results? Maybe it's too specific, but afaik mainstream search engines seem to give somewhat consistent results here.

https://deusu.org/query?q=nick+kusters

Looking at the code (https://github.com/MichaelSchoebel/DeuSu/) I notice that you have ranking modifiers based on the .tld; why not store the reported content language and score based on that? Isn't that more relevant?

Post reply on HN