Live data from Hacker News

Show HN: Open-source search engine with 2bn-page index

deusu.org

21–30 of 148 posts

Re: Show HN: Open-source search engine with 2bn-page index

#22
The site's interface is just incredibly pleasant compared to Google.com. I really hope the author sticks with it. Unfortunately I'm not sure it's usable right now, searching "group theory Wikipedia" never brings up a Wikipedia page (although maybe I should just be directly searching Wikipedia if that's what I wanted).

Re: Show HN: Open-source search engine with 2bn-page index

#23

Earlier quoted context omitted.

If it's not good, the it doesn't matter if it's OSS or not.

Good for what? Even though this isn't good for use as an every day general purpose search engine, it could be good for a particular use case perhaps with some adaptation or for learning from.

I don't know why would people use it to be frank. Lot better alternatives exists.

> it could be good for a particular use case

Namely?

> or for learning from.

The author admitted in the github readme that the code quality is rather bad. I also don't see a link to the search index, the only valuable component of this project.

Re: Show HN: Open-source search engine with 2bn-page index

#26

works really fast!

Thx.

But all the traffic from here is currently driving the servers to their limit. Queries are already slowing down a bit because of imminent overload. Usually the average query takes about 250ms. Currently the average is at 334ms.

Re: Show HN: Open-source search engine with 2bn-page index

#27
post #22

The site's interface is just incredibly pleasant compared to Google.com. I really hope the author sticks with it. Unfortunately I'm not sure it's usable right now, searching "group theory Wikipedia" never brings up a Wikipedia page (although maybe I should just be directly searching Wikipedia if that's what I wanted).

DuckDuckGo's approach of !bang searches, making duckduckgo the place[1] I go when I want to search another site, is really useful.

[1] It's my default search engine in Chrome, so I use bang searching in the address bar.

Re: Show HN: Open-source search engine with 2bn-page index

#28

Earlier quoted context omitted.

Good for what? Even though this isn't good for use as an every day general purpose search engine, it could be good for a particular use case perhaps with some adaptation or for learning from.

I don't know why would people use it to be frank. Lot better alternatives exists. > it could be good for a particular use case Namely? > or for learning from. The author admitted in the github readme that the code quality is rather bad. I also don't see a link to the search index, the only valuable component of this project.

I will publish the index for download in a few weeks. I'm currently working on the documentation. Oh, and I will publish the raw crawl-data too. Everything together is about 2.5tb.

There is also a free API in beta-test right now. Will probably be ready for official release next week.

Re: Show HN: Open-source search engine with 2bn-page index

#29
post #18

Alternative general purpose search engines are an exciting idea. It seems a lot like we're about the time when yahoo was dominant and searching was sort of awful. When you searched, what ranked highest was market-driven sorts of stuff. Right now, for topics normal people search for - not techies -all you get are content farm sites with js-popups asking for your email address. Try searching for anything health related…

I always had an inkling for a Search Engine that ONLY indexed the root page of every domain. Not sure if I'm right about this, but it sure would sort the chaff from the wheat for general purpose queries.

Seems like that would just give you all those made-for-seo sites that tend to have second-rate content at best. ie, you search for 'best electric lawn mower', and you'll get bestelectriclawnmowers.com, 10bestelectricmowers.com, etc. Those sort of sites exist for every imaginable topic, and in my experience are rarely worth visiting.

I would almost want the opposite. The best content on most topics I've found tends to be a page on a discussion forum of some sort, followed by blogs and more general editorial sites.

Re: Show HN: Open-source search engine with 2bn-page index

#30
post #3

It's written in pascal. Neat. However, it's not very good. If I search for "banana" I get information about a sex shop rather than about bananas.

Appears to be a "smart" search engine. Tries to infer a lot (maybe based on data collected earlier).
Post reply on HN