Live data from Hacker News

Xapiand: A fast, simple, modern search and storage engine

kronuz.io

31–40 of 68 posts

Re: Xapiand: A fast, simple, modern search and storage engine

#33
post #7

Earlier quoted context omitted.

Not sure if you know about tantivy but it's cool too: https://github.com/tantivy-search/tantivy

Also worth mentioning is Toshi: https://github.com/toshi-search/Toshi Toshi is to ElasticSearch as Tantivy is to Lucene if that makes sense. Obviously as they are new they are not at feature parity, but Tantivy does win at some benchmarks: https://tantivy-search.github.io/bench/

There is also Blast (golang), built on top of Bleve.

- https://github.com/mosuka/blast - http://blevesearch.com/

Re: Xapiand: A fast, simple, modern search and storage engine

#35
post #12

Xapian has a long history starting in the early 80s: https://xapian.org/history I've used Xapian extensively, but not this new Xapiand tool, so I can only speak to the actual library. Xapian is a C++ library that accesses index data files directly on disk. There are bindings for various languages, say Python, let's you do 'import xapian' and get FFI bindings to the library, then you basically open your on disk index…

I love Xapian, the quality of its recall is excellent and indexing performance very hard to find fault with. There's just a tiny problem - it's stuck with the GPL, despite a long effort to relicence the code going back years.

Remind me what's wrong with GPL, here? You can't repackage and resell it?

Re: Xapiand: A fast, simple, modern search and storage engine

#36
post #12

Earlier quoted context omitted.

I love Xapian, the quality of its recall is excellent and indexing performance very hard to find fault with. There's just a tiny problem - it's stuck with the GPL, despite a long effort to relicence the code going back years.

Remind me what's wrong with GPL, here? You can't repackage and resell it?

You can't include it in your code and sell your software without distributing the source.

Re: Xapiand: A fast, simple, modern search and storage engine

#37
post #33
post #7

Earlier quoted context omitted.

Also worth mentioning is Toshi: https://github.com/toshi-search/Toshi Toshi is to ElasticSearch as Tantivy is to Lucene if that makes sense. Obviously as they are new they are not at feature parity, but Tantivy does win at some benchmarks: https://tantivy-search.github.io/bench/

There is also Blast (golang), built on top of Bleve. - https://github.com/mosuka/blast - http://blevesearch.com/

Yeah but it's golang, so it's kinda like java, so I see no pros in it TBH.

Re: Xapiand: A fast, simple, modern search and storage engine

#38
post #27

I was genuinely wondering recently why the Hackernews site search tool didn't show a very recent article with very obvious keywords, that google, for example, had in the first place in the results, when adding "Hn" to those 2 keywords in the search field. Is it a matter of the indexing, it means the article was too recent and it wasn't yet in the Algolia's(I believe) based HN's search tool memory; and in this case go…

Google search with site:news.ycombinator.com (and optionally a time limit, which I wish wasn't limited to past hour/day/week/month/year) seems consistently superior to what Algolia provides. Algolia is YC company, so I assume that's the main reason it's being used. But that it does such an awful job with such a simply structured site isn't compelling.

Hey latch, I've been working on the Algolia-based HN search and would love to improve it to provide you with a better search experience.

Do you think about any specific improvements? Would you mind sharing with us some non-working queries? We can follow-up here and you can also open issues on https://github.com/algolia/hn-search

Re: Xapiand: A fast, simple, modern search and storage engine

#39

Earlier quoted context omitted.

Remind me what's wrong with GPL, here? You can't repackage and resell it?

You can't include it in your code and sell your software without distributing the source.

Yeah, a pity

Re: Xapiand: A fast, simple, modern search and storage engine

#40
post #33
post #7

Earlier quoted context omitted.

Also worth mentioning is Toshi: https://github.com/toshi-search/Toshi Toshi is to ElasticSearch as Tantivy is to Lucene if that makes sense. Obviously as they are new they are not at feature parity, but Tantivy does win at some benchmarks: https://tantivy-search.github.io/bench/

There is also Blast (golang), built on top of Bleve. - https://github.com/mosuka/blast - http://blevesearch.com/

Wow I actually forgot about Bleve!

I watched a talk on the new indexing engine a while back:

https://www.youtube.com/watch?v=zjG2Y01i3Kk

Can we attribute some of this renewed zeal in the search space to the creation of more approachable systems languages (i.e. Golang and Rust)? Maybe I just haven't been watching the search space but I feel it wasn't always this full of new projects putting up good numbers.

Post reply on HN