This is nice - We use elasticsearch, but getting good quality has been hard - setting up the tokenizers, filters etc in a good way is tricky, and sometimes our search gives really bad results.
Instacart launches Searchkick - Bootstrap for Search
11–20 of 23 posts
Re: Instacart launches Searchkick - Bootstrap for Search
#12This looks pretty good. Though many of the features are already baked into PostgreSQL's full-text search, out of the box this seems to add enough value to get me interested. I'll definitely be checking this out further.
Interesting. I'll have to look into PostgreSQL's full text search. Does it support token filters similar to Elasticsearch?
To a degree, and is also very customizeable. It breaks things out to the lexeme level, read http://www.postgresql.org/docs/9.2/interactive/textsearch-in....
Re: Instacart launches Searchkick - Bootstrap for Search
#13Hardcoding your scoring function here is a bad, bad idea:
https://github.com/ankane/searchkick/blob/master/lib/searchk...
Just curious, how many docs are you indexing?
Re: Instacart launches Searchkick - Bootstrap for Search
#14Hardcoding your scoring function here is a bad, bad idea: https://github.com/ankane/searchkick/blob/master/lib/searchk... Just curious, how many docs are you indexing?
We're indexing around 100k documents. What line are you referring to, and what's bad about it?
Re: Instacart launches Searchkick - Bootstrap for Search
#15This is nice - We use elasticsearch, but getting good quality has been hard - setting up the tokenizers, filters etc in a good way is tricky, and sometimes our search gives really bad results.
That's exactly why we open-sourced Searchkick :)
Re: Instacart launches Searchkick - Bootstrap for Search
#16This looks pretty good. Though many of the features are already baked into PostgreSQL's full-text search, out of the box this seems to add enough value to get me interested. I'll definitely be checking this out further.
We looked into PostgreSQL search for a bit, but didn't see a way to train search results from past conversions. Does anyone know if this is possible?
Re: Instacart launches Searchkick - Bootstrap for Search
#17Elasticsearch should be the bootstrap of search imo. Afaics the only interesting bit in this project is the reindex technique. The rest is just trying to make a nice rails idiomatic client library (perhaps for ruby too) around search querying. For a python idiomatic client lib comparison, see mozilla services http://elasticutils.readthedocs.org/en/latest/
Training searches from conversions (self-improving searches) is kinda interesting. Elasticsearch is an amazing product but it can be hard to configure, especially for beginners.
Edit: spelling
Re: Instacart launches Searchkick - Bootstrap for Search
#18Looks very cool! Going to play around with it some. Is this a first open release of the project or is it in quiet use other places than Instacart?
It's been on Github for a bit, but this is the first big release.
Re: Instacart launches Searchkick - Bootstrap for Search
#19I appreciate that you decided to open-source this project. I do have a few (hopefully) constructive criticisms to make:
1. Using aliases the reindex with near zero downtime is very clever, mad props to Jaroslav Kalistsuk
2. Tire is excellent, I am glad you didn't try to reinvent the wheel here, please keep it that way.
3. Conversion based score boosting, although clever is flawed. Hardcoding values https://github.com/ankane/searchkick/blob/master/lib/searchk... is convoluted. You should consider providing a more flexible DSL to customize how conversion based score is calculated.
4. Analyzers https://github.com/ankane/searchkick/blob/master/lib/searchk... are poorly named and do not represent what they do.
Again, this is very nice for version 0.1.2
Re: Instacart launches Searchkick - Bootstrap for Search
#20Thanks! I'll give this a go for sure!