Show HN: I wrote a full text search engine in Go
1–10 of 56 posts
Re: Show HN: I wrote a full text search engine in Go
#2This is very cool! Your readme is intersting and well written - I didn't know I could be so interested in the internals of a full text search engine :)
What was the motivation to kick this project off? Learning or are you using it somehow?
Re: Show HN: I wrote a full text search engine in Go
#3Why did you create this new account if there's already 3 existing accounts promoting your stuff and only your stuff?
Re: Show HN: I wrote a full text search engine in Go
#4Great work! Would be interesting to see how it compares to Lucene performance-wise, e.g. with a benchmark like https://github.com/quickwit-oss/search-benchmark-game
Re: Show HN: I wrote a full text search engine in Go
#5Why did you create this new account if there's already 3 existing accounts promoting your stuff and only your stuff?
Because running a three-account bot‑net farm is fun :D
Okay, jk, please don’t mod me out.
One’s for browsing HN at work, the other’s for home, and the third one has a username I'm not too fond of.
I’ll stick to this one :) I might have some karma on the older ones, but honestly, HN is just as fun from everywhere
Re: Show HN: I wrote a full text search engine in Go
#6This is very cool! Your readme is intersting and well written - I didn't know I could be so interested in the internals of a full text search engine :) What was the motivation to kick this project off? Learning or are you using it somehow?
I’m learning the internals of FTS engines while building a vector database from scratch. Needed a solid FTS index, so I built one myself :)
It ended up being a clean, reusable component, so I decided to carve it out into a standalone project
The README is mostly notes from my Notion pages, glad you found it interesting!
Re: Show HN: I wrote a full text search engine in Go
#7This is very cool! Your readme is intersting and well written - I didn't know I could be so interested in the internals of a full text search engine :) What was the motivation to kick this project off? Learning or are you using it somehow?
I’m learning the internals of FTS engines while building a vector database from scratch. Needed a solid FTS index, so I built one myself :) It ended up being a clean, reusable component, so I decided to carve it out into a standalone project The README is mostly notes from my Notion pages, glad you found it interesting!
What are you building a vector database from scratch for?
Re: Show HN: I wrote a full text search engine in Go
#8Great work! Would be interesting to see how it compares to Lucene performance-wise, e.g. with a benchmark like https://github.com/quickwit-oss/search-benchmark-game
Thanks! Honestly, given it's hacked together in a weekend not sure it’d measure up to Lucene/Bleve in any serious way.
I intended this to be an easy on-ramp for folks who want to get a feel for how FTS engines work under the hood :)
Re: Show HN: I wrote a full text search engine in Go
#9Earlier quoted context omitted.
I’m learning the internals of FTS engines while building a vector database from scratch. Needed a solid FTS index, so I built one myself :) It ended up being a clean, reusable component, so I decided to carve it out into a standalone project The README is mostly notes from my Notion pages, glad you found it interesting!
What are you building a vector database from scratch for?
Mostly wanted a refresher on GPU accelerated indexes and Vector DB internals. And maybe along the way, build an easy on-ramp for folks who want to understand how these work under the hood
Re: Show HN: I wrote a full text search engine in Go
#10Cool project!
I see you are using a positional index rather than doing bi-word matching to support positional queries.
Positional indexes can be a lot larger than non-positional. What is the ratio of the size of all documents to the size of the positional inverted index?