SQLite FTS5 Extension
sqlite.org
SQLite FTS5 Extension
1–10 of 61 posts
Re: SQLite FTS5 Extension
#2It's a very useful feature of sqlite and it also works great in-browser using wa-sqlite[0]. Example, if anyone's curious [1].
[0]: https://github.com/rhashimoto/wa-sqlite [1]: https://github.com/iansinnott/prompta/blob/master/src/lib/mi...
Re: SQLite FTS5 Extension
#3This is hugely underrated in my opinion: it’s a very competent search engine.
It also ships as part of the Python standard library, so if your machine has Python installed you have a high quality search engine ready to use without installing anything else.
I have a CLI tool (and Python library) for working with it here: https://sqlite-utils.datasette.io/en/stable/cli.html#configu...
Re: SQLite FTS5 Extension
#4Does anyone have successfully worked with Non-English text with FTS5 in Sqlite? I could not find any reference for German, e.g. and the default stemming does not seem to work properly (given some short tests).
Re: SQLite FTS5 Extension
#5This is hugely underrated in my opinion: it’s a very competent search engine. It also ships as part of the Python standard library, so if your machine has Python installed you have a high quality search engine ready to use without installing anything else. I have a CLI tool (and Python library) for working with it here: https://sqlite-utils.datasette.io/en/stable/cli.html#configu...
though useless for many non english languages
Re: SQLite FTS5 Extension
#6Does anyone have successfully worked with Non-English text with FTS5 in Sqlite? I could not find any reference for German, e.g. and the default stemming does not seem to work properly (given some short tests).
Not that I tried it, but this problem seems to be related: https://stackoverflow.com/questions/45681645/how-to-enable-f...
Just that you would need to tokenize the right characters for your target language (e.g. ÜüÖöÄäßẞ¹), maybe those are already included in Unicode61.
¹: Yeah there is now a capital Eszett
Re: SQLite FTS5 Extension
#7This is hugely underrated in my opinion: it’s a very competent search engine. It also ships as part of the Python standard library, so if your machine has Python installed you have a high quality search engine ready to use without installing anything else. I have a CLI tool (and Python library) for working with it here: https://sqlite-utils.datasette.io/en/stable/cli.html#configu...
On a lark I used this to build a local-first code search tool for my organisation. Of course I used datasette for running the queries.
Other than getting all my git access revoked and receiving a very concerned email from our security team, it was a great project.
Re: SQLite FTS5 Extension
#8It's a very useful feature of sqlite and it also works great in-browser using wa-sqlite[0]. Example, if anyone's curious [1]. [0]: https://github.com/rhashimoto/wa-sqlite [1]: https://github.com/iansinnott/prompta/blob/master/src/lib/mi...
I'd go as far as claiming that the WASM port of SQLite with FTS5 enabled makes SQLite the best general purpose client-side search engine currently on the market. And with the option to further customize it with custom tokenizers and auxilliary functions, you can do pretty advanced stuff with it, rivalling Lucene (not completely though, e.g. FTS5 does not store offsets, so highlighting is more expensive than in Lucene).
Re: SQLite FTS5 Extension
#9Can you do fuzzy search with it?
Re: SQLite FTS5 Extension
#10This is hugely underrated in my opinion: it’s a very competent search engine. It also ships as part of the Python standard library, so if your machine has Python installed you have a high quality search engine ready to use without installing anything else. I have a CLI tool (and Python library) for working with it here: https://sqlite-utils.datasette.io/en/stable/cli.html#configu...
though useless for many non english languages
[flagged]