Live data from Hacker News

Show HN: Postgres extension for BM25 relevance-ranked full-text search

github.com

11–20 of 75 posts

Re: Show HN: Postgres extension for BM25 relevance-ranked full-text search

#12

> ParadeDB, is guarded behind AGPL What a wonderful ad for ParadeDB, and clear signal that "TigerData" is a pernicious entity.

You: > "TigerData" is a pernicious entity TigerData: > pg_textsearch v1.0 is freely available via open source (Postgres license) They deemed AGPL untenable for their business and decided to create an OSS solution that used a license they were comfortable with and they are somehow "pernicious"? Perhaps take a moment to reflect on your characterization of a group that just contributed an alternative OSS project for a s…

[flagged]

Re: Show HN: Postgres extension for BM25 relevance-ranked full-text search

#15
post #14

[flagged]

Yep, there are numbers in the blog post and repo. We are able to index MS-MARCO v2 (138M documents, around 50GB of raw data) in a bit under 18 minutes.

For 2M scale dataset, you should be able to index in about 1 minute on low-end hardware. See the MS-MARCO v1 (8M documents) numbers, measured on cheap Github runners.

Re: Show HN: Postgres extension for BM25 relevance-ranked full-text search

#18

Very exciting! Congrats on the release, this will be a huge benefit to all folks building RAG/rerank systems on top of Postgres. Looking forward to testing it out myself.

This is pretty much my case right now. BM25 is so useful in many cases and having with with postgres is neat!
Post reply on HN