Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#1

Post by billwashere » Sun, Oct 08, 2023, 9:43 AM UTC

Pg_bm25: Elastic-Quality Full Text Search Inside Postgres
docs.paradedb.com

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#2

Post by antman » Sun, Oct 08, 2023, 2:25 PM UTC

An important step, could be a good combination with pg_vector if they are fast enough

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#3

Post by mkleczek » Sun, Oct 08, 2023, 2:29 PM UTC

This is really exciting and I hope to try it out at my company ASAP.

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#4

Post by pritambaral » Sun, Oct 08, 2023, 2:34 PM UTC

antman wrote: post #2

An important step, could be a good combination with pg_vector if they are fast enough

I believe the parent project — paradedb — already does that, for their support of HNSW indexes.

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#5

Post by hardwaresofton » Sun, Oct 08, 2023, 2:47 PM UTC

pgrx is one of the greatest enabling innovations in the PG ecosystem in a long time.

Awesome to see so many high quality extensions come out of it.

https://github.com/pgcentralfoundation/pgrx

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#6

Post by aiunboxed » Sun, Oct 08, 2023, 2:56 PM UTC

I wonder how do legacy search players like elastic / solr compete against the new age startups combining semantic and regular search ?

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#7

Post by canadiantim » Sun, Oct 08, 2023, 3:04 PM UTC

ParadeDB and the work they’re doing with this extension is incredibly exciting. Love to see it.

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#8

Post by ntonozzi » Sun, Oct 08, 2023, 3:26 PM UTC

aiunboxed wrote: post #6

I wonder how do legacy search players like elastic / solr compete against the new age startups combining semantic and regular search ?

By adding the features that those new age startups launch: https://www.elastic.co/guide/en/elasticsearch/reference/curr...

Building a classic text search engine is way harder than building a KNN engine, and bolting a KNN engine into a term search engine is easier than the other way around.

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#9

Post by est » Sun, Oct 08, 2023, 3:28 PM UTC

looks like a cool project https://github.com/paradedb/paradedb

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#10

Post by phamilton » Sun, Oct 08, 2023, 3:33 PM UTC

With an AGPL license, does that make it unlikely to be included in hosted environments like RDS?

My understanding of the spirit of the license is that it should be fine as long as modifications are made available. Anyone know of any existing extensions in RDS that are AGPL?