Please oh please let GCP add this to the supported managed Postgres extensions...
A little birdie told me that efforts are underway to support the extension in Alloy, at least!
Show HN: Postgres extension for BM25 relevance-ranked full-text search
31–40 of 75 posts
Re: Show HN: Postgres extension for BM25 relevance-ranked full-text search
#32I've been doing some RAG prototypes with hybrid search using pg_textsearch plus pgvector and have been very pleased with the results. Happy to see a 1.0 release!
Re: Show HN: Postgres extension for BM25 relevance-ranked full-text search
#33Thank you!! Goodbye manticore if this works.
Re: Show HN: Postgres extension for BM25 relevance-ranked full-text search
#34On a tangent note it’s amazing how hard it is to have a good case-insensitive search in Postgres.
In SQL Server you just use case-insensitive collation (which is a default) and add an index (it’s the only one non-clustered) and call it a day.
In postgres you need to go above and beyond just for that. It’s like postgres guys were “nah dog, everybody just uses lowercase; you don’t need to worry of people writing john doe as John Doe)”.
And don’t get me started with storing datetime with timezone (e.g “4/2/2007 7:23:57 PM -07:00“). In sql server you have datetimeoffset; in Postgres you fuck off :-)
Re: Show HN: Postgres extension for BM25 relevance-ranked full-text search
#35“Just use Postgres” greybeards right again.
Looking forward to giving this a go soon
Re: Show HN: Postgres extension for BM25 relevance-ranked full-text search
#36Earlier quoted context omitted.
I actually don't love this example either, for the reasons you mention, but at some point we had questions about how to filter based on numeric ranking. Thanks for the reminder to revisit this. Re filtering, there are often reasonable workarounds in the SQL context that caused me to deprioritize this for GA. With your example, the workaround is to apply post-filtering to select just matches with all desired terms. Th…
While we’re talking about filtering — is there a way to set a WHERE clause when you’re setting up the index? I’ve been working on this a lot recently for a hybrid vector search in pg. One of the things that I’m running up against is setting a good BM25 index for a subset of a table (the where clause). I have a document subsets with very different word frequencies, so I’m trying to make sure that the search works on a…
[dead]
Re: Show HN: Postgres extension for BM25 relevance-ranked full-text search
#37Re: Show HN: Postgres extension for BM25 relevance-ranked full-text search
#38I hope someone from Neon is watching this thread, definitely want to play with this asap
Re: Show HN: Postgres extension for BM25 relevance-ranked full-text search
#39[dead]
Re: Show HN: Postgres extension for BM25 relevance-ranked full-text search
#40I've been doing some RAG prototypes with hybrid search using pg_textsearch plus pgvector and have been very pleased with the results. Happy to see a 1.0 release!
Do you have LongMemEval numbers for pgvector vs pgvector+ hybrid search?