Live data from Hacker News

Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

docs.paradedb.com

11–20 of 72 posts

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#11

I wonder how do legacy search players like elastic / solr compete against the new age startups combining semantic and regular search ?

Reading "legacy" near "elastic" make me feel a little bit old :D :D

BTW, if you are one of the leaders of the market, you don't need to continuously improve, just wait and let your competitors do the research job and implement only when the feature is mature.

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#12

I wonder how do legacy search players like elastic / solr compete against the new age startups combining semantic and regular search ?

Who is the competition besides Algolia? Last I checked most of the competition is either very expensive or very feature limited compared to Elastic/Solr.

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#13
post #11

I wonder how do legacy search players like elastic / solr compete against the new age startups combining semantic and regular search ?

Reading "legacy" near "elastic" make me feel a little bit old :D :D BTW, if you are one of the leaders of the market, you don't need to continuously improve, just wait and let your competitors do the research job and implement only when the feature is mature.

:D :D

Sorry my question was on the basis of the quality of the results, simply put .. how does players who have good semantic search turn out against "legacy" players who had good text search

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#14
post #12

I wonder how do legacy search players like elastic / solr compete against the new age startups combining semantic and regular search ?

Who is the competition besides Algolia? Last I checked most of the competition is either very expensive or very feature limited compared to Elastic/Solr.

I think pretty much all the companies who provide vector search are indirect competitors

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#15

I wonder how do legacy search players like elastic / solr compete against the new age startups combining semantic and regular search ?

Lots of reasons:

1) switching search engines is hard when you’ve built your information needs around one. I’ve led lots of search engine migrations and they’re not fun. I even gave a talk on the problems companies face when doing so. https://haystackconf.com/us2020/search-migration-circus/

2) lots of the new search startups don’t offer full feature coverage. So just because a company is the new hotness it doesn’t mean it can fill the need of someone entrenched in Solr/elastic

3) why risk going to a startup when they haven’t proven they’ll be around in 3 to 5 years?

4) incumbent search engines eventually catch up at the speed of the enterprise market. Why spend a year migrating when the engine your using will implement the feature for you within that timeframe?

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#16

With an AGPL license, does that make it unlikely to be included in hosted environments like RDS? My understanding of the spirit of the license is that it should be fine as long as modifications are made available. Anyone know of any existing extensions in RDS that are AGPL?

I forget, does AWS let you use custom extensions from pgrx?

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#17

With an AGPL license, does that make it unlikely to be included in hosted environments like RDS? My understanding of the spirit of the license is that it should be fine as long as modifications are made available. Anyone know of any existing extensions in RDS that are AGPL?

See who made pg_bm25 - vendor of database based on PostgreSQL. Most likely they would like offer that as hosted solution itself, so they attempt avoid Elasticsearch / Terraform-like drama using AGPL license from beginning.

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#18
post #16

With an AGPL license, does that make it unlikely to be included in hosted environments like RDS? My understanding of the spirit of the license is that it should be fine as long as modifications are made available. Anyone know of any existing extensions in RDS that are AGPL?

I forget, does AWS let you use custom extensions from pgrx?

No, they allow use Rust for custom functions (alternatively to PL/SQL) only.

Re: Pg_bm25: Elastic-Quality Full Text Search Inside Postgres

#19

With an AGPL license, does that make it unlikely to be included in hosted environments like RDS? My understanding of the spirit of the license is that it should be fine as long as modifications are made available. Anyone know of any existing extensions in RDS that are AGPL?

Related question, could it be possible that at some point postgresql natively implements that algorithm ? Or as there is already an extension doing it , regardless of the licence , it is unlikely that patches in that direction will be accepted ?
Post reply on HN