Vector search just got up to 10x faster and vertically scalable
1–10 of 54 posts
Re: Vector search just got up to 10x faster and vertically scalable
#2For anyone interested in the code walkthrough: https://www.pinecone.io/learn/testing-p2-collections-scaling...
Re: Vector search just got up to 10x faster and vertically scalable
#3No post body was provided.
Re: Vector search just got up to 10x faster and vertically scalable
#4Side tangent: Pinecone pods seem to cost 15.625% more per hour on AWS compared to GCP.
All the instance types hide away the price differences usually, so this is interesting to see.
Edit: also there is no free tier for Pinecone on AWS :(
Re: Vector search just got up to 10x faster and vertically scalable
#5Quoted post unavailable.
[deleted]
Re: Vector search just got up to 10x faster and vertically scalable
#6Side tangent: Pinecone pods seem to cost 15.625% more per hour on AWS compared to GCP. All the instance types hide away the price differences usually, so this is interesting to see. Edit: also there is no free tier for Pinecone on AWS :(
[deleted]
Re: Vector search just got up to 10x faster and vertically scalable
#7No post body was provided.
Re: Vector search just got up to 10x faster and vertically scalable
#8Quoted post unavailable.
If you really think that's enough to build a real product, go for it.
Even open-source companies (Elastic, Mongo, Scylla) have to build tons of infra around their core codebase in order to make it an actual cloud product.
Re: Vector search just got up to 10x faster and vertically scalable
#9Quoted post unavailable.
Which open source libraries is pinecone wrapping?
Re: Vector search just got up to 10x faster and vertically scalable
#10I don't understand the emphasis here on vertical scaling. Move a database to a bigger machine = more storage and faster querying. Not exactly rocket science. Horizontal scaling is the real challenge here, and the complexity of vector indexes makes it especially challenging. Milvus and Vertex AI both have horizontal scaling ANN search and the ability to do parallel indexing as well. I appreciate the post but this doesn't seem worthy of an announcement.