Rewriting a high performance vector database in Rust
1–10 of 157 posts
Re: Rewriting a high performance vector database in Rust
#2[deleted]
Re: Rewriting a high performance vector database in Rust
#3> First of all, Python is a garbage collected language, which means it can be extremely slow for writing anything high performance at scale.
I don't think garbage collection is in the top 3 causes of why Python is slow.
Re: Rewriting a high performance vector database in Rust
#4rewriting everything in rust is not just a meme?
Re: Rewriting a high performance vector database in Rust
#5Glanced through the article, and I see no comparisons on how performance of the DB is in Rust versus their current C++ implementation, no mention of if maintaining the Rust code is easier than their C++ codebase, no stats on how devs are ramping up and how it's tackling their "hard to find a dev who knows both C++ and Python well" issue.
Re: Rewriting a high performance vector database in Rust
#6rewriting everything in rust is not just a meme?
Memes typically have some basis in reality. If your project reaches a point where it could benefit from fearless concurrency or better memory control, Rust is probably your best bet at the moment.
I could see huge benefits from Kafka and Cassandra being re-written in Rust.
Re: Rewriting a high performance vector database in Rust
#7rewriting everything in rust is not just a meme?
Memes typically have some basis in reality. If your project reaches a point where it could benefit from fearless concurrency or better memory control, Rust is probably your best bet at the moment. I could see huge benefits from Kafka and Cassandra being re-written in Rust.
kafka clone redpanda is written in rust ?
Re: Rewriting a high performance vector database in Rust
#8rewriting everything in rust is not just a meme?
Memes typically have some basis in reality. If your project reaches a point where it could benefit from fearless concurrency or better memory control, Rust is probably your best bet at the moment. I could see huge benefits from Kafka and Cassandra being re-written in Rust.
They are rewritten in C++ already; Redpanda and ScyllaDB, respectively. Why waste the effort of rewriting it once again?
Re: Rewriting a high performance vector database in Rust
#9> As you can see in the above graph, a commit was merged that caused a huge spike. However, with Criterion, an open source benchmarking tool, we were easily able to identify it, mitigate it, and push a fix.
Wonder what the commit was that caused a more than 2x regression and got a fix instead of an undo.
Re: Rewriting a high performance vector database in Rust
#10Earlier quoted context omitted.
Memes typically have some basis in reality. If your project reaches a point where it could benefit from fearless concurrency or better memory control, Rust is probably your best bet at the moment. I could see huge benefits from Kafka and Cassandra being re-written in Rust.
They are rewritten in C++ already; Redpanda and ScyllaDB, respectively. Why waste the effort of rewriting it once again?
C++ isn't better in the ways outlined.
I'm not necessarily advocating it [1] but the parent's claim was that those programs could benefit from memory safety, thread safety and better concurrency and C++ does not deliver along that axis.
[1] https://www.joelonsoftware.com/2000/04/06/things-you-should-...