Live data from Hacker News

Apache Pegasus - A horizontally scalable, high-performance key-value store

github.com

21–30 of 41 posts

Re: Apache Pegasus - A horizontally scalable, high-performance key-value store

#21
post #5
post #4

Why yet another key value store?

KV stores are a complex topic and research continues. Each new tool comes with its own set of trade offs. It would help to go through the documentation.

You could do a million other interesting things academically or commercially before diving into yet another KV store though.

Re: Apache Pegasus - A horizontally scalable, high-performance key-value store

#22
post #5

Earlier quoted context omitted.

KV stores are a complex topic and research continues. Each new tool comes with its own set of trade offs. It would help to go through the documentation.

You could do a million other interesting things academically or commercially before diving into yet another KV store though.

Hard to know what the point is of this line of reasoning. Someone or some company thought it was interesting, so they made it.

Re: Apache Pegasus - A horizontally scalable, high-performance key-value store

#23
post #18

Note that this seems to be a relatively old project, first commits from 2015. The project seems active, but most of the work seems to have been done around its inception, with some significant activity from 2020 onwards. Speculation/interpretation: So this might be a project that was used internally by some company, but perhaps not any more, and they've decided to open-source it at some point (2017-2018?) because som…

Apache foundation is retirement home for projects so it checks out

Re: Apache Pegasus - A horizontally scalable, high-performance key-value store

#26
post #12
post #6

Will be interesting to see the benchmarks! There's a lot of KV engines that uses RocksDB now, like CockroachDB (Forked into PebbleDB though), YugabyteDB and TiDB. Those are all many times slower than Redis though, so having a middle-ground aimed to be similar to Redis, that doesn't eat all RAM, is very exciting!

> Those are all many times slower than Redis though I'd appreciate if there any links/doc that I could look into to learn more about this?

Blog post from antirez http://oldblog.antirez.com/post/redis-persistence-demystifie...

Re: Apache Pegasus - A horizontally scalable, high-performance key-value store

#27
post #14
post #6

Will be interesting to see the benchmarks! There's a lot of KV engines that uses RocksDB now, like CockroachDB (Forked into PebbleDB though), YugabyteDB and TiDB. Those are all many times slower than Redis though, so having a middle-ground aimed to be similar to Redis, that doesn't eat all RAM, is very exciting!

because you are comparing in-memory store with permanent storage. many kvdb can be run from memory if needed.

Technically, all of them can, if you put the "persisted" storage in a directory on a ramfs or tmpfs mount :)

This might seem like a bit of a facetious comment, but it does have genuine use cases, e.g. unit tests, or for data that you can easily restore after a shutdown.

Re: Apache Pegasus - A horizontally scalable, high-performance key-value store

#28
post #7

Is it me or are most of the docs only available in Chinese?

It says it's being translated at the moment.

Looks dead. English docs haven't been touched for 2 years.

https://github.com/apache/incubator-pegasus-website/tree/mas...

Re: Apache Pegasus - A horizontally scalable, high-performance key-value store

#30
post #23
post #18

Note that this seems to be a relatively old project, first commits from 2015. The project seems active, but most of the work seems to have been done around its inception, with some significant activity from 2020 onwards. Speculation/interpretation: So this might be a project that was used internally by some company, but perhaps not any more, and they've decided to open-source it at some point (2017-2018?) because som…

Apache foundation is retirement home for projects so it checks out

I wouldn't say thats accurate. Theres many super successful and active apache projects still. To name a few:

Kafka, Cassandra, Zookeeper, Spark, Tomcat, Superset, Storm, Lucene,Log4j2, Hadoop, etc. The list goes on, but I would safely say that a majority of the world's systems run on Apache projects which are for the most part actively developed

Post reply on HN