Live data from Hacker News

ScyllaDB is Moving to a New Replication Algorithm: Tablets

scylladb.com

21–27 of 27 posts

Re: ScyllaDB is Moving to a New Replication Algorithm: Tablets

#21
post #7

Earlier quoted context omitted.

How so? Mind saying more?

I suppose that they are saying that CockroachDB is a single binary which you just drop on a machine and you are good to go. For ScyllaDB you need to install Java, Python and several ScyllaDB related packages.

I think you may be confusing ScyllaDB with Cassandra.

Re: ScyllaDB is Moving to a New Replication Algorithm: Tablets

#23
post #16

This is the right move for Scylla. Overall, looks similar to YugabyteDB that distirbutes data by sharding tables into tablets as well. The cluster monitors the cluster size (number of nodes) and the size of each tablet (data volume), and adds new tablets or re-shards large ones automatically: https://docs.yugabyte.com/preview/architecture/docdb-shardin...

"can i copy your homework" "yeah but change it a bit" (compared to the other comment that looks nearly identical, looks lik yugabyte sent some people in here)

Re: ScyllaDB is Moving to a New Replication Algorithm: Tablets

#24
post #19
post #13

Earlier quoted context omitted.

The load shifting part is similar to the way BigTable splits, merges, and assigns tablets. But the rest of it is not related, because BigTable does not try to offer mutation consistency across replicas. If you write to one replica of a BigTable, your mutation may be read at some other replica, after an undefined delay. Applications that need stronger consistency features must layer their own replication scheme atop B…

I don't understand this comment. Bigtable requires that each tablet is only assigned to one tablet server at a time, enforced in Chubby. There's no risk of inconsistent reads. Of course this means that there can be downtime when a tablet server goes down, until a replacement tablet server is ready to serve requests.

Right, the contrast I was trying to draw was between what they depict, where multiple nodes are holding a replica of the tablet and performing synchronous replication between themselves, and what BigTable would do, which is to have the entire table copied elsewhere, with mutation log shipping. What they are doing is more analogous to how Spanner would do replication.

Re: ScyllaDB is Moving to a New Replication Algorithm: Tablets

#25
post #15

[flagged]

"can i copy your homework" "yeah but change it a bit" (compared to the other comment that looks nearly identical, looks lik yugabyte sent some people in here)

Yeah sry about that, they gave us an expired GPT4 key so we had to reuse the same lines a few times.

Re: ScyllaDB is Moving to a New Replication Algorithm: Tablets

#26
post #24
post #19

Earlier quoted context omitted.

I don't understand this comment. Bigtable requires that each tablet is only assigned to one tablet server at a time, enforced in Chubby. There's no risk of inconsistent reads. Of course this means that there can be downtime when a tablet server goes down, until a replacement tablet server is ready to serve requests.

Right, the contrast I was trying to draw was between what they depict, where multiple nodes are holding a replica of the tablet and performing synchronous replication between themselves, and what BigTable would do, which is to have the entire table copied elsewhere, with mutation log shipping. What they are doing is more analogous to how Spanner would do replication.

Unless you're doing multi-cluster replication, there is no log shipping in BigTable: the data replication within a cluster is taken care of by the underlying filesystems.

Single-cluster BigTable is strongly consistent.

Re: ScyllaDB is Moving to a New Replication Algorithm: Tablets

#27
post #19
post #13

Earlier quoted context omitted.

The load shifting part is similar to the way BigTable splits, merges, and assigns tablets. But the rest of it is not related, because BigTable does not try to offer mutation consistency across replicas. If you write to one replica of a BigTable, your mutation may be read at some other replica, after an undefined delay. Applications that need stronger consistency features must layer their own replication scheme atop B…

I don't understand this comment. Bigtable requires that each tablet is only assigned to one tablet server at a time, enforced in Chubby. There's no risk of inconsistent reads. Of course this means that there can be downtime when a tablet server goes down, until a replacement tablet server is ready to serve requests.

There can be consistency issue if you run multi-cluster BigTable, because multi-cluster replication is asynchronous.
Post reply on HN