Live data from Hacker News

ScyllaDB Closes $16M in Series B Funding

scylladb.com

71–74 of 74 posts

Re: ScyllaDB Closes $16M in Series B Funding

#71
post #48

Earlier quoted context omitted.

> realtime analytics This doesn't mean anything. The only thing that matters is what (and how much) data you have and what queries you want to run. If a relational database can do that for you then cassandra/scylla isn't a good choice.

> This doesn't mean anything. And neither does your practically trolling comment. You could say that about anything. > The only thing that matters is what (and how much) data you have and what queries you want to run. If a relational database can do that for you then cassandra/scylla isn't a good choice. Theory aside what matters is what I can get to work... so prior knowledge is a big deal. All I said is it would be…

It's not trolling - it's the fact that "realtime analytics" are just buzzwords and don't really mean anything. Analytics is just another word for queries and realtime is different for everyone. You can use anything from some in-memory code to redis to postgres or other exotic databases for this and I've yet to come across a situation where those words have helped provide much clarity.

Cassandra is wide-column (which is just another buzzword for key/value), not columnar (as in storing data in a column-oriented format) so it's actually not great with aggregations and barely supports queries like that. It is good for range scans across data in a single partition and for spreading load around the cluster if your data is also spread evenly into these partitions, but ultimately my point was that in a thread about cassandra/scylla, it doesnt make much sense to bring up a relational db because it's completely different in every way.

If it does work better for you, that's great - and it means is that cassandra/scylla was never a good fit to begin with. The multi-master global replication is a key feature that will likely never be reached by postgres (which is just starting to get scale-up and some logical replication features now) and even mysql only just released the group-replication for multi-master which still only supports the concept of a single total cluster.

Re: ScyllaDB Closes $16M in Series B Funding

#72
post #54
post #37

Congratulations to the team. Any word on native JSON types ? Scylla will have another reason to drop Cassandra.

JSON types are actually not very often requested feature so we have not prioritized it very high. I suspect that's because most people just store their JSON data as text and do processing in their applocation. There's an open issue about it on Github: https://github.com/scylladb/scylla/issues/2058 Please feel free to upvote and comment on the issue to voice your interest in the feature.

Some clarity - that issue is about interfacing with a row within a CQL table as a piece of json, not actually storing a schemaless json document (like in a special postgres-style json datatype).

Cassandra is actually schemaless but since the shift to CQL from Thrift, it's unlikely that it'll go back to a schemaless model again.

In the meantime, the Keen.IO crew has a nice model for storing lots of arbitrary json if that's something thats needed. It takes some work but a very clever strategy and they've made it work well.

Re: ScyllaDB Closes $16M in Series B Funding

#73
post #48

Earlier quoted context omitted.

> This doesn't mean anything. And neither does your practically trolling comment. You could say that about anything. > The only thing that matters is what (and how much) data you have and what queries you want to run. If a relational database can do that for you then cassandra/scylla isn't a good choice. Theory aside what matters is what I can get to work... so prior knowledge is a big deal. All I said is it would be…

It's not trolling - it's the fact that "realtime analytics" are just buzzwords and don't really mean anything. Analytics is just another word for queries and realtime is different for everyone. You can use anything from some in-memory code to redis to postgres or other exotic databases for this and I've yet to come across a situation where those words have helped provide much clarity. Cassandra is wide-column (which…

Perhaps if you had elaborated like you have now I would not have thought it was trolling :)

There is a general consensus what realtime analytics is ( memsql.com apparently tries to define it). It certainly is less nebulous than "big data".

Our biggest problem was continuous aggregates. Continuous aggregates are tough for databases (particularly for Postgres since it is MVCC). So it isn't the relational model that is the problem but the algorithms needed for consistency that conflict with constant read and write speed.

I did goof by saying Cassandra was column oriented (that is a loaded and confusing term) but people do use it all the time for aggregates (see Druid). Druid by the way is apparently column oriented (going back to my point how you can most data stores into something else).

Saying Cassandra is completely different than Postgres isn't really saying something terribly useful. I bring up Postgres not because it is a relational database but because it has some nice features and extensions that seem to be cost effective (compared to just loading everything in memory ala redis which is not cheap).

Cassandra certainly does try to offer familiar things to old school SQL guys like myself (namely CQL and various options for consistency)... again it isn't completely different.

> If it does work better for you, that's great - and it means is that cassandra/scylla was never a good fit to begin with.

You are also assuming some stuff like that we didn't have to compromise. We will still need something like Cassandra as we do want to collect more data points and we do need a place to effectively warehouse this stuff across regions.

Also plain Postgres is not a good choice for continuous aggregates as I mentioned before (again I'm going to ignore theory of the relational model... the relational model fits for us because we make it fit... not the other way around). It was one of the reasons why we investigated other technologies.

> The multi-master global replication is a key feature that will likely never be reached by postgres

I'm sensing some bias here... never... maybe never for postgres core but certainly someone could build an extension or add on.

Re: ScyllaDB Closes $16M in Series B Funding

#74

Earlier quoted context omitted.

This is why I love HN. People give their real-world scenarios. Thank you for recommending pipelinedb, I haven't come across them before. I have kafka and postgres and in need of real-time analytics, this may be the solution I'm looking for. I've used citus in the past, whilst it's excellent for data-warehousing. Unless you scale up the servers, then it's not suitable for real-time counts. I found that lacking for my…

If you need both citus + pipelinedb then memsql.com will solve your problem with a much more polished solution. MySQL dialect instead of PostgreSQL but that's rarely a problem for a data warehouse.

Thanks. I actually have scheduled a demo. In the meantime will download the community version and have a play.
Post reply on HN