Live data from Hacker News

MySQL Cluster 7.2 GA Released, Delivers 1 Billion Queries per Minute

mysql.com

11–20 of 35 posts

Re: MySQL Cluster 7.2 GA Released, Delivers 1 Billion Queries per Minute

#11
post #5

Has anyone here used MySQL Cluster in production?

Yes. And its a pain in the ass. From reading whats new in this release I could care less about AQL but hearing them say you can bring up a whole cluster with one command it shares user permissions between them... that gets me excited!

Re: MySQL Cluster 7.2 GA Released, Delivers 1 Billion Queries per Minute

#12
Definitely an impressive benchmark by any standard. However, there are some things to be aware of:

1) They used Infiniband interconnects. Running on ethernet is likely to yield less impressive results.

2) Their benchmark does simple primary key lookups. If you start doing joins or transactions that need to hit multiple data nodes, things will slow down. Depending on your workload, this may or may not be an issue.

3) NDB is an in-memory storage engine, so you're limited to the aggregate RAM in your cluster for max storage size.

4) AFAIK, MySQL Cluster doesn't re-balance, you need to pre-determine how data is partitioned and changing it at runtime is hard. I don't know if this has changed in the later releases.

Re: MySQL Cluster 7.2 GA Released, Delivers 1 Billion Queries per Minute

#14
post #12

Definitely an impressive benchmark by any standard. However, there are some things to be aware of: 1) They used Infiniband interconnects. Running on ethernet is likely to yield less impressive results. 2) Their benchmark does simple primary key lookups. If you start doing joins or transactions that need to hit multiple data nodes, things will slow down. Depending on your workload, this may or may not be an issue. 3)…

For point #3, NDB has supported on disk non-indexed attributes for a while now (2-3 years?). So you just need to be able to fit indexes in memory which is a much smaller dataset, but still limiting.

I'm sure for the benchmark it was all in memory though.

Re: MySQL Cluster 7.2 GA Released, Delivers 1 Billion Queries per Minute

#15
As a MySQL, Oracle and Clustrix DBA this is very sexy news. Here is the extra info on the benchmark http://mikaelronstrom.blogspot.com/2012/02/105bn-qpm-using-m...

But no info on what disk setup they used. But for every instance node there was a storage node.

Re: MySQL Cluster 7.2 GA Released, Delivers 1 Billion Queries per Minute

#16
post #4

I'm a novice in this area, so looking past the somewhat sensationalist headline (or, perhaps, I'm missing the wit? "Now with 70x more performance!")... Can someone who knows this stuff give a bit of an overview on the significance of this release? I read the NoSQL stuff as Oracle/MySQL trying to compete (at least in terms of marketing-speak) with the wave of competition that's arrived in the DB market. Is there any m…

NDB originally only had a NoSQL interface called NDB API. NDB API is a bit complex and when MySQL acquired them, they added the SQL layer on top of it to make it easier for developers to use it.

This release adds an additional memcache api layer which sits on top of NDB API, so that you can more easily program against it.

Re: MySQL Cluster 7.2 GA Released, Delivers 1 Billion Queries per Minute

#17

When did we go from standard measure of per second for these types of things, you know, requests per second, transactions per second, to per minute? Statistics eh?

For whatever reason, database people have been using transactions per minute for a long time.

Re: MySQL Cluster 7.2 GA Released, Delivers 1 Billion Queries per Minute

#19
post #5

Has anyone here used MySQL Cluster in production?

I'm also very curious to hear real world feedback on this, I've been aware of the option for a while, but never heard much about actual use. Automatic sharding and memcached integration are pretty awesome features, and could definitely ease code at the application level (sharding code is a particularly special pain in the ass, not so much getting it working, but allowing for re-sharding migrations if you decide you n…

It is more suited for realtime transaction processing type activity, not for big data type analytics.

NDB was originally created by and for telecoms. So very high write/read rates with very fast response times and very high availability required. Generally not extremely large datasets.

If you know what you are doing, NDB can work extremely well. It supports all of the highend cluster goodies including online software upgrade, online node addition, automatic handling of node failures, geographic async replication, etc...

However, it certainly has a pretty steep learning curve from the admin point of view and it is a bit easy to mess things up. It is a bit brittle due to this, but once it is setup properly and running, it can deliver on the promises.

Post reply on HN