Live data from Hacker News

CockroachDB 2.0 Performance Makes Significant Strides

cockroachlabs.com

51–60 of 187 posts

Re: CockroachDB 2.0 Performance Makes Significant Strides

#51
post #31

Before clicking the comments link, I always know what to expect in HN comment section for a CDB post announcing their latest milestone or feature: A lot of congrats and excitement, questions about who uses it in a production environment, very specific use-case questions, and of course the name. Weird how predictable the response to one company/tech always is.

came here to comment on the name.

I came here to upvote comments about the name

Re: CockroachDB 2.0 Performance Makes Significant Strides

#52

Great stuff. I appreciated being educated about TPC-C, and the whole spirit of not focusing on vanity benchmarks!

Same here, but in educating myself more I found that TPC-C seems to be a somewhat obsolete metric compared to TPC-E (see https://stackoverflow.com/questions/9246939/what-is-the-diff... ). Why use the old one here? edit: Looking into it even further, I agree with the co-author's response here that TPC-C is still an appropriate metric. TPC-E is different and newer but still not as widely used.

I don't think it's true to claim that TPC-C is obsolete and subsumed by TPC-E. They are both different OLTP benchmarks, with different characteristics. TPC-C is more write heavy, TPC-E is far more read heavy. It's true that TPC-E is newer, but doesn't deprecate TPC-C (the way TPC-A, for instance, is now deprecated).

We chose TPC-C because it's far more understood than TPC-E in 2018. We wanted to provide understandable benchmarks that can be put into context with other databases. Other databases report TPC-C numbers, so we choose to do so as well.

Re: CockroachDB 2.0 Performance Makes Significant Strides

#54

Earlier quoted context omitted.

We use Citus and Memsql (big data analytics use cases). How does Cockroach handle joins and other OLAP style queries?

You're not going to get better performance for OLAP than MemSQL's columnstore and in-memory rowstore for reference tables to join. Citus is great if you want the Postgres interface but is still using standard rowstore tables. CockroachDB is similar with rowstore performance but with added distributed consensus overhead. They are both much better for OLTP and sharding. CockroachDB also provides easy high-availability…

kdb+?

Re: CockroachDB 2.0 Performance Makes Significant Strides

#56

I will not use this product based on it's name alone, it give me jeepers. Petty? Damn straight it's petty. Doesn't make it less real though.

Came here to say the same! I am sorry but this name alone prevents me from exploring this product. Whoever chose that has probably never encountered a cockroach....flying.

Re: CockroachDB 2.0 Performance Makes Significant Strides

#59
post #22

How is this meaningful without detailed setup description? http://www.tpc.org/tpcc/results/tpcc_results.asp?print=false... Looking at this list of results one wonders what those results actually mean?

I think you can still drive some insights. I clicked on the TPC-C results you shared and read their executive summaries.

The Oracle on SPARC cluster (at the top, 2010) performs 30.2M qualified tx/min vs the 16K tx/min in this blog post. The Oracle cluster also costs $30M, which is clearly higher than the Cockroach cluster's cost.

That said, the TPC-C benchmark is new to me. Happy to update this comment if I'm misreading the numbers.

(Edited to incorporate the reply below.)

Re: CockroachDB 2.0 Performance Makes Significant Strides

#60
post #59
post #22

How is this meaningful without detailed setup description? http://www.tpc.org/tpcc/results/tpcc_results.asp?print=false... Looking at this list of results one wonders what those results actually mean?

I think you can still drive some insights. I clicked on the TPC-C results you shared and read their executive summaries. The Oracle on SPARC cluster (at the top, 2010) performs 30.2M qualified tx/min vs the 16K tx/min in this blog post. The Oracle cluster also costs $30M, which is clearly higher than the Cockroach cluster's cost. That said, the TPC-C benchmark is new to me. Happy to update this comment if I'm misread…

A short note that the total cost of that SPARC cluster was $30 million. You're not misreading those numbers, but it requires a little context.

We're focusing today on our improvements over CockroachDB 1.1, using a small-ish cluster. We'll be showing some more scalability with larger clusters in the coming weeks. If you've found CockroachDB performance slow in the past, you will be pleasantly surprised with this release!

Post reply on HN