Live data from Hacker News

Snowflake’s response to Databricks’ TPC-DS post

snowflake.com

1–10 of 111 posts

Re: Snowflake’s response to Databricks’ TPC-DS post

#2
Personally I think it’s a great response and very well written. I didn’t jump on the congrats-Databricks wagon when the result first came out because of the weird front page comparison against snowflake. Both companies are doing great work. Focusing on building a better product for your customer is much more meaningful than making your competitor look bad.

Re: Snowflake’s response to Databricks’ TPC-DS post

#7
post #6

Databricks broke the record by 2x) and is 10x more cost effective, in an audited benchmark. Snowflake should participate in the official, audited benchmark. Customers win when businesses are open and transparent…

Audited how? If you look at the Snowflake response the numbers being posted by Databricks look outright faked or otherwise false.

Re: Snowflake’s response to Databricks’ TPC-DS post

#8
post #6

Databricks broke the record by 2x) and is 10x more cost effective, in an audited benchmark. Snowflake should participate in the official, audited benchmark. Customers win when businesses are open and transparent…

Audited how? If you look at the Snowflake response the numbers being posted by Databricks look outright faked or otherwise false.

Hey jiggawatts - TPC is the official way to audit benchmarks in the database industry. They’ve been around for a bit, but let me know if you want more info, I’m happy to share more about them.

Re: Snowflake’s response to Databricks’ TPC-DS post

#9
post #6

Databricks broke the record by 2x) and is 10x more cost effective, in an audited benchmark. Snowflake should participate in the official, audited benchmark. Customers win when businesses are open and transparent…

Audited how? If you look at the Snowflake response the numbers being posted by Databricks look outright faked or otherwise false.

The results are so crazy different that either Snowflake or Databricks are wrong or outright lying.

Re: Snowflake’s response to Databricks’ TPC-DS post

#10
post #8

Earlier quoted context omitted.

Audited how? If you look at the Snowflake response the numbers being posted by Databricks look outright faked or otherwise false.

Hey jiggawatts - TPC is the official way to audit benchmarks in the database industry. They’ve been around for a bit, but let me know if you want more info, I’m happy to share more about them.

It sounds fundamentally busted if a competitor can submit benchmarks for someone else. TPC is great in general, but I didn't realize it had such a gaping flaw.

TPC submissions take real time/$/energy/expertise, so I don't know anyone who has ever done it casually. Ex: It was a multi-company effort for the RAPIDS community to get enough API coverage & edge case optimization for an end-to-end GPU submission on the big data one (SQL, ...), and even there the TPC folks made them resubmit if I remember right.

Also, note how the parent's response did not actually answer 'audited how'. Pushing the work to the questioner is on the shortlist of techniques studied by misinformation researchers. I'm a fan of both companies, so disappointing to see from a company rep.

Post reply on HN