Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Databricks response to Snowflake's accusation of lacking integrity

databricks.com

Post reply on HN
Print view View original

11–20 of 168 posts

Re: Databricks response to Snowflake's accusation of lacking integrity

#11

Post by __MatrixMan__ »

Instead of blog posts written but experts in app A based on their experience with app B, I wish there were a platform for this kind of comparison.

Some objective third party sets the goal and then each company submits automation (selenium?) that configures their own app to achieve the goal. Entrants are scored by:

- time

- storage

- compute

- config complexity

No need to waste time making your opponent look bad, just focus on making your self look good, and do it on a level playing field.

Re: Databricks response to Snowflake's accusation of lacking integrity

#12

Post by tyingq »

falaki wrote: post #3

tl;dr: The data warehouse company used a pre-baked TPC-DS dataset and claimed they have similar performance to Databricks. Turns out if you use the official TPC-DS data generation scripts, you get much worse performance.

I read the original post, the Snowflake response, and this. From that I gather that both of them aren't being completely honest or fair when making comparisons. A fair amount of truth, but also some clever wording and omission on both their parts. Which is not surprising or particularly new in this space :)

Re: Databricks response to Snowflake's accusation of lacking integrity

#13

Post by paxys »

avip wrote: post #6

I've used both products in production. Both are good++. The blog wars seem extremely ridiculous to me. I don't recall ever choosing one over another based on how fast it runs on some imaginary arbitrary dataset.

Manufactured rivalries can be a great thing for business. We have been debating Coke vs Pepsi, Nike vs Reebok, McDonald's vs Burger King for decades now while these companies laugh all the way to the bank.

Re: Databricks response to Snowflake's accusation of lacking integrity

#14

Post by rxin »

__MatrixMan__ wrote: post #11

Instead of blog posts written but experts in app A based on their experience with app B, I wish there were a platform for this kind of comparison. Some objective third party sets the goal and then each company submits automation (selenium?) that configures their own app to achieve the goal. Entrants are scored by: - time - storage - compute - config complexity No need to waste time making your opponent look bad, just…

Isn’t that what the official TPC does?

Re: Databricks response to Snowflake's accusation of lacking integrity

#15

Post by slownews45 »

falaki wrote: post #3

tl;dr: The data warehouse company used a pre-baked TPC-DS dataset and claimed they have similar performance to Databricks. Turns out if you use the official TPC-DS data generation scripts, you get much worse performance.

Even worse, they claimed to have similar performance to Databricks AND claimed databricks "lacked integrity". WOW, talk about chutzpah!

Re: Databricks response to Snowflake's accusation of lacking integrity

#18

Post by slownews45 »

tyingq wrote: post #12
falaki wrote: post #3

tl;dr: The data warehouse company used a pre-baked TPC-DS dataset and claimed they have similar performance to Databricks. Turns out if you use the official TPC-DS data generation scripts, you get much worse performance.

I read the original post, the Snowflake response, and this. From that I gather that both of them aren't being completely honest or fair when making comparisons. A fair amount of truth, but also some clever wording and omission on both their parts. Which is not surprising or particularly new in this space :)

Databricks results are available at tpc.org [1]

Snowflake has shown NOTHING close to this.

[1] http://tpc.org/results/fdr/tpcds/databricks~tpcds~100000~dat...

Re: Databricks response to Snowflake's accusation of lacking integrity

#20

Post by falaki »

__MatrixMan__ wrote: post #11

Instead of blog posts written but experts in app A based on their experience with app B, I wish there were a platform for this kind of comparison. Some objective third party sets the goal and then each company submits automation (selenium?) that configures their own app to achieve the goal. Entrants are scored by: - time - storage - compute - config complexity No need to waste time making your opponent look bad, just…

That is exactly the role of tpc.org.
Post reply on HN