ClickHouse, a column-oriented DBMS to generate analytical reports in real time

#1

Post by jinqueeny » Sat, Sep 29, 2018, 11:18 AM UTC

ClickHouse, a column-oriented DBMS to generate analytical reports in real time
github.com

Re: ClickHouse, a column-oriented DBMS to generate analytical reports in real time

#2

Post by dang » Sun, Sep 30, 2018, 7:19 AM UTC

Discussion from a couple years ago: https://news.ycombinator.com/item?id=11908254

Re: ClickHouse, a column-oriented DBMS to generate analytical reports in real time

#3

Post by lykr0n » Sun, Sep 30, 2018, 11:26 PM UTC

Clickhouse has some weird quirks when you think of it as a SQL Database, but its astounding to use it. It's faster than one would think, it can do some really cool data modeling, and provides a wealth of features for the average user out of the box.

The most important thing, and the thing that makes it attractive to me is that it is almost stupidly simple to setup and get running. It's quite simple (when you wrap your head around it) to do sharding or replication and scale up. The zookeeper stuff takes a bit more effort, but most of that is due to zookeeper and not ClickHouse.

Re: ClickHouse, a column-oriented DBMS to generate analytical reports in real time

#4

Post by gary__ » Mon, Oct 01, 2018, 12:11 AM UTC

lykr0n wrote: post #3

Clickhouse has some weird quirks when you think of it as a SQL Database, but its astounding to use it. It's faster than one would think, it can do some really cool data modeling, and provides a wealth of features for the average user out of the box. The most important thing, and the thing that makes it attractive to me is that it is almost stupidly simple to setup and get running. It's quite simple (when you wrap you…

A look through the below does highlight some of its differences with a standard sql database.

https://www.slideshare.net/Altinity/migration-to-clickhouse-...

Year on now, perhaps things have changed.

Re: ClickHouse, a column-oriented DBMS to generate analytical reports in real time

#5

Post by dorfsmay » Mon, Oct 01, 2018, 12:18 AM UTC

Can it run on a cluster? Or single server only?

Can you update specific rows? How fast are updates?

How does it compare to monetDB.

Re: ClickHouse, a column-oriented DBMS to generate analytical reports in real time

#6

Post by georgewfraser » Mon, Oct 01, 2018, 12:33 AM UTC

The basic techniques for implementing a fast column-store data warehouse have been well-known for 10 years. There are several excellent commercial and open-source implementations of these techniques:

    - BigQuery
    - Snowflake
    - Redshift
    - Presto

ClickHouse is not one of them. It doesn't have:

    - Transactions
    - Distributed joins
    - Separate compute from storage
    - UPDATE
    - User management

I don't mean to be a jerk, I'm just trying to save people some time. Columnar DBs is well-trod territory and ClickHouse is way behind.

Re: ClickHouse, a column-oriented DBMS to generate analytical reports in real time

#7

Post by bretthoerner » Mon, Oct 01, 2018, 12:58 AM UTC

georgewfraser wrote: post #6

The basic techniques for implementing a fast column-store data warehouse have been well-known for 10 years. There are several excellent commercial and open-source implementations of these techniques: - BigQuery - Snowflake - Redshift - Presto ClickHouse is not one of them. It doesn't have: - Transactions - Distributed joins - Separate compute from storage - UPDATE - User management I don't mean to be a jerk, I'm just…

ClickHouse stable has both UPDATE and DELETE.

Re: ClickHouse, a column-oriented DBMS to generate analytical reports in real time

#8

Post by ehfeng » Mon, Oct 01, 2018, 1:18 AM UTC

georgewfraser wrote: post #6

The basic techniques for implementing a fast column-store data warehouse have been well-known for 10 years. There are several excellent commercial and open-source implementations of these techniques: - BigQuery - Snowflake - Redshift - Presto ClickHouse is not one of them. It doesn't have: - Transactions - Distributed joins - Separate compute from storage - UPDATE - User management I don't mean to be a jerk, I'm just…

I wouldn't call Redshift "excellent", nor would I call ClickHouse "way behind". ClickHouse was the best choice for my last employer's use case (https://twitter.com/zeeg/status/987009550501928960), after many other solutions were tested and benchmarked.

Just because a tool doesn't have a specific feature checklist doesn't mean you should categorically rule it out, particularly if you don't have experience using/running/deploying it.

Re: ClickHouse, a column-oriented DBMS to generate analytical reports in real time

#9

Post by ehfeng » Mon, Oct 01, 2018, 1:18 AM UTC

bretthoerner wrote: post #7

georgewfraser wrote: post #6

The basic techniques for implementing a fast column-store data warehouse have been well-known for 10 years. There are several excellent commercial and open-source implementations of these techniques: - BigQuery - Snowflake - Redshift - Presto ClickHouse is not one of them. It doesn't have: - Transactions - Distributed joins - Separate compute from storage - UPDATE - User management I don't mean to be a jerk, I'm just…

ClickHouse stable has both UPDATE and DELETE.

Hi Brett

Re: ClickHouse, a column-oriented DBMS to generate analytical reports in real time

#10

Post by mamcx » Mon, Oct 01, 2018, 2:10 AM UTC

georgewfraser wrote: post #6

The basic techniques for implementing a fast column-store data warehouse have been well-known for 10 years. There are several excellent commercial and open-source implementations of these techniques: - BigQuery - Snowflake - Redshift - Presto ClickHouse is not one of them. It doesn't have: - Transactions - Distributed joins - Separate compute from storage - UPDATE - User management I don't mean to be a jerk, I'm just…

> The basic techniques for implementing a fast column-store

Pointers to what them are?