Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Is ClickHouse Moving Away from Open Source?

altinity.com

Post reply on HN
Print view View original

41–50 of 70 posts

Re: Is ClickHouse Moving Away from Open Source?

#41

Post by jabart »

unamedrus wrote: post #37
jabart wrote: post #36

Clickhouse open source and cloud user. My understanding is that the cloud version uses S3. Which would mean that they have very specific tenant pattern and code to run that version. This may be why lightweight work a specific way in that environment, or they need a way to test it at scale that would be hard through a feature flag in the open source product. Lightweight deletes were released to both, and previous road…

> Lightweight deletes were released to both Because they were contributed by community member, not ClickHouse Inc core team. https://github.com/ClickHouse/ClickHouse/pull/37893

Commits show both, yes a community member kicked things over with the initial PR and seems like a team effort to get that feature launched.

Re: Is ClickHouse Moving Away from Open Source?

#42

Post by jabart »

hodgesrm wrote: post #39
jabart wrote: post #36

Clickhouse open source and cloud user. My understanding is that the cloud version uses S3. Which would mean that they have very specific tenant pattern and code to run that version. This may be why lightweight work a specific way in that environment, or they need a way to test it at scale that would be hard through a feature flag in the open source product. Lightweight deletes were released to both, and previous road…

> You should be using ReplacingMergeTree if you are doing updates at the current moment. Indeed. Altinity and other community users like ContentSquare made numerous contributions to make it more usable. It's a promising approach to updates at scale and has improved markedly over the last few months. That said you can't currently use RMT very efficiently in S3 because of overall limitations in MergeTree S3 table stora…

Yeah, its the don't treat S3 like a disk issue. I'm looking at S3 only for cold storage but need AWS VPC Gateway Endpoint support for S3 access since we are on-premise.

*Yes you can use a vpc gateway but need public IPs to waste to setup the BGP/IP routes.

Re: Is ClickHouse Moving Away from Open Source?

#45

Post by hodgesrm »

benjaminwootton wrote: post #17

This would be a shame and also a mistake in my opinion. Clickhouse is instantly differentiated from Snowflake, Databricks, BigQuery and RedShift with the open source offering that you can deploy yourself. There are lots of other options but Clickhouse has the most mindshare and is the techies choice. I find myself rooting for them and recommending them for that before you even get into any technical comparison.

ClickHoues is also faster than any of them if you know how to use it properly. It helps if you have some distributed systems background and an intuitive feel for map/reduce.

For example ReplacingMergeTree uses a distributed algorithm to process changes without incurssing excessive INSERT time expense. It's quite elegant.

Re: Is ClickHouse Moving Away from Open Source?

#46

Post by aadant »

benjaminwootton wrote: post #35
lairv wrote: post #15

How do you chose between ClickHouse and DuckDB ? It feels like they solve the same problem

They solve the same problem in that they are OLAP data stores, but that's where the similarity ends. Clickhouse is a centralised OLAP store (like 10s of others) whilst DuckDB is an embedded database that is usually ran in process. What is it about DuckDB and it's strange cult like following? It's nice that it's in process, but then it's an incremental improvement over Pandas. Nice tool and well implemented but I don'…

ClickHouse power is to have one binary that runs anywhere :

- local - server - cloud (*) - serverless - in-process https://github.com/chdb-io/chdb similar to DuckDB

(*) except for the forked cloud versions, ClickHouse Inc, Huawei, etc ...

Re: Is ClickHouse Moving Away from Open Source?

#47

Post by PeterZaitsev »

I do not think ClickHouse Inc will Abandon to Open Source, but following current trend it may focus on restricting Innovations to their proprietary cloud only product.

We see it with Oracle (MySQL) where most of innovations is happening in cloud only "Heatwave" or MongoDB where MongoDB Atlas increasingly getting features not available in their Community (SSPL) version

Re: Is ClickHouse Moving Away from Open Source?

#49

Post by hodgesrm »

jabart wrote: post #42
hodgesrm wrote: post #39

Earlier quoted context omitted.

> You should be using ReplacingMergeTree if you are doing updates at the current moment. Indeed. Altinity and other community users like ContentSquare made numerous contributions to make it more usable. It's a promising approach to updates at scale and has improved markedly over the last few months. That said you can't currently use RMT very efficiently in S3 because of overall limitations in MergeTree S3 table stora…

Yeah, its the don't treat S3 like a disk issue. I'm looking at S3 only for cold storage but need AWS VPC Gateway Endpoint support for S3 access since we are on-premise. *Yes you can use a vpc gateway but need public IPs to waste to setup the BGP/IP routes.

What's the "AWS VPC Gateway Endpoint" support you refer to? Do you mean an S3 proxy? If so one of our PRs that just merged may be helpful. [0]

[0] https://github.com/ClickHouse/ClickHouse/pull/51749

Re: Is ClickHouse Moving Away from Open Source?

#50

Post by bitshiftin »

unamedrus wrote: post #30
bitshiftin wrote: post #16

Earlier quoted context omitted.

"forced to do RFCs on GitHub" The author has raised 1 RFC ever. Have you evidence they attemnpted to contribute more in the past? Proposals to form a steering committee? sponsorship? PRs?

Are you part of ClickHouse community, ever used that DBMS or participate in any activity related it? Just to make sure, we are on the same page.

Yes I am part of the community. Yes I have used clickhouse for many years now. Yes I have recommended clickhouse to a number of others and helped them personally get started. I think it's a great piece of technology.
Post reply on HN