Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ten years of ClickHouse in open source

clickhouse.com

Post reply on HN
Print view View original

101–110 of 110 posts

Re: Ten years of ClickHouse in open source

#101

Post by dmurray »

aetherspawn wrote: post #78
KebabCase wrote: post #33

Earlier quoted context omitted.

[flagged]

My country literally has sanctions on your country. If I do any projects with you, I’ll pay a fine of $200K and go to jail for up to 10 years. It’s not racism, it’s just caution. That’s sad because I’ve always wanted to visit Russia and from the outside it looks like a really interesting place. Now, if you could change your government to one that listens to the European Court of Human Rights (namely: don’t start rand…

Does your country sanction all other countries that start "random wars", or just Russia?

Re: Ten years of ClickHouse in open source

#102

Post by dmurray »

benjamkovi wrote: post #17
lazyasciiart wrote: post #12

> You can open a pull request as an experiment, without aiming for it to be merged - it will be tested with the same level of scrutiny as production releases. Found a new memory allocator, a new compression library, a new hash table, a data format, or a sorting algorithm? - bring it to ClickHouse, and it will expose it inside-out Wow

ClickHouse dev here, but this is true. ClickHouse contributed finding several bugs on our third-party libs (jemalloc, librdkafka for 100%, there much more, but I only worked on these), in linux kernel and basically everywhere. We have very rigorous fuzzers (yes, multiple fuzzers on multiple levels), running tests in insane number of configurations. I think the last number I heard a year ago is around 400 hours for a…

Does it ever get abused?

"This PR introduces the ability for Clickhouse to mine Bitcoin...":

Re: Ten years of ClickHouse in open source

#103

Post by saisrirampur »

cpursley wrote: post #93
philippemnoel wrote: post #76

Earlier quoted context omitted.

There is significant work happening in the PostgreSQL ecosystem to make "use a single system to run everything" possible. ParadeDB is one such system pushing on full-text/vector search, with some light aggregations, at the index level. There is also work being done by DuckDB folks with pg_duckdb and others like Xata. (disclaimer: I work at ParadeDB)

What’s the closest extension or tooling that provides functionality similar to ClickHouse? I’m looking for something like that before making the full jump and adding another dependency.

You should check this message that talks about everything we are doing to make adoption of ClickHouse with Postgres easy. It captures all the tools we’ve released and are actively working on.

https://news.ycombinator.com/item?id=48599644

Re: Ten years of ClickHouse in open source

#104

Post by zX41ZdbW »

dmurray wrote: post #102
benjamkovi wrote: post #17

Earlier quoted context omitted.

ClickHouse dev here, but this is true. ClickHouse contributed finding several bugs on our third-party libs (jemalloc, librdkafka for 100%, there much more, but I only worked on these), in linux kernel and basically everywhere. We have very rigorous fuzzers (yes, multiple fuzzers on multiple levels), running tests in insane number of configurations. I think the last number I heard a year ago is around 400 hours for a…

Does it ever get abused? "This PR introduces the ability for Clickhouse to mine Bitcoin...":

The CI only runs after one of the maintainers adds a "can be tested" label. When the label is already added, it stops when any of the infrastructure-related files are modified, like Dockerfile, CI configurations, etc. This is quite ok, but not 100% bulletproof, as you can easily do weird things by modifying the code or using a bug in the compiler. However, the CI infrastructure runs on isolated machines inside an isolated account.

Before adding the label, we have to check the diff for suspicious things. There were a few abuse attempts (all of them were from now vanished GitHub accounts).

Re: Ten years of ClickHouse in open source

#105

Post by zX41ZdbW »

zX41ZdbW wrote: post #104
dmurray wrote: post #102

Earlier quoted context omitted.

Does it ever get abused? "This PR introduces the ability for Clickhouse to mine Bitcoin...":

The CI only runs after one of the maintainers adds a "can be tested" label. When the label is already added, it stops when any of the infrastructure-related files are modified, like Dockerfile, CI configurations, etc. This is quite ok, but not 100% bulletproof, as you can easily do weird things by modifying the code or using a bug in the compiler. However, the CI infrastructure runs on isolated machines inside an iso…

Found one example that survived, and it was legitimate: https://github.com/ClickHouse/ClickHouse/pull/99522/changes

Re: Ten years of ClickHouse in open source

#106

Post by kjuulh »

mscdex wrote: post #97
kjuulh wrote: post #75

Love clickhouse it is just super performant. I've had to tweak a few queries for performance here and there but it has been more than stellar. I'd initially set up a real time pipeline ingest for us to handle our larger incremental ingests when i started (used redshift in the past, very expensive and quite slow in comparison), it has been unnecessary so far, as clickhouse has just been able to chew through tons of da…

What "heavy handed tracing" was turned on by default?

Cant quite remember, sadly, i followed a post about it. Might have been this one https://kb.altinity.com/altinity-kb-setup-and-maintenance/al....

It drastically reduced our cpu usage and disk as well. At this point it was on a small t3 on aws

Re: Ten years of ClickHouse in open source

#107

Post by amazingman »

throw-the-towel wrote: post #48
budsniffer952 wrote: post #34

Earlier quoted context omitted.

> ask a random stranger on the street if he's racist, and he will honestly say no, even if he actually simply does not realize it My lord you people are beyond patronizing. When people refer to "the Chinese" or "the Russians", we are taking about the nation state, not the people. And there are legitimate security concerns. Whether we should be adversial is another question. But we are.

I agree about the legitimate security concerns, but not with "we're talking about the nation state, not the people". If life has taught me anything in the last few years, it's that normies are incapable of making this distinction, at least in the Old World.

I liked how you othered people as you lamented the human habit of othering people.

Re: Ten years of ClickHouse in open source

#108

Post by aetherspawn »

dmurray wrote: post #101
aetherspawn wrote: post #78

Earlier quoted context omitted.

My country literally has sanctions on your country. If I do any projects with you, I’ll pay a fine of $200K and go to jail for up to 10 years. It’s not racism, it’s just caution. That’s sad because I’ve always wanted to visit Russia and from the outside it looks like a really interesting place. Now, if you could change your government to one that listens to the European Court of Human Rights (namely: don’t start rand…

Does your country sanction all other countries that start "random wars", or just Russia?

Well, we also have sanctions on the Middle East, and we’ve warned China that they will get sanctions if they invade Taiwan.

Maybe we should have sanctions on America, but our politicians are not exactly brave.

Re: Ten years of ClickHouse in open source

#110

Post by mrngm »

kjuulh wrote: post #106
mscdex wrote: post #97

Earlier quoted context omitted.

What "heavy handed tracing" was turned on by default?

Cant quite remember, sadly, i followed a post about it. Might have been this one https://kb.altinity.com/altinity-kb-setup-and-maintenance/al... . It drastically reduced our cpu usage and disk as well. At this point it was on a small t3 on aws

Probably trace_log (we had a similar experience), but you'll only notice with limited storage space, and a regular keen eye on how your database fills up.
Post reply on HN