11–20 of 58 posts
Earlier quoted context omitted.
> tosh submits 10-20 articles a day That’s kinda sad
I didn't know HN allows someone to posts that much. This would be a full-time job for a person. Hidden motives?
I'm currently experimenting with Clickhouse, because my dataflow is increasing in size (40M rows right now, doubling every month or so) and my current setup (MongoDB) is at its limits. I would like to migrate the 40M rows to CH, but I also need the metadata for the rows to be in something more robust like Postgres or Mongo. Would you have a microservice that does the queries between the OLAP and relational DBs and does the join manually, exposing that as some low-level API? Or is using the various FDW options (remote tables in Clickhouse, Postgres clickhouse_fdw, etc.) realistic in production?
Sorry for the ramble, it's late here. But I can clarify if necessary.
People who've used Clickhouse or other OLAP databases in production & at scale, how do you "interconnect" it with relational data? I'm currently experimenting with Clickhouse, because my dataflow is increasing in size (40M rows right now, doubling every month or so) and my current setup (MongoDB) is at its limits. I would like to migrate the 40M rows to CH, but I also need the metadata for the rows to be in something…
We were using kdb before, but clickhouse is more scalable, way cheaper and much more easy to grasp for a newbie.
Earlier quoted context omitted.
tosh submits 10-20 articles a day (yet averages about 1 comment every 2-3 days). There's bound to be some dupes.
Seems like spam. He posted this link earlier, for example: https://en.m.wikipedia.org/wiki/Stolen_base Not sure what I'm missing but that doesn't seem interesting at all. Almost something a bot would pick randomly.
My heuristic for submitting is when I come across something (in this case ClickHouse) that I find useful or fascinating (a-ha moment) where I also think this might be of interest to others here (filter).
People who've used Clickhouse or other OLAP databases in production & at scale, how do you "interconnect" it with relational data? I'm currently experimenting with Clickhouse, because my dataflow is increasing in size (40M rows right now, doubling every month or so) and my current setup (MongoDB) is at its limits. I would like to migrate the 40M rows to CH, but I also need the metadata for the rows to be in something…
How big is that metadata? If it's less than tens of millions rows, you can look at External Dictionaries support in clickhouse.
https://clickhouse.tech/docs/en/sql-reference/dictionaries/e...
https://altinity.com/blog/2020/5/19/clickhouse-dictionaries-...
People who've used Clickhouse or other OLAP databases in production & at scale, how do you "interconnect" it with relational data? I'm currently experimenting with Clickhouse, because my dataflow is increasing in size (40M rows right now, doubling every month or so) and my current setup (MongoDB) is at its limits. I would like to migrate the 40M rows to CH, but I also need the metadata for the rows to be in something…
"Allows to connect to databases on a remote PostgreSQL server. Supports read and write operations (SELECT and INSERT queries) to exchange data between ClickHouse and PostgreSQL."
https://clickhouse.tech/docs/en/engines/database-engines/pos...