Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Citus 12: Schema-based sharding for PostgreSQL

citusdata.com

Post reply on HN
Print view View original

41–47 of 47 posts

Re: Citus 12: Schema-based sharding for PostgreSQL

#41

Post by mariocesar »

stevefan1999 wrote: post #30
mariocesar wrote: post #18

I'm having trouble getting CitusDB to work with RDS, even though I'd really like to use it with AWS. Whenever I try to research how to make it happen, I get stuck in a lot of challenges and end up concluding that it might not be possible. While I could use Azure instead, I'm hesitant because I have a lot of resources and infrastructure in AWS and it wouldn't make sense to move the database layer. The idea of having t…

Checkout stackgres: https://stackgres.io/install/ They are offering Citus integration

Thank you!

Re: Citus 12: Schema-based sharding for PostgreSQL

#42

Post by ksec »

metadat wrote: post #14

Does Oracle support anything like this? Or any other DBMS in widespread use, for that matter? The promise behind this approach to DB sharding has great potential. Simultaneously impressive, novel, and badass. I wish this had been available ten years ago at a few of my startups!

Something like Vitess / PlanetScale?

Re: Citus 12: Schema-based sharding for PostgreSQL

#44

Post by binwiederhier »

It is worth noting that Citus was acquired by Microsoft a few years ago (not a secret, but may not be obvious to everyone), and they have since shifted heavily towards the Azure side of the world.

Back when it happened we tried to buy their product and they were not sure if the Citus standalone product was even going to exist, and they refused to demo it even. Odd timing possibly, but it's a data point.

On the positive side of things, the shard rebalancing was not open source back then iirc, which made the open source version pretty useless. Now it seems to be open source: https://www.citusdata.com/product/comparison -- pretty cool.

I'd still be careful to bank on it as a Citus only customer or open source user.

Re: Citus 12: Schema-based sharding for PostgreSQL

#45

Post by mulander »

binwiederhier wrote: post #44

It is worth noting that Citus was acquired by Microsoft a few years ago (not a secret, but may not be obvious to everyone), and they have since shifted heavily towards the Azure side of the world. Back when it happened we tried to buy their product and they were not sure if the Citus standalone product was even going to exist, and they refused to demo it even. Odd timing possibly, but it's a data point. On the positi…

Hi, we open-sourced the project fully: https://www.citusdata.com/blog/2022/06/17/citus-11-goes-full...

There no longer is an enterprise version, what runs on Azure is the exact same Citus that you can run yourself. We even invested in Patroni, to make it easier for the community to self-host Citus with HA setups.

While we obviously want people using Citus on Azure, having Citus as a viable open-source choice is our path to achieving that. I wasn't part of the company when the acquisition happened so can't speak to that, but I can imagine how that could have made sales at the transition time unclear.

Personally I would also like to add, that the team is full of long term open-source contributors. We contribute both to PostgreSQL and projects around it (like pgbouncer). I understand and respect your reservation, but wanted to share my perspective on it.

Re: Citus 12: Schema-based sharding for PostgreSQL

#46

Post by mulander »

potamic wrote: post #43

Doesn't sharding imply horizontal partitioning? Some of their examples show vertical partitioning use cases. Not sure how I feel about that. I can't imagine why you would do microservices and host their databases as schemas on the same instance.

Because with schema-based sharding in Citus, the schemas are the sharding unit and the system can move them to new nodes being added to the cluster.

You can start with all your microservices sharing a single node, add nodes and have the storage layer distributed horizontally in a way transparent to the services themselves.

Re: Citus 12: Schema-based sharding for PostgreSQL

#47

Post by potamic »

mulander wrote: post #46
potamic wrote: post #43

Doesn't sharding imply horizontal partitioning? Some of their examples show vertical partitioning use cases. Not sure how I feel about that. I can't imagine why you would do microservices and host their databases as schemas on the same instance.

Because with schema-based sharding in Citus, the schemas are the sharding unit and the system can move them to new nodes being added to the cluster. You can start with all your microservices sharing a single node, add nodes and have the storage layer distributed horizontally in a way transparent to the services themselves.

I see, so it's kinda paving the way for a db-as-a service solution?
Post reply on HN