Live data from Hacker News

PolarDB, yet another open source database system based on PostgreSQL

github.com

41–50 of 103 posts

Re: PolarDB, yet another open source database system based on PostgreSQL

#41
post #40

What are people/companies using currently to make their postgres database distributed these days? Currently running my app + db on Heroku in the EU and would like to scale out since latency is abysmal for users in Australia and Asia.

I think Citus is one option. Or possibly TimescaleDB

Re: PolarDB, yet another open source database system based on PostgreSQL

#42
post #18

Earlier quoted context omitted.

there used to be citus but now it's part of microsoft Azure

True, it is developed by Microsoft and available as a service on Azure. It is also open source, actively maintained and improved, and it's a PG13-compatible Postgres extension that adds both distributed database capabilities and columnar storage. :) https://github.com/citusdata/citus (Citus engineer)

> PG13-compatible

So not (IBM-System-)R-compatible, then?

Re: PolarDB, yet another open source database system based on PostgreSQL

#44
post #43

What are the differences between this and YugobyteDB?

Yugabyte is different DB technology than postgres but with PG compatibility layer, means you can use existing postgres query/application, the rest is different beast. This one is more comparable with citus, an PG extension. Meaning it runs on top postgres. However from their github page they also offer patched version of PG which I suppose offer some tighter integration with the extension.

Re: PolarDB, yet another open source database system based on PostgreSQL

#46
post #17

Looking at their code tree, this is based on 11.2 ( https://www.postgresql.org/docs/11/release-11-2.html ): https://github.com/alibaba/PolarDB-for-PostgreSQL/blob/maste... So this is code from two years ago missing stability fixes from upstream up to 11.12, at short sight.

Are there any stability fixes you have in mind? In my recollection, there is not much instability in PG releases.

Re: PolarDB, yet another open source database system based on PostgreSQL

#47

Earlier quoted context omitted.

Sometimes I dream about a highly available multi primary postgresql.

CockroachDB?

Perhaps. It's missing the 30 years of experience, the PostGreSQL reputation, an opensource license, and a better name.

Re: PolarDB, yet another open source database system based on PostgreSQL

#48
post #6

“high availability through Paxos based replication”. I thought Paxos is supposed to be a CP system.

HA isn't really about 100% availability. Any single system that promises such is extremely likely to be misleading you somehow. Your in-flight query is going to get interrupted no matter how fancy your clustering is, and I struggle to even come up with hypothetical use cases where this is something you can't afford to have happen, ever.

All you need is that in the event of a failure the clustered system can still recover quickly enough (to a well-defined state!) that the application layer can deal with the transient failure without significant impact on users, maintaining the illusion of availability.

Re: PolarDB, yet another open source database system based on PostgreSQL

#49

Earlier quoted context omitted.

How do you think the next dominant Database platform will start? Is your expectation that innovation requires polish before hitting the (free open source) “marketplace”?

My expectation is that the next dominant platform will offer something unique which creates enough value that I'm willing to overlook the unfinished parts that deduct value. When Neo4j and other graph databases went big in the past decade, they value they created: "finally! I don't have to faff around with RDBMS tables and Cobb purists to store and query my non-relational object-graph!" - despite the fact that Neo4j…

> It extends PostgreSQL to become a share-nothing distributed database, which supports global data consistency and ACID across database nodes, distributed SQL processing, and data redundancy and high availability through Paxos based replication. PolarDB is designed to add values and new features to PostgreSQL in dimensions of high performance, scalability, high availability, and elasticity. At the same time, PolarDB remains SQL compatibility to single-node PostgreSQL with best effort.

That’s pretty compelling, if it delivers.

Re: PolarDB, yet another open source database system based on PostgreSQL

#50
post #6

“high availability through Paxos based replication”. I thought Paxos is supposed to be a CP system.

HA isn't really about 100% availability. Any single system that promises such is extremely likely to be misleading you somehow. Your in-flight query is going to get interrupted no matter how fancy your clustering is, and I struggle to even come up with hypothetical use cases where this is something you can't afford to have happen, ever. All you need is that in the event of a failure the clustered system can still rec…

> I struggle to even come up with hypothetical use cases where this is something you can't afford to have happen, ever.

a rocket is using this query to adjust their trusters ;)

Post reply on HN