Live data from Hacker News

Cloud SQL for PostgreSQL now generally available

cloudplatform.googleblog.com

91–100 of 108 posts

Re: Cloud SQL for PostgreSQL now generally available

#91
post #25

Does anyone have insight or experience using this in production? We're currently running PostgreSQL 10 w/ pg_partman on our own hardware but looking at a several options for cloud migration. Unfortunately, Citus Cloud on GCP doesn't appear to be an option (yet?) - Google Cloud SQL (PostgreSQL) - Citus Cloud (AWS Only) - Citus (managed ourselves) on GCP

We did, but now use https://aiven.io Highly recommended if you want a fast and featured managed db service.

[deleted]

Re: Cloud SQL for PostgreSQL now generally available

#92

Started down the path of using this when it was in beta, but had to abort when we saw there was no option to connect to it from Python App Engine Standard. Now that it's GA...it looks like that hasn't changed. Is the classic, Python, App Engine standard becoming a second class citizen? Or was there some reason why this wasn't considered GA worthy for Postgres? Trying to understand if going forward Google is trying to…

[I am a Googler and my team works on part of this] You can connect to postgres from app engine standard... as long as its Java. See this doc https://cloud.google.com/appengine/docs/standard/java/cloud-... And no, appengine standard is not a second class citizen. Hand-wave-ily, the connectivity path that flex uses works for postgres with minimal changes, but unfortunately some additional work is required to get appeng…

Thanks. Could you please explain in a little bit more detail how it works for Java GAE Standard and not Python?

Re: Cloud SQL for PostgreSQL now generally available

#93
post #40

Earlier quoted context omitted.

"Live migration" refers to how Compute Engine transparently migrates a VM to another physical host [1]. Disk and memory is copied over, and they have some ridiculous technology that keeps network connections alive and re-attaches them to the new VM when it's been switched over, so that it causes, in principle, zero disruptions. This is much more magical than other providers, such as AWS and DigitalOcean, where such a…

> they have some ridiculous technology that maintains network connections and re-routes them when everything switches to the new VM indeed, this is the primary reason i wish to switch. i have no problem maintaining our own stuff, we do that anyway. :) thanks for the details.

If you (or the parent) are interested in some details about that ridiculous technology, there was a paper in NSDI this year: https://www.usenix.org/system/files/conference/nsdi18/nsdi18...

(disclaimer: I'm one of the many authors on the paper, although for building parts of the underlying tech, not writing the prose)

Re: Cloud SQL for PostgreSQL now generally available

#94

Started down the path of using this when it was in beta, but had to abort when we saw there was no option to connect to it from Python App Engine Standard. Now that it's GA...it looks like that hasn't changed. Is the classic, Python, App Engine standard becoming a second class citizen? Or was there some reason why this wasn't considered GA worthy for Postgres? Trying to understand if going forward Google is trying to…

Why not use AWS though? It is so much better, reliable and overall super cheap.

Re: Cloud SQL for PostgreSQL now generally available

#95

Earlier quoted context omitted.

[I'm the Cloud SQL TL] No, it isn't. We agree with you that it's an important feature for managed databases, and we're working to get it right. We decoupled it from this launch to get PostgreSQL to GA faster.

Unrelated to pg but could you badger the spanner team to make a mini spanner product :) Related to postgres. We have many many concurrent connections but a load satisfied by an n1-standard-4 atm do you recommend a connection pooler or something to help us get down to the 100 to 200 connections we need to be at to use cloudsql?

[I'm the Cloud SQL TL] We do recommend connection pooling whenever possible. You save server resources, but you also save connection latency.

Re: Cloud SQL for PostgreSQL now generally available

#96
post #64
post #60

Earlier quoted context omitted.

Last I checked it wasn't possible to whitelist internal IPs (e.g. Kubernetes nodes or VM instances) to access Cloud SQL instances at all -- the options are either to use the non-standard cloud SQL proxy sidecar app, or allow connections from all endpoints (public or private). This seems like a major omission, and AWS has had this for ages.

From the docs: https://cloud.google.com/sql/docs/postgres/connect-external-... > You can grant any application access to a Cloud SQL instance by authorizing the IP addresses that the application uses to connect. > You can not specify a private network (for example, 10.x.x.x) as an authorized network. > PostgreSQL instances support only IPv4 addresses. They are automatically configured with a static IP address.

Ah, misremembered exactly what the issue was -- you're right, individual endpoints can be whitelisted. Internal networks cannot, which is what I (or anyone else using GKE) would need, since node IPs are ephemeral.

I believe the same issue would apply to VM instances that are not pets, (in auto-scaling groups for example), since I'm not aware of being able to auto-assign static IPs there either.

Re: Cloud SQL for PostgreSQL now generally available

#97
post #78

Earlier quoted context omitted.

[I'm the Cloud SQL TL] I can't comment on timelines, but we're aware that customers are interested in more features around maintenance window scheduling, deferral, and notification, as well as shorter downtime for updates and smarter scheduling within a group of replicas.

Can you confirm that it's impossible to avoid downtime, even with HA, because of forced updates? Surely that's what HA is? no downtime as you update each node one at a time? If it's impossible then it's a dealbreaker.

[I'm the Cloud SQL TL] Confirmed. We know it's a problem that we need to fix. HA reduces downtime in unexpected failure cases (live migration for your primary only helps in planned shutdown cases, not if the physical machine fails), but doesn't currently help with maintenance-related downtime.

Re: Cloud SQL for PostgreSQL now generally available

#98
post #45
post #17

Earlier quoted context omitted.

There's a previous blog post[1] about HA replication. It uses block-level replication managed by PD infrastructure. [1] https://cloudplatform.googleblog.com/2017/11/Cloud-SQL-for-P...

Block device based replication for Postgres seems a bit unconventional given that Postgres has native synchronous replication support with WAL streaming. Intuition tells me that you might get better performance if you let the DB itself do the replication but I can't really justify that without real review of what happens. The postgres docs ( https://www.postgresql.org/docs/10/static/different-replicat... ) say that t…

Amazon's Aurora Postgres database does a similar thing: your master in one zone replicates to a disk that is in all the other zones. Unlike normal Postgres RDS instance it also auto-scales storage to what you use.

Amazon claims better scaling then ordinary Postgres for this.

Re: Cloud SQL for PostgreSQL now generally available

#99

Earlier quoted context omitted.

They're the best we've found as well, but there are lots of managed database providers of all kinds. https://www.compose.com is another big one.

We’re using compose for redis, but we might switch it to aiven as well, despite aiven having some missing functionality... For Gcloud and especially in Europe, I think these two are the only options that I’m aware of (at least for PG and redis)

If you want managed Redis, there’s nothing better than RedisLabs

Re: Cloud SQL for PostgreSQL now generally available

#100
post #74

I tried using this, but couldn't get the root certs to work. So I went to AWS RDS instead. A pity, it's much cheaper ( especially in beta pricing )

[Cloud SQL person, SSL+connections is my jam]

When you say you couldn't get the root certs to work... what do you mean?

Cloud SQL automatically generates server certificates, and we offer UI+API for creating additional client certificates. The two should not share a root CA.

Post reply on HN