How to move from Amazon RDS to a dedicated PostgreSQL server • Hacker News Board

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#21

Post by eliribble » Wed, May 25, 2016, 1:40 AM UTC

samcheng wrote: post #13

vacri wrote: post #4

Earlier quoted context omitted.

I'm not sure that the article moved to bare iron. The author could have just set up postgres on a regular ec2 instance.

Does that bring performance or cost savings? What is the motivation and calculus for making that transition?

It can bring a cost savings, but the savings is very slight if you're comparing apples-to-apples. For example, if you're using RDS in a multi-AZ replication set up with periodic S3 backups you have to take into account running each of the replica instances and the S3 costs. What we found was that RDS was treated like a black box to our automation (which was a good thing for a long time) and so we were less attentive to being over-provisioned and actually testing failover situations than we should have been.

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#22

Post by qaq » Wed, May 25, 2016, 1:49 AM UTC

OK a bit of topic, but just curious we are considering rolling Postgres hosted service that would support much large instances up 50TB much higher IOPS 1,000,000+ lower latency (infiniband vs ethernet SAN) pricing would be in line with AWS RDS +/- optional ElasticSearch integration optional change notification pub/sub Would you guys be interested/think such service is a good idea? Would appreciate to learn what you guys think?

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#23

Post by audleman » Wed, May 25, 2016, 1:56 AM UTC

qaq wrote: post #22

OK a bit of topic, but just curious we are considering rolling Postgres hosted service that would support much large instances up 50TB much higher IOPS 1,000,000+ lower latency (infiniband vs ethernet SAN) pricing would be in line with AWS RDS +/- optional ElasticSearch integration optional change notification pub/sub Would you guys be interested/think such service is a good idea? Would appreciate to learn what you g…

My 2 cents: you're promising a lot more for the same price which seems dubious. How are you going to beat the wholesaler?

Even if you did I probably wouldn't use it. I don't want a 3rd party dependency on the most critical part of my infrastructure.

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#24

Post by qaq » Wed, May 25, 2016, 2:16 AM UTC

audleman wrote: post #23

qaq wrote: post #22

OK a bit of topic, but just curious we are considering rolling Postgres hosted service that would support much large instances up 50TB much higher IOPS 1,000,000+ lower latency (infiniband vs ethernet SAN) pricing would be in line with AWS RDS +/- optional ElasticSearch integration optional change notification pub/sub Would you guys be interested/think such service is a good idea? Would appreciate to learn what you g…

My 2 cents: you're promising a lot more for the same price which seems dubious. How are you going to beat the wholesaler? Even if you did I probably wouldn't use it. I don't want a 3rd party dependency on the most critical part of my infrastructure.

The price would be comparable to AWS appropriate tear eg 6TB storage for a bit less (10-15%) then amazon's 6TB RDS option but with much better performance. I totally get your reluctance to rely on 3rd party, but the question is more for people who already do rely on 3rd party such as AWS or Azure.

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#25

Post by brightball » Wed, May 25, 2016, 2:34 AM UTC

jbrantly wrote: post #5

Not that it necessarily should, but the article did not really address why they were moving away from RDS. Was it cost, performance, other issues? I've been trying to compare RDS for Postgres to other offerings like Compose or Heroku but have come up surprisingly dry on comparisons.

I wrote one up for Codeship earlier this year:

https://blog.codeship.com/heroku-postgresql-versus-amazon-rd...

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#26

Post by joshmn » Wed, May 25, 2016, 2:41 AM UTC

jbrantly wrote: post #5

Not that it necessarily should, but the article did not really address why they were moving away from RDS. Was it cost, performance, other issues? I've been trying to compare RDS for Postgres to other offerings like Compose or Heroku but have come up surprisingly dry on comparisons.

OVH is likely to launch a dedicated instance for Postgres in the near future. It's currently in the beta stage of RunAbove.

https://www.runabove.com/PaaSDBPGSQL.xml

No affiliation, just a happy customer of OVH's hardware.

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#27

Post by erkkie » Wed, May 25, 2016, 3:00 AM UTC

qaq wrote: post #24

audleman wrote: post #23

Earlier quoted context omitted.

My 2 cents: you're promising a lot more for the same price which seems dubious. How are you going to beat the wholesaler? Even if you did I probably wouldn't use it. I don't want a 3rd party dependency on the most critical part of my infrastructure.

The price would be comparable to AWS appropriate tear eg 6TB storage for a bit less (10-15%) then amazon's 6TB RDS option but with much better performance. I totally get your reluctance to rely on 3rd party, but the question is more for people who already do rely on 3rd party such as AWS or Azure.

How are you imagining solving latency issues? Many people want their DB to be close to their appservers.

edit: and if it's an hosted service, I'm assuming decent networking options (ipsec et al)?

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#28

Post by toomuchtodo » Wed, May 25, 2016, 3:06 AM UTC

eliribble wrote: post #16

jbrantly wrote: post #5

Not that it necessarily should, but the article did not really address why they were moving away from RDS. Was it cost, performance, other issues? I've been trying to compare RDS for Postgres to other offerings like Compose or Heroku but have come up surprisingly dry on comparisons.

I'm the decision maker for the company in question - Authentise. It was a combination of cost and the fact that we need to support an in-datacenter install option for our customers. RDS is really great if you need all of the failover and backup options it provides and you don't have the manpower to invest in it. That's how we got our services started. But, as our expertise and automation grew it ended up being a mode…

Well done on not being married to AWS. Its usually a costly lesson for those who don't prepare for that earlier in their environment's lifecycle.

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#29

Post by sandGorgon » Wed, May 25, 2016, 3:08 AM UTC

qaq wrote: post #22

OK a bit of topic, but just curious we are considering rolling Postgres hosted service that would support much large instances up 50TB much higher IOPS 1,000,000+ lower latency (infiniband vs ethernet SAN) pricing would be in line with AWS RDS +/- optional ElasticSearch integration optional change notification pub/sub Would you guys be interested/think such service is a good idea? Would appreciate to learn what you g…

Dont go for IOPS , but price. Make sure that there is replication and fail over... people at this stage just want to make sure that their data isn't lost. Use cheap hardware like ovh - you can beat AWS on price. Plus, googling for "hosted postgresql" is still something that can be competed upon.

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#30

Post by jbrantly » Wed, May 25, 2016, 3:17 AM UTC

erkkie wrote: post #27

qaq wrote: post #24

Earlier quoted context omitted.

The price would be comparable to AWS appropriate tear eg 6TB storage for a bit less (10-15%) then amazon's 6TB RDS option but with much better performance. I totally get your reluctance to rely on 3rd party, but the question is more for people who already do rely on 3rd party such as AWS or Azure.

How are you imagining solving latency issues? Many people want their DB to be close to their appservers. edit: and if it's an hosted service, I'm assuming decent networking options (ipsec et al)?

Exactly. I want my app server and my db server to be as close as possible. That's why services like Compose and ElephantSQL offer just that. So then it comes down to performance/price (value) between RDS and those.