Live data from Hacker News

How to move from Amazon RDS to a dedicated PostgreSQL server

layer0.authentise.com

11–20 of 73 posts

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#11
post #5

Not that it necessarily should, but the article did not really address why they were moving away from RDS. Was it cost, performance, other issues? I've been trying to compare RDS for Postgres to other offerings like Compose or Heroku but have come up surprisingly dry on comparisons.

Cost, performance, size limitations

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#12
From the article (emphasis mine):

> [pg_dump ...] The main disadvantage of this method is that it will not provide high reliability.

Pretty sure the author means "availability" not "reliabilitiy". pg_dump is completely reliable, arguably more so than ANY other backup mechanism as it creates logical machine independent backups.

Best intro tip regarding pg_dump: use -Fc (custom format)

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#13
post #4
post #2

For those that have done this, I'd be interested in the performance gain (say, IOPS at an equivalent hosting + hardware cost). I'd also be interested in RDS vs. Heroku Postgres. Do people do this for security / policy purposes, or are they motivated by cost savings? Does removing all that virtualization buy improved performance?

I'm not sure that the article moved to bare iron. The author could have just set up postgres on a regular ec2 instance.

Does that bring performance or cost savings? What is the motivation and calculus for making that transition?

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#14
post #2

For those that have done this, I'd be interested in the performance gain (say, IOPS at an equivalent hosting + hardware cost). I'd also be interested in RDS vs. Heroku Postgres. Do people do this for security / policy purposes, or are they motivated by cost savings? Does removing all that virtualization buy improved performance?

30,000 iops is less then single crappy consumer grade SSD 6TB is fairly low limit largest instance has 244Gb RAM So improved performance, running larger instances, lower cost

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#15
post #11
post #5

Not that it necessarily should, but the article did not really address why they were moving away from RDS. Was it cost, performance, other issues? I've been trying to compare RDS for Postgres to other offerings like Compose or Heroku but have come up surprisingly dry on comparisons.

Cost, performance, size limitations

At what scale have you found Performance and Size Limitations an issue? I've seen people leave due to cost before (not that I thought they were always correct), but not for the other two you listed.

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#16
post #5

Not that it necessarily should, but the article did not really address why they were moving away from RDS. Was it cost, performance, other issues? I've been trying to compare RDS for Postgres to other offerings like Compose or Heroku but have come up surprisingly dry on comparisons.

I'm the decision maker for the company in question - Authentise. It was a combination of cost and the fact that we need to support an in-datacenter install option for our customers. RDS is really great if you need all of the failover and backup options it provides and you don't have the manpower to invest in it. That's how we got our services started. But, as our expertise and automation grew it ended up being a modest cost savings to handle our own backups and redundancies. Primarily, though, we just can't install RDS in someone else's datacenter on premises.

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#17
post #5

Not that it necessarily should, but the article did not really address why they were moving away from RDS. Was it cost, performance, other issues? I've been trying to compare RDS for Postgres to other offerings like Compose or Heroku but have come up surprisingly dry on comparisons.

It's because it's a pretty situational thing to talk about. IMO, the most sensible reasons to move away from RDS would be customer requirements or you're not using AWS for anything else.

What traits are you comparing on? What kind of a thing are you building? What features (cost, performance, ease of use, time) are the most important to you?

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#18

Overall a nice post. It doesn't quite get into all the options for pg_dump as there's a number of other flags that can be useful to reduce downtime. It's also probably worth taking a look at Amazon Migration Service as well (though I haven't personally used it or heard from others that have yet) - https://aws.amazon.com/dms/ . One tool they did miss for continuous archiving is WAL-E, which tends to be the one most us…

Maybe Yani himself can chime in when it's daytime in his time zone, but if memory serves correctly he did look at WAL-E. It had some nice features in its favor. I'm not sure why it didn't make it into the blog post.

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#19
post #4
post #2

For those that have done this, I'd be interested in the performance gain (say, IOPS at an equivalent hosting + hardware cost). I'd also be interested in RDS vs. Heroku Postgres. Do people do this for security / policy purposes, or are they motivated by cost savings? Does removing all that virtualization buy improved performance?

I'm not sure that the article moved to bare iron. The author could have just set up postgres on a regular ec2 instance.

Yes, we did move to a regular EC2 instance for our cloud service. Where we install databases on premises for our customers it can be bare iron, but it can also be a similar virtualized setup.

Re: How to move from Amazon RDS to a dedicated PostgreSQL server

#20
post #15
post #11

Earlier quoted context omitted.

Cost, performance, size limitations

At what scale have you found Performance and Size Limitations an issue? I've seen people leave due to cost before (not that I thought they were always correct), but not for the other two you listed.

30,000 iops is 1/2 of a crappy consumer grade SSD. 6TB is fairly low for projects that generate any sizable amount of data. We don't run things in AWS unless it's strong client preference.
Post reply on HN