How to move from Amazon RDS to a dedicated PostgreSQL server
layer0.authentise.com
How to move from Amazon RDS to a dedicated PostgreSQL server
1–10 of 73 posts
Re: How to move from Amazon RDS to a dedicated PostgreSQL server
#2For those that have done this, I'd be interested in the performance gain (say, IOPS at an equivalent hosting + hardware cost). I'd also be interested in RDS vs. Heroku Postgres.
Do people do this for security / policy purposes, or are they motivated by cost savings? Does removing all that virtualization buy improved performance?
Re: How to move from Amazon RDS to a dedicated PostgreSQL server
#3Overall a nice post. It doesn't quite get into all the options for pg_dump as there's a number of other flags that can be useful to reduce downtime. It's also probably worth taking a look at Amazon Migration Service as well (though I haven't personally used it or heard from others that have yet) - https://aws.amazon.com/dms/.
One tool they did miss for continuous archiving is WAL-E, which tends to be the one most used including by us at Citus Cloud and Heroku Postgres - https://github.com/wal-e/wal-e
Re: How to move from Amazon RDS to a dedicated PostgreSQL server
#4For those that have done this, I'd be interested in the performance gain (say, IOPS at an equivalent hosting + hardware cost). I'd also be interested in RDS vs. Heroku Postgres. Do people do this for security / policy purposes, or are they motivated by cost savings? Does removing all that virtualization buy improved performance?
I'm not sure that the article moved to bare iron. The author could have just set up postgres on a regular ec2 instance.
Re: How to move from Amazon RDS to a dedicated PostgreSQL server
#5Not that it necessarily should, but the article did not really address why they were moving away from RDS. Was it cost, performance, other issues?
I've been trying to compare RDS for Postgres to other offerings like Compose or Heroku but have come up surprisingly dry on comparisons.
Re: How to move from Amazon RDS to a dedicated PostgreSQL server
#6tldr - a howto
Re: How to move from Amazon RDS to a dedicated PostgreSQL server
#7Overall a nice post. It doesn't quite get into all the options for pg_dump as there's a number of other flags that can be useful to reduce downtime. It's also probably worth taking a look at Amazon Migration Service as well (though I haven't personally used it or heard from others that have yet) - https://aws.amazon.com/dms/ . One tool they did miss for continuous archiving is WAL-E, which tends to be the one most us…
Yeah, I would* do a `pg_dump | pg_restore` with these settings: https://github.com/heroku/heroku/blob/master/lib/heroku/help...
*disclaimer: I wrote that code while at heroku
Re: How to move from Amazon RDS to a dedicated PostgreSQL server
#8Overall a nice post. It doesn't quite get into all the options for pg_dump as there's a number of other flags that can be useful to reduce downtime. It's also probably worth taking a look at Amazon Migration Service as well (though I haven't personally used it or heard from others that have yet) - https://aws.amazon.com/dms/ . One tool they did miss for continuous archiving is WAL-E, which tends to be the one most us…
We've tested out DMS to migrate from a 3 node Oracle RAC to Oracle RDS, and I was incredibly impressed. They list a bunch of limitations in their documentation that you should look at first. It migrated our roughly 1 TB database in two hours and ten minutes and handled replication flawlessly - not a single record discrepancy between the two database systems over a week long test. We were not expecting it to work that well and doubted that it would work with RAC as the source.
Re: How to move from Amazon RDS to a dedicated PostgreSQL server
#9Not that it necessarily should, but the article did not really address why they were moving away from RDS. Was it cost, performance, other issues? I've been trying to compare RDS for Postgres to other offerings like Compose or Heroku but have come up surprisingly dry on comparisons.
Agreed, I always look for the reasoning behind these types of decisions. It helps others understand the issues that people face with different platforms.
Re: How to move from Amazon RDS to a dedicated PostgreSQL server
#10Overall a nice post. It doesn't quite get into all the options for pg_dump as there's a number of other flags that can be useful to reduce downtime. It's also probably worth taking a look at Amazon Migration Service as well (though I haven't personally used it or heard from others that have yet) - https://aws.amazon.com/dms/ . One tool they did miss for continuous archiving is WAL-E, which tends to be the one most us…
Yeah, came here to say that the migration service was built to solve this exact problem (among others).