Managed Redis on Google Cloud Platform • Hacker News Board

Re: Managed Redis on Google Cloud Platform

#41

Post by ctavan » Thu, Apr 26, 2018, 8:42 PM UTC

ssambros wrote: post #35

nodesocket wrote: post #2

Great. Does this support persisting to disk RDB[1] or AOF[2]? Pricing seems reasonable? 1GB of Redis data is $0.049 per GB hour. 730 hours in a month = $0.049 * 1 * 730 = $35.77/mo. 5GB of Redis data is $0.027 per GB hour. 730 hours in a month = $0.027 * 5 * 730 = $98.55/mo. [1][2] https://redis.io/topics/persistence

May I ask what is the planned use case for the RDB/AOF replication? Are you expecting to have access to the snapshots while the instance is running, or you just need them for import/export or durability reasons? Disclaimer: I am an engineer at Google on the managed Redis team.

Use case for RDB backups: for rather large redis datasets (>50GB) with long living keys (90days and beyond) I found it useful to be able to parse an RDB snapshot using the python rdbtools and iterate over the whole dataset, e.g. in order to migrate data to a different format. I found this usually more stable and reliable than using SCAN and the likes.

Re: Managed Redis on Google Cloud Platform

#42

Post by ssambros » Fri, Apr 27, 2018, 8:46 AM UTC

ctavan wrote: post #41

ssambros wrote: post #35

Earlier quoted context omitted.

May I ask what is the planned use case for the RDB/AOF replication? Are you expecting to have access to the snapshots while the instance is running, or you just need them for import/export or durability reasons? Disclaimer: I am an engineer at Google on the managed Redis team.

Use case for RDB backups: for rather large redis datasets (>50GB) with long living keys (90days and beyond) I found it useful to be able to parse an RDB snapshot using the python rdbtools and iterate over the whole dataset, e.g. in order to migrate data to a different format. I found this usually more stable and reliable than using SCAN and the likes.

For this use case it seems the export feature that allows you to take a snapshot of the database at any given time might fit the needs. We will definitely consider this feature for the general availability release.

Re: Managed Redis on Google Cloud Platform

#43

Post by ctavan » Fri, Apr 27, 2018, 11:06 AM UTC

ssambros wrote: post #42

ctavan wrote: post #41

Earlier quoted context omitted.

Use case for RDB backups: for rather large redis datasets (>50GB) with long living keys (90days and beyond) I found it useful to be able to parse an RDB snapshot using the python rdbtools and iterate over the whole dataset, e.g. in order to migrate data to a different format. I found this usually more stable and reliable than using SCAN and the likes.

For this use case it seems the export feature that allows you to take a snapshot of the database at any given time might fit the needs. We will definitely consider this feature for the general availability release.

Thanks for the reply!

I wasn't aware of an export feature. As long as the export comes in a reasonable machine readable format that should be equally fine and would remove the need for access to RDB files for my use case.