Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

EBS-SnapShooter – Python script to snapshot EBS volumes

github.com

Post reply on HN
Print view View original

1–10 of 17 posts

Re: EBS-SnapShooter – Python script to snapshot EBS volumes

#4

Post by eropple »

CloudWatch Events can already do this for you. I wish it were exposed through automation; that's still coming, but in the interim it's still a solution that minimizes your own failure surface. Do AWS tasks with AWS's tools whenever you can--it minimizes points of failure that you have to manage. Check it: http://docs.aws.amazon.com/AmazonCloudWatch/latest/events/Ta...

I've also seen people use Lambda, which is halfway to "do AWS tasks with AWS's tools"; it's only a few lines of code and can be flexibly triggered without this much bulk. (Same code can usually be tossed in cron.)

If you want to go the persistent-daemon approach, there's something like automated-ebs-snapshots (which I used before CloudWatch Events came along), which is reasonably bulletproofed and is already used in anger: https://github.com/skymill/automated-ebs-snapshots

Writing stuff like this is decent practice to get comfortable with the AWS APIs, but these are generally solved problems. I'd be real uncomfortable with k8s's "secrets? what's that? is that something I store unencrypted?" approach to anything remotely sensitive when I'm throwing AWS credentials around; AWS already provides a better ACL method for this sort of thing in IAM. (If you have insisted on a k8s cluster and you aren't able to leverage IAM, this is a problem on your end that should be rectified sooner than soon.)

Re: EBS-SnapShooter – Python script to snapshot EBS volumes

#6

Post by foxylion »

eropple wrote: post #4

CloudWatch Events can already do this for you. I wish it were exposed through automation; that's still coming, but in the interim it's still a solution that minimizes your own failure surface. Do AWS tasks with AWS's tools whenever you can--it minimizes points of failure that you have to manage. Check it: http://docs.aws.amazon.com/AmazonCloudWatch/latest/events/Ta... I've also seen people use Lambda, which is halfwa…

A good blog post about snapshots with CloudWatch and Lambdas can be found here:

Part 1: create snapshots

https://serverlesscode.com/post/lambda-schedule-ebs-snapshot...

Part 2: expire old snapshots

https://serverlesscode.com/post/lambda-schedule-ebs-snapshot...

Re: EBS-SnapShooter – Python script to snapshot EBS volumes

#8

Post by smile0x90 »

rad_gruchalski wrote: post #5
smile0x90 wrote: post #2

This too make AWS - EBS snapshot periodically and more easy. Docker image can also be found in quay . It's an OpenSource project so feel free to contribute :)

Why not a Lambda function?

The purpose of this repo is to prepare a Kubernetes Periodic Job to make ebs snapshots. It can be done with different manner ;)

Re: EBS-SnapShooter – Python script to snapshot EBS volumes

#10

Post by manojlds »

eropple wrote: post #4

CloudWatch Events can already do this for you. I wish it were exposed through automation; that's still coming, but in the interim it's still a solution that minimizes your own failure surface. Do AWS tasks with AWS's tools whenever you can--it minimizes points of failure that you have to manage. Check it: http://docs.aws.amazon.com/AmazonCloudWatch/latest/events/Ta... I've also seen people use Lambda, which is halfwa…

Here's my lambda implementation that snapshots and purges - https://github.com/manojlds/ebs-snapshot-lambda
Post reply on HN