Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

EBS-SnapShooter – Python script to snapshot EBS volumes

github.com

Post reply on HN
Print view View original

11–17 of 17 posts

Re: EBS-SnapShooter – Python script to snapshot EBS volumes

#11

Post by machbio »

manojlds wrote: post #9

EBS Snapshot (and purge) is like building the todo app for the Devops world :) Here's my AWS Lambda implementation that snapshots and purges - https://github.com/manojlds/ebs-snapshot-lambda

Yes, the next step from Todo App is to do Incremental backups, and delete the old ones beyond certain version.. :)

Re: EBS-SnapShooter – Python script to snapshot EBS volumes

#12

Post by paulddraper »

eropple wrote: post #4

CloudWatch Events can already do this for you. I wish it were exposed through automation; that's still coming, but in the interim it's still a solution that minimizes your own failure surface. Do AWS tasks with AWS's tools whenever you can--it minimizes points of failure that you have to manage. Check it: http://docs.aws.amazon.com/AmazonCloudWatch/latest/events/Ta... I've also seen people use Lambda, which is halfwa…

Don't your solutions give you potentially corrupted snapshots?

For this reason, for my backups, I run a cronjob on the EC2 instance and call fsfreeze (https://linux.die.net/man/8/fsfreeze). Is this unnecessary?

Re: EBS-SnapShooter – Python script to snapshot EBS volumes

#13

Post by zwily »

paulddraper wrote: post #12
eropple wrote: post #4

CloudWatch Events can already do this for you. I wish it were exposed through automation; that's still coming, but in the interim it's still a solution that minimizes your own failure surface. Do AWS tasks with AWS's tools whenever you can--it minimizes points of failure that you have to manage. Check it: http://docs.aws.amazon.com/AmazonCloudWatch/latest/events/Ta... I've also seen people use Lambda, which is halfwa…

Don't your solutions give you potentially corrupted snapshots? For this reason, for my backups, I run a cronjob on the EC2 instance and call fsfreeze ( https://linux.die.net/man/8/fsfreeze ). Is this unnecessary?

An EBS-snapshot should give a crash-consistent image. However, it's probably better to freeze if you can. If you're doing RAID across multiple volumes, you almost definitely need to freeze your volumes while all the snapshots start.

Re: EBS-SnapShooter – Python script to snapshot EBS volumes

#15

Post by paulddraper »

machbio wrote: post #11
manojlds wrote: post #9

EBS Snapshot (and purge) is like building the todo app for the Devops world :) Here's my AWS Lambda implementation that snapshots and purges - https://github.com/manojlds/ebs-snapshot-lambda

Yes, the next step from Todo App is to do Incremental backups, and delete the old ones beyond certain version.. :)

EBS snapshots are incremental already....

Re: EBS-SnapShooter – Python script to snapshot EBS volumes

#16

Post by eropple »

smile0x90 wrote: post #8
rad_gruchalski wrote: post #5

Earlier quoted context omitted.

Why not a Lambda function?

The purpose of this repo is to prepare a Kubernetes Periodic Job to make ebs snapshots. It can be done with different manner ;)

What is the benefit of assuming additional risk by inserting this into your infrastructure instead of using AWS's existing stuff?

(I will admit: am being a little hard on you because I think this is a bad idea. On the scale of bad ideas, it's only a bad idea and not a really bad idea, but it's a bad idea.)

Post reply on HN