Live data from Hacker News

Coding Horror and blogs.stackoverflow.com experience "100% Data Loss"

codinghorror.com

21–30 of 175 posts

Re: Coding Horror and blogs.stackoverflow.com experience "100% Data Loss"

#21
post #20
post #5

Let me get this right: the guy who ran a site whose entire purpose is to make fun of other people's poor programming practices has no external backups?

"Coding Horror experienced 100% data loss at our hosting provider, CrystalTech. I have some backups and I'll try to get it up and running ASAP!"

Read his newer tweets - his backups were just copies on the same server; they are gone as well, and now he's resorting to using internet caches to restore his content.

Re: Coding Horror and blogs.stackoverflow.com experience "100% Data Loss"

#22
1. Register an Amazon AWS S3 account - https://aws-portal.amazon.com/gp/aws/developer/registration/...

2. Download my S3 backup script (or anyone's S3 Backup script) - http://github.com/leftnode/S3-Backup

3. Set up a cron to push hourly/daily/whatever tar's of your vhost's directory to S3.

Spend, like, $10 a month. Thats 30gb of storage, 30gb up and 30gb down. Now, I know that may not be a lot, but I doubt codinghorror.com had that much data.

Re: Coding Horror and blogs.stackoverflow.com experience "100% Data Loss"

#24
post #7

To be fair, Atwood thought his hosting provider (CrystalTech) was backing up his system. As it turns out, their entire VM backup solution failed silently, so everyone thought the backups were being made. If anything, I'd say this is a sign not to work with CrystalTech.

If you fail to audit and test your disaster recovery procedures on a regular basis, then you fail at competently maintaining your infrastructure. No excuses.

Re: Coding Horror and blogs.stackoverflow.com experience "100% Data Loss"

#25
post #20
post #5

Let me get this right: the guy who ran a site whose entire purpose is to make fun of other people's poor programming practices has no external backups?

"Coding Horror experienced 100% data loss at our hosting provider, CrystalTech. I have some backups and I'll try to get it up and running ASAP!"

[deleted]

Re: Coding Horror and blogs.stackoverflow.com experience "100% Data Loss"

#26

1. Register an Amazon AWS S3 account - https://aws-portal.amazon.com/gp/aws/developer/registration/... 2. Download my S3 backup script (or anyone's S3 Backup script) - http://github.com/leftnode/S3-Backup 3. Set up a cron to push hourly/daily/whatever tar's of your vhost's directory to S3. Spend, like, $10 a month. Thats 30gb of storage, 30gb up and 30gb down. Now, I know that may not be a lot, but I doubt codinghorr…

I do the same thing, with a script using ruby s3sync I wrote a while ago (that I should probably update):

http://paulstamatiou.com/how-to-bulletproof-server-backups-w...

Re: Coding Horror and blogs.stackoverflow.com experience "100% Data Loss"

#27
post #7

To be fair, Atwood thought his hosting provider (CrystalTech) was backing up his system. As it turns out, their entire VM backup solution failed silently, so everyone thought the backups were being made. If anything, I'd say this is a sign not to work with CrystalTech.

[deleted]

Re: Coding Horror and blogs.stackoverflow.com experience "100% Data Loss"

#28
post #13
post #5

Let me get this right: the guy who ran a site whose entire purpose is to make fun of other people's poor programming practices has no external backups?

Well - he is human though he can have a new site now called "backup horrors". All kidding aside - this is horrible. How many people validate their backups on a regular basis? (even once a year)

Automatic validation is done through every backup (and I have my guys do a review of the logs from the nightly cron procedures). Once a month we test our restore procedures.

Re: Coding Horror and blogs.stackoverflow.com experience "100% Data Loss"

#29
In the Joel thread, there was mention of "Truly Great Programmers(TM)", what their qualities are and how to hire them. I don't know if folks were putting Jeff in that category or not. But as a skeptic of this True Greatness, I'm perhaps grasping at straws in saying "hey look, anyone can screw up, True Greatness, phooey".
Post reply on HN