Accidentally destroyed production database on first day of a job
1–10 of 31 posts
Re: Accidentally destroyed production database on first day of a job
#2This post is from three years ago. I wonder what the poor guy is doing now.
Re: Accidentally destroyed production database on first day of a job
#3This post is from three years ago. I wonder what the poor guy is doing now.
I am glad he left that toxic place.
Re: Accidentally destroyed production database on first day of a job
#4This post is from three years ago. I wonder what the poor guy is doing now.
His last comment from three years ago says he found a new job shortly after. But who knows? Reddit has a chronic problem with people using it as a creative writing portal, regardless of the subreddit (r/AITA, r/RelationshipAdvice, r/MaliciousCompliance, ...).
Re: Accidentally destroyed production database on first day of a job
#5This post is from three years ago. I wonder what the poor guy is doing now.
His last comment from three years ago says he found a new job shortly after. But who knows? Reddit has a chronic problem with people using it as a creative writing portal, regardless of the subreddit (r/AITA, r/RelationshipAdvice, r/MaliciousCompliance, ...).
/r/legaladvice
The list never ends.
I swear folks post sock puppets just so they can tell at them...
Re: Accidentally destroyed production database on first day of a job
#6The experience of reading this on reddit today versus what it was like when this was originally posted is astonishing. The comment are what make this post valuable and the view to them is abysmal.
Re: Accidentally destroyed production database on first day of a job
#7Previous post on HN:
Re: Accidentally destroyed production database on first day of a job
#8For us, one of our junior Devs managed to wipe out all environments, all datacenters for one of our Elastic instances. They got handed a task to modify an index. The Dev Lead and Sr. Devs were 'too busy' and she stack overflowed how to do it and it was rubber stamped. What she did worked - but it wipes out all the existing documents when she dropped and recreated the indexes. Issue was it was a large enough collection that it was not apparent that bad things were happing to the documents on the system. She scripted it up once she thought her test worked and everything went away as the automation ripped through systems. Three days later we had everything restored. The good news is the older system that the new release was replacing was still operational, so we did that.
A few learning experiences. Elastic was brand new to our mix, so not a lot of domain knowledge there. We discovered how dangerous a handful of curl commands could be with the 'stock' permissions the developers had and fixed that. Also became a nice conversation on code reviews, signoff, and deadlines. Also about actual DR readiness and how long it takes to actually restore. We got a lot of value out of that mistake.
She is still my favorite developer. I'd steal her for my personal team any day had she not been stolen from our group by another a couple years later. (shakes fist) As one would expect, she apologized and learned the lessons. She was one of the youngest we ended up giving root to a 12B document prod instance because I knew she would do it carefully and correctly.
Re: Accidentally destroyed production database on first day of a job
#9The fact is, Parler didn't learn from this - a single off-site secondary, or even an off-site backup, would've made recovery trivial after their AWS deplatforming - yet they didn't have one.
Re: Accidentally destroyed production database on first day of a job
#10Earlier quoted context omitted.
His last comment from three years ago says he found a new job shortly after. But who knows? Reddit has a chronic problem with people using it as a creative writing portal, regardless of the subreddit (r/AITA, r/RelationshipAdvice, r/MaliciousCompliance, ...).
/r/legaladvice The list never ends. I swear folks post sock puppets just so they can tell at them...
It really never ends. Add /r/TIFU and /r/ChoosingBeggars to the list.