Live data from Hacker News

Keep calm and use the runbook

cortex.io

21–30 of 51 posts

Re: Keep calm and use the runbook

#21

It is obvious to me that keeping the runbook up to date is really important. But how do you foster a culture in which everyone keeps it up to date? Many people don't even read the readme, let alone correct it. Is it cultural? If you are so privileged that your books are updated, please share with us your ways!

Allocate resources to it.

See: https://zwischenzugs.com/2017/04/04/things-i-learned-managin...

Re: Keep calm and use the runbook

#23

It is obvious to me that keeping the runbook up to date is really important. But how do you foster a culture in which everyone keeps it up to date? Many people don't even read the readme, let alone correct it. Is it cultural? If you are so privileged that your books are updated, please share with us your ways!

In the onboarding welcome call, one of the first things that I share is that if the new team member notices an issue in any of the documentation, they should either correct it, or at least raise a flag. You need to build the culture from the very start.

Re: Keep calm and use the runbook

#24

What is the difference (if any) between a runbook and a process? Genuine question; I am interested to hear people's answers.

You can have a process without a runbook, but not the reverse. i.e. a process can work, but be undocumented. Whereas having a runbook means you've defined the process (or at least gotten a good start at it..)

Re: Keep calm and use the runbook

#25

It is obvious to me that keeping the runbook up to date is really important. But how do you foster a culture in which everyone keeps it up to date? Many people don't even read the readme, let alone correct it. Is it cultural? If you are so privileged that your books are updated, please share with us your ways!

Runbooks, checklists, playbooks, SOPs (standard operating procedures), broadly fall into two categories:

- those that always need to be followed

- those that provide helpful and welcome direction on how to do an unknown or rarely occurring task

It needs to be clear which is which.

An example of one that always needs to be followed is the deployment process. It changes from time to time. The person running it may perfectly remember all the steps from the last time it was run. But this time, a new step may have been added. Reading and following it step by step is critical.

How to keep these up to date? When things break, do a retrospective. Often, the action item required to prevent an issue will require you to update the runbook.

For the runbooks that are "nice to have", you should hear about problems from the people that run them. I regularly hear that such-and-such instructions no longer work, or such-and-such step needs to be changed. People tend to appreciate these types of instructions more as they can see how they make their lives easier. Because of that, they tend to take care of them more.

Re: Keep calm and use the runbook

#26

Runbooks are very common in safety critical environments. E.g. aviation is completely driven by checklists. Everything has a checklist. Even amateur pilots tend to stick to their checklists. There are a few useful properties with checklists: - They stop you from having to improvise actions when time is too short for that. People under stress take bad decisions. It's better for them to stick to a pre-defined plan. - T…

The “preventable mistakes” point reminds me of this great video about “normalization of deviance” [from routine/checklists] https://youtu.be/Ljzj9Msli5o

Re: Keep calm and use the runbook

#27

It is obvious to me that keeping the runbook up to date is really important. But how do you foster a culture in which everyone keeps it up to date? Many people don't even read the readme, let alone correct it. Is it cultural? If you are so privileged that your books are updated, please share with us your ways!

It's kind of crazy that we live in a world where questions like this are even a thing.

> how do you foster a culture in which everyone keeps it up to date

You hire the people who will do the stuff you need them to do, and you don't hire the people who won't.

Given all the well-known strife over hiring games that are the source of constant complaints, you'd think that meant that most orgs' resident personnel experts would be at a place where they already at least have the basics covered—ensuring that employees will be able to manage to do the stuff that they're supposed to do after being hired. And yet here we are.

How much market inefficiency and dysfunction in the industry would disappear if people abandoned any illusions about the efficacy of riddles to attempt to measure aptitude (usually by approaching it sideways), and just focused on these two things instead: "We are a company that does X. We need to hire someone to take care of Y. Part of that involves doing Z. Can you do Z (or figure out how)? Will you do Z?"

Re: Keep calm and use the runbook

#29

What is the difference (if any) between a runbook and a process? Genuine question; I am interested to hear people's answers.

IMHO:

- Process: follow it in order when you want result X, all steps need to be completed, each time every time. Routine stuff.

- Runbook: follow it in order when X happens, some steps may not apply depending on the situation or you may need to adapt. Non-routine stuff.

Re: Keep calm and use the runbook

#30

It is obvious to me that keeping the runbook up to date is really important. But how do you foster a culture in which everyone keeps it up to date? Many people don't even read the readme, let alone correct it. Is it cultural? If you are so privileged that your books are updated, please share with us your ways!

It's kind of crazy that we live in a world where questions like this are even a thing. > how do you foster a culture in which everyone keeps it up to date You hire the people who will do the stuff you need them to do, and you don't hire the people who won't. Given all the well-known strife over hiring games that are the source of constant complaints, you'd think that meant that most orgs' resident personnel experts w…

And ... will you update documentation? Do you have examples of prior work maintaining any documentation?
Post reply on HN