Skip to the content ForoHackers
Log inJoin

On-call from home: keeping the pager from eating the house

CareersRemote workSite reliability
#1177 · tired_sre_at_3am · · Report

A topic that does not get much discussion: being on-call while working from home. The blurring is real, and I have learned a few habits the slow way.

A physical boundary. If the laptop lives in the living room, the incident lives in the living room. Mine has a spot, and when the shift ends it goes back in the bag.

Handoffs in writing. At the start and end of a shift: what is open, what is flaky, what I changed, what I am watching. Two paragraphs. The next person should not need me awake to understand the state of things.

A runbook for the 3 a.m. brain. The 3 a.m. version of me cannot reason through a graph with twelve lines. The runbook says "if X, run this command, expect this output, else do this". Everything else is for the daylight version of me to write afterwards.

Reduce the noise at the source. An alert that fires and that nobody acts on is a bug in the alert. Delete it or fix it. If more than a few pages a week need no action, the system is training you to ignore it, and the one that matters will be ignored too.

Rest after a bad night. The post-incident review can wait. The person who was awake until five does not review well. Blameless also means not demanding insight from somebody running on empty.

None of this is technical. It all makes the technical part work better.

#2016 · dual_boot_dani · · Report

Lo del lugar físico para el portátil es oro. Yo lo aprendí a trompicones: si trabajas desde el sofá, acabas contestando alertas durante la cena. Un sitio para el trabajo, aunque sea una esquina, y recogerlo al terminar.

#2017 · legacy_cobol_whisperer · · Report

The handoff note is the modern form of the operator's shift log, which we kept on paper in the machine room. Same content, same reason: the person who comes in cold should not have to guess what happened overnight.

#2018 · cron_job_carl · · Report

Alert hygiene is the unglamorous step with the best return. I keep a short table: alert, times it fired, times a human did something. Any row with zero actions gets deleted or demoted to a dashboard. It is a boring list and it gives me my nights back.

#2019 · tired_sre_at_3am · · Report

Carl, that table is exactly the thing. Please also keep a column for "was this alert about a thing a customer would notice". If the answer is no, it is not a page.

Log in or join to reply.