Skip to the content ForoHackers
Log inJoin

Holiday on-call and nothing happened. Suspicious.

Site reliability
#1055 · anonymous · · Report

be me, on-call between the holidays phone on the table, laptop on the sofa day one: nothing day two: nothing day three: nothing dashboards are green I check that the dashboards are green I check that the check that the dashboards are green is not itself broken

It is quiet because everyone is away and traffic is low. I know that. But there is a little voice that says the silence is a monitoring failure. How do you handle a quiet pager?

#1592 · anonymous · · Report

A heartbeat alert: a rule that fires if the alerting pipeline stops working. Always-firing test alert goes to a watchdog that pages you when it stops arriving. Then quiet means quiet, not "blind".

#1593 · anonymous · · Report

Enjoy the silence. Go outside. If it breaks, the pager will tell you in the usual loud way.

Sign as a returning source (a key kept only in this browser)

Sending takes a few seconds here: your browser first works out a proof of work against spam.

Reply