Observability Practical By Samson Tanimawo, PhD Published Jun 23, 2026 4 min read

The On-Call Noise Reduction Playbook

Most teams get woken up too much. The 5-step playbook that takes a noisy rotation to actionable in one quarter.

Audit the pages

List every alert that fired in the last 30 days. Mark each: real / noise / unclear.

Anything below 50% real is the priority for tuning.

Tune top offenders

Tighten threshold; widen window; add aggregation; or remove. Each option has trade-offs; pick deliberately.

Re-audit weekly to verify the change took. Some 'tuned' alerts come back noisy after a week.

Compound the wins

Each tuned alert is 1-5 fewer pages per week. Across 10-20 alerts, the rotation transforms.

Track per-shift page count. Trending down is the signal that the playbook is working.