Markdown Editor

事件管理套件

严重级别矩阵、告警策略、事件指挥官手册、值班、运行手册、事件沟通、事后复盘、桌面演练、Game Day、灾备测试与琐事评审。

第 1 步

政策

  1. Incident Severity Matrix Template (SEV1 to SEV4)

    完整

    Organisation SEV1 to SEV4 standard, impact criteria, response per level, security track, crisis flag, upgrade and downgrade rules, worked examples

    PagerDuty Incident Response docs; NIST SP 800-61 Rev. 3
  2. Alerting Policy Template (SLO Burn-Rate Alerts)

    完整

    Symptom-based paging, page vs ticket vs log, multi-window burn-rate rules with worked numbers, alert metadata, naming, routing, noise budget, review, alerts as code

    OpenTelemetry semantic conventions 1.44.0; SLO burn-rate alerting
第 2 步

生产就绪

  1. Incident Commander Handbook Template

    完整

    IC and response roles, RACI, staffing by severity, declaring and taking command, battle rhythm, decision log, escalation, handover, closing, one-page IC checklist

    PagerDuty Incident Response docs; FEMA NIMS 3rd ed. (ICS)
  2. On-call Handbook Template

    标准

    On-call handbook: rotation and handover, severity examples linked to the matrix, response targets, escalation, first 15 minutes, comms templates, wellbeing

    Links ops/incident-severity-matrix; Google SRE books (cited)
  3. Runbook Template

    标准

    Service runbook: overview, dependencies, dashboards, per-alert diagnosis and mitigation with commands, common tasks, rollback, contacts

第 3 步

事件

  1. Incident Communication Template

    标准

    Incident comms plan: audiences, severity matrix, roles, cadence, status page and customer messages, executive brief

  2. Planned Maintenance Notice Template

    精简

    Planned maintenance notice with times in several time zones, impact, actions required, status link, plus a completion follow-up

  3. Incident Postmortem Template

    完整

    Blameless incident postmortem: severity per matrix, impact and error budget, UTC timeline, root cause, 5 Whys, security incident links, action items

    Google SRE postmortem practice (concepts, 1st and 2nd ed.); NIST SP 800-61 Rev. 3
第 4 步

演练与测试

  1. Tabletop Exercise Template (CISA CTEP, HSEEP, NIST SP 800-84)

    完整

    Discussion-based exercise pack: objectives and criteria, roles, ground rules, ransomware scenario with injects, questions, facilitator notes, AAR and Improvement Plan

    CISA Tabletop Exercise Packages; FEMA HSEEP 2020; NIST SP 800-84
  2. Game Day Plan Template

    标准

    Game day exercise: objectives, scenarios, roles, schedule, safety controls, comms, detection and response scoring, debrief

  3. DR Test Report Template (NIST SP 800-84, RTO and RPO Evidence)

    完整

    Evidence of one DR test: SP 800-84 event type, scope, scenario, timeline, RTO and RPO target vs achieved, integrity checks, deviations, findings, actions, sign-off

    NIST SP 800-84; NIST SP 800-34 Rev. 1; NIST SP 800-53 Rev. 5 CP-4, CP-9, CP-10; ISO 22301:2019 (clauses only)
第 5 步

评估

  1. Toil Review Template (Quarterly Operational Load and Automation ROI)

    完整

    Quarterly toil review: toil definition tests, measurement method, toil share per engineer vs cap, pages per shift, on-call health, toil inventory, automation ROI ranking, decisions

    Google SRE book (cited by name only)