Markdown Editor

SRE 및 운영 키트

SLO와 오류 예산, 관측성, 프로덕션 준비, 런북, FMEA, 카오스 실험, 재해 복구, 장애 대응, 포스트모템.

1단계

목표와 관측성

  1. SLO Document Template

    전체

    Service SLO document: user journeys, SLI specs and queries, targets, error budget math, multiwindow burn-rate alerts, review

    Google SRE conventions
  2. Error Budget Policy Template

    표준

    Error budget policy: SLOs covered, budget and burn-rate maths, thresholds, feature freeze, escalation, exceptions, sign-off

  3. Observability Specification Template (OpenTelemetry)

    전체

    Observability spec: logs, metrics and traces standards, semantic conventions, log schema, RED/USE catalogue, sampling, alerts, privacy, cost

    OpenTelemetry concepts
  4. Capacity Plan Template

    전체

    Capacity plan: demand forecast with growth model, utilisation, headroom policy, resource models, bottlenecks, scaling, lead times, cost

2단계

프로덕션 준비

  1. Production Readiness Review Template

    전체

    Production readiness review: SLOs, load test evidence, observability, on-call, rollback, backups, security, failure modes, sign-off

    Google SRE PRR conventions
  2. Runbook Template

    표준

    Service runbook: overview, dependencies, dashboards, per-alert diagnosis and mitigation with commands, common tasks, rollback, contacts

  3. Deployment and Release Runbook Template

    표준

    Deployment runbook: release metadata, pre-deploy checklist, go/no-go, steps with verification, canary rollout, rollback, comms

  4. On-call Handbook Template

    표준

    On-call handbook: rotation and handover, severity matrix, response targets, escalation, first 15 minutes, comms templates, wellbeing

3단계

복원력과 복구

  1. Software FMEA Template (IEC 60812)

    전체

    Software failure modes, effects, causes, controls, S/O/D scales, RPN and action priority, actions and re-scoring

    IEC 60812:2018
  2. Chaos Experiment Plan Template

    표준

    Chaos engineering experiment: steady state, hypothesis, faults, blast radius, abort conditions, runbook, results, actions

    Principles of Chaos Engineering
  3. Game Day Plan Template

    표준

    Game day exercise: objectives, scenarios, roles, schedule, safety controls, comms, detection and response scoring, debrief

  4. IT Disaster Recovery Plan Template (NIST SP 800-34)

    전체

    IT disaster recovery plan: roles, contact tree, BIA with RTO/RPO/MTD, activation flow, recovery procedures, reconstitution, exercises

    NIST SP 800-34 Rev. 1
  5. Backup and Restore Procedure Template

    표준

    Backup and restore procedure: data inventory, policy table with 3-2-1 check, jobs, monitoring, step-by-step restore, test evidence log

4단계

장애

  1. Incident Response Plan Template

    표준

    IR phases, severity matrix, comms

  2. Incident Communication Template

    표준

    Incident comms plan: audiences, severity matrix, roles, cadence, status page and customer messages, executive brief

  3. Incident Postmortem Template

    전체

    Blameless incident postmortem: impact and error budget consumed, UTC timeline, root cause, 5 Whys, action items, lessons

    Google SRE postmortem practice (concepts)