Bộ mẫu SRE và vận hành
SLO và error budget, observability, sẵn sàng production, runbook, FMEA, thử nghiệm chaos, khôi phục thảm họa, ứng phó sự cố và postmortem.
Mục tiêu và quan sát
SLO Document Template
Đầy đủService SLO document: user journeys, SLI specs and queries, targets, error budget math, multiwindow burn-rate alerts, review
Google SRE conventionsError Budget Policy Template
ChuẩnError budget policy: SLOs covered, budget and burn-rate maths, thresholds, feature freeze, escalation, exceptions, sign-off
Observability Specification Template (OpenTelemetry)
Đầy đủObservability spec: logs, metrics and traces standards, semantic conventions, log schema, RED/USE catalogue, sampling, alerts, privacy, cost
OpenTelemetry conceptsCapacity Plan Template
Đầy đủCapacity plan: demand forecast with growth model, utilisation, headroom policy, resource models, bottlenecks, scaling, lead times, cost
Sẵn sàng production
Production Readiness Review Template
Đầy đủProduction readiness review: SLOs, load test evidence, observability, on-call, rollback, backups, security, failure modes, sign-off
Google SRE PRR conventionsRunbook Template
ChuẩnService runbook: overview, dependencies, dashboards, per-alert diagnosis and mitigation with commands, common tasks, rollback, contacts
Deployment and Release Runbook Template
ChuẩnDeployment runbook: release metadata, pre-deploy checklist, go/no-go, steps with verification, canary rollout, rollback, comms
On-call Handbook Template
ChuẩnOn-call handbook: rotation and handover, severity matrix, response targets, escalation, first 15 minutes, comms templates, wellbeing
Khả năng phục hồi
Software FMEA Template (IEC 60812)
Đầy đủSoftware failure modes, effects, causes, controls, S/O/D scales, RPN and action priority, actions and re-scoring
IEC 60812:2018Chaos Experiment Plan Template
ChuẩnChaos engineering experiment: steady state, hypothesis, faults, blast radius, abort conditions, runbook, results, actions
Principles of Chaos EngineeringGame Day Plan Template
ChuẩnGame day exercise: objectives, scenarios, roles, schedule, safety controls, comms, detection and response scoring, debrief
IT Disaster Recovery Plan Template (NIST SP 800-34)
Đầy đủIT disaster recovery plan: roles, contact tree, BIA with RTO/RPO/MTD, activation flow, recovery procedures, reconstitution, exercises
NIST SP 800-34 Rev. 1Backup and Restore Procedure Template
ChuẩnBackup and restore procedure: data inventory, policy table with 3-2-1 check, jobs, monitoring, step-by-step restore, test evidence log
Sự cố
Incident Response Plan Template
ChuẩnIR phases, severity matrix, comms
Incident Communication Template
ChuẩnIncident comms plan: audiences, severity matrix, roles, cadence, status page and customer messages, executive brief
Incident Postmortem Template
Đầy đủBlameless incident postmortem: impact and error budget consumed, UTC timeline, root cause, 5 Whys, action items, lessons
Google SRE postmortem practice (concepts)