Security Logging Standard Template (OMB M-26-14, NIST AU)
Logging policy statements, required sources by tier, fields and UTC time sync, SIEM pipeline, integrity, searchable vs retrievable retention, privacy, coverage metrics, use cases
उपयोग कैसे करें: Use it when you set organisation-wide rules for security event logs that the SOC and incident responders rely on. Fill the system tiers and source catalogue first, then fields, retention and coverage metrics. The main pitfall is measuring coverage against what the SIEM already receives instead of the asset inventory.
प्रीव्यू
Security Logging Standard: [Organisation name]
Organisation-wide standard for security event logging: what every system must log, in which format, how logs reach the central platform, how they are protected, how long they stay searchable and retrievable, how personal data in logs is minimised, and how coverage and detection value are measured. Informed by the joint guide Best Practices for Event Logging and Threat Detection (ASD's ACSC with CISA, FBI, NSA and international partners, August 2024), the NIST SP 800-53 Rev. 5 Audit and Accountability (AU) control family (Release 5.2.0, August 2025), and, for United States federal agencies, OMB Memorandum M-26-14 (22 May 2026), which rescinded M-21-31. NIST SP 800-92 Rev. 1 is cited only as an initial public draft. Replace every
[bracketed]value and every row marked Example. Worked examples use Corvid Commerce, a fictional SaaS company (Example).
Document control
| Field | Value |
|---|---|
| Document ID | [SEC-STD-LOG-001] |
| Version | [0.1] |
| Status | [Draft / In review / Approved / Superseded] |
| Owner | [@security-operations-lead] |
| Approvers / reviewers | [@ciso], [@head-of-platform], [@data-protection-officer], [@legal-counsel] |
| Last updated | YYYY-MM-DD |
| Classification | Internal |
| Effective date | YYYY-MM-DD |
| Next review | YYYY-MM-DD (at least annually, and after any major incident or SIEM change) |
| Central log platform | [Example: Corvid Commerce SIEM tenant siem-prod-eu, plus object-storage archive] |
| Applicable frameworks | [Example: NIST SP 800-53 Rev. 5 AU family, ISO/IEC 27001:2022 Annex A, SOC 2] |
| Related | Security policy, Incident Response Plan (compliance/incident-response-plan), Observability Specification (ops/observability-spec), Detection Rule Specification (security/detection-rule-spec) |
Approvals
| Role | Name | Decision | Date |
|---|---|---|---|
| Chief information security officer | [@name] | [Approved / Changes requested] | YYYY-MM-DD |
| Head of platform engineering | [@name] | [Decision] | YYYY-MM-DD |
| Data protection officer | [@name] | [Decision] | YYYY-MM-DD |
| Legal counsel (retention and legal hold) | [@name] | [Decision] | YYYY-MM-DD |
Revision history
| Version | Date | Author | Change summary |
|---|---|---|---|
| 0.1 | YYYY-MM-DD | [@name] | First draft |
| 0.2 | YYYY-MM-DD | [@name] | Example: Added SaaS audit sources and OT network sensors after coverage review |
| 1.0 | YYYY-MM-DD | [@name] | Example: Approved by security steering committee |
Contents
- Purpose
- Scope and applicability
- Roles and responsibilities
- Policy statements
- Required log sources by tier
- Required fields, format and time synchronisation
- Centralisation and SIEM
- Integrity, protection and access control
- Retention
- Privacy and data minimisation
- Coverage measurement and metrics
- Detection use cases
- Onboarding a log source
- Exceptions and risk acceptance
- Compliance, review and related documents
- Glossary and references
1. Purpose
This standard sets the minimum security logging that every system owned or operated by [Organisation name], or operated by a third party on its behalf, must provide. It exists so that the security operations centre (SOC) can:
- Detect malicious activity promptly, including techniques that use legitimate administrative tools and valid accounts.
- Investigate a suspected compromise and establish its scope, entry point, lateral movement, affected data and timeline.
- Support containment, recovery and lessons learned, and provide evidence to regulators, customers, insurers and law enforcement when required.
- Demonstrate that controls operate, for audits and customer assurance.
The standard balances detection value against cost and privacy. Collecting everything is neither affordable nor lawful; collecting too little leaves incidents unexplained. Each required source in section 5 is justified by a detection or investigation need in section 12.
2. Scope and applicability
In scope:
- Production, staging and corporate environments, on premises and in every cloud account, subscription or project.
- Identity providers, endpoints, servers, containers and Kubernetes clusters, network and edge devices, databases and data platforms.
- Software-as-a-Service (SaaS) applications that hold company or customer data, including collaboration, source control and CI/CD services.
- Operational technology (OT) and Internet of Things (IoT) devices that are part of a company information system.
- Systems operated by suppliers on the organisation's behalf, through contract clauses (section 4, LOG-POL-012).
Out of scope:
- Application performance telemetry used only for reliability (see Observability Specification (
ops/observability-spec)). - Content of customer documents and messages. Logs record events about data, never the data itself (section 10).
- [Example: Personal devices not enrolled in mobile device management.]
Where this standard conflicts with a law, regulation or contract, the stricter applicable requirement wins and the conflict is recorded as an exception (section 14) or a change request to this standard.
3. Roles and responsibilities
| Role | Responsibilities |
|---|---|
| CISO | Approves the standard, retention schedule and exceptions above the risk threshold |
| Security operations lead (standard owner) | Maintains the standard, source catalogue and coverage metrics; reviews onboarding requests |
| SOC / detection engineering | Builds and tunes detections, monitors ingestion health, triages alerts |
| System owner | Enables required logging, keeps it enabled through changes, fixes gaps within SLA |
| Platform / SIEM engineering | Runs the collection pipeline, parsers, storage tiers and access control |
| Data protection officer | Reviews personal data in logs, retention and lawful basis |
| Legal counsel | Approves legal holds and retention beyond the schedule |
| Internal audit | Tests compliance annually |
RACI (R responsible, A accountable, C consulted, I informed):
| Activity | CISO | SecOps lead | SOC / DE | System owner | Platform | DPO | Legal |
|---|---|---|---|---|---|---|---|
| Approve standard and retention | A | R | C | I | C | C | C |
| Enable logging on a system | I | C | C | A, R | C | I | I |
| Onboard source to SIEM | I | A | R | C | R | I | I |
| Build and tune detections | I | A | R | C | I | I | I |
| Approve personal data fields | I | C | C | C | I | A, R | C |
| Approve exception | A | R | C | R | I | C | I |
| Place or release legal hold | I | C | I | I | R | C | A |
4. Policy statements
| ID | Statement | Control reference |
|---|---|---|
| LOG-POL-001 | Every in-scope system MUST generate the events required for its tier in section 5 and MUST keep them enabled through upgrades and configuration changes. | AU-2, AU-12 |
| LOG-POL-002 | Required events MUST contain the fields in section 6.1 and MUST use timestamps synchronised to the organisation's designated time source. | AU-3, AU-8 |
| LOG-POL-003 | Required logs MUST be forwarded to, or be queryable from, the central log platform within the ingestion latency target for the tier. | AU-6(4), AU-12 |
| LOG-POL-004 | Logs MUST be protected against unauthorised read, modification and deletion, in transit and at rest; log deletion MUST require two-person approval. | AU-9, AU-9(5) |
| LOG-POL-005 | Logs MUST be retained per the schedule in section 9 and MUST NOT be deleted while a legal hold applies. | AU-11 |
| LOG-POL-006 | Logging failures (source silent, parser errors, storage full) MUST raise an alert to the SOC and the system owner; storage capacity MUST be planned so that logs are not overwritten before the end of retention. | AU-4, AU-5 |
| LOG-POL-007 | Logs MUST NOT contain secrets, full payment card numbers, authentication credentials or document content; personal data SHOULD be limited to identifiers needed for security purposes. | AU-3(3), PT family |
| LOG-POL-008 | Administrative and privileged actions MUST be logged with the identity of the human behind any shared or service account. | AU-3, AC-6(9) |
| LOG-POL-009 | Tier 1 sources MUST have at least one active detection use case mapped in section 12. | SI-4 |
| LOG-POL-010 | New systems MUST complete log source onboarding (section 13) before production go-live. | AU-12, SA-3 |
| LOG-POL-011 | Access to logs MUST be role-based, logged and reviewed at least quarterly. | AU-9(4), AC-2 |
| LOG-POL-012 | Contracts for systems operated by suppliers SHOULD require export or API access to the security events in section 5 and notice before logging changes. | SA-9, SR family |
| LOG-POL-013 | Logging configuration SHOULD be defined as code and reviewed like any other change. | CM-3 |
| LOG-POL-014 | The source catalogue and coverage metrics MUST be reviewed at least quarterly. | AU-2, CA-7 |
Control references point to NIST SP 800-53 Rev. 5 identifiers. Map them to your own control framework in your statement of applicability.
5. Required log sources by tier
5.1 System tiers
| Tier | Definition | Ingestion latency target | Examples (Example) |
|---|---|---|---|
| Tier 1 | Systems whose compromise gives broad control or exposes customer data at scale: identity, cloud control planes, production data stores, CI/CD, secrets management, internet-facing services | [Example: 5 minutes] | Corvid Commerce identity provider, AWS Organization CloudTrail, production PostgreSQL, CI runners |
| Tier 2 | Business-critical systems with limited blast radius | [Example: 15 minutes] | Internal admin tools, support desk SaaS, data warehouse |
| Tier 3 | Other systems | [Example: 60 minutes] | Printers, meeting room devices, test environments without real data |
The prioritisation follows the joint guide's logic: favour sources most likely to be targeted and most damaging if compromised, and sources that reveal living off the land (LOTL) activity.
5.2 Source catalogue
| Source ID | Category | Source | Required events | Tier 1 | Tier 2 | Tier 3 |
|---|---|---|---|---|---|---|
| SRC-IDN-001 (Example) | Identity | Identity provider (SSO, MFA) | Sign-in success and failure, MFA challenge and result, token issuance, session revocation, admin role change, policy change | MUST | MUST | MUST |
| SRC-IDN-002 (Example) | Identity | Directory and domain controllers | Account create, delete, enable, group membership change, Kerberos and NTLM authentication, privileged logon | MUST | MUST | SHOULD |
| SRC-IDN-003 (Example) | Identity | Privileged access and secrets manager | Secret read, rotation, checkout, policy change, break-glass use | MUST | MUST | n/a |
| SRC-END-001 (Example) | Endpoint | EDR on servers and workstations | Process creation with command line, script execution, driver load, tamper attempts, detections | MUST | MUST | SHOULD |
| SRC-END-002 (Example) | Endpoint | Operating system security logs | Logon, privilege use, service install, scheduled task, audit policy change, log cleared | MUST | MUST | SHOULD |
| SRC-NET-001 (Example) | Network | Firewalls and edge devices | Allowed and denied connections at boundaries, admin logon, configuration change | MUST | MUST | SHOULD |
| SRC-NET-002 (Example) | Network | DNS resolvers | Query name, type, response, client | MUST | SHOULD | SHOULD |
| SRC-NET-003 (Example) | Network | Web proxy and secure web gateway | URL, category, action, user, bytes | MUST | SHOULD | SHOULD |
| SRC-NET-004 (Example) | Network | VPN and zero trust access | Session start and end, device posture, source address | MUST | MUST | n/a |
| SRC-NET-005 (Example) | Network | Cloud flow logs | Accepted and rejected flows for Tier 1 networks | MUST | SHOULD | MAY |
| SRC-CLD-001 (Example) | Cloud control plane | Provider audit logs (management events) | All write and administrative API calls, console sign-in, IAM changes, logging configuration changes | MUST | MUST | MUST |
| SRC-CLD-002 (Example) | Cloud control plane | Data access audit logs | Read and write on Tier 1 storage buckets, key management operations | MUST | SHOULD | MAY |
| SRC-CLD-003 (Example) | Cloud control plane | Kubernetes API audit | Secrets, ConfigMaps and TokenReviews at Metadata level only (never Request or RequestResponse, which would record secret values); RBAC changes, pods/exec, attach and portforward at Request level; admission decisions | MUST | SHOULD | n/a |
| SRC-SAS-001 (Example) | SaaS | Collaboration suite audit | Admin actions, sharing changes, mailbox rules, OAuth app consent, mass download | MUST | MUST | n/a |
| SRC-SAS-002 (Example) | SaaS | Source control and CI/CD | Repository permission change, branch protection change, token creation, workflow run on protected branch, secret access | MUST | MUST | n/a |
| SRC-APP-001 (Example) | Application | Customer-facing application security events | Authentication, authorisation failure, account recovery, admin action, export of customer data | MUST | SHOULD | n/a |
| SRC-DB-001 (Example) | Data | Database audit | Privileged sessions, schema change, bulk export, audit setting change | MUST | SHOULD | n/a |
| SRC-OT-001 (Example) | OT | OT network sensors and historians | Connections across the IT/OT boundary, engineering workstation sessions, controller program change | MUST where present | SHOULD | n/a |
| SRC-SEC-001 (Example) | Security tools | Email security, WAF, vulnerability scanner, DLP | Detections, policy change, scanner authentication | MUST | SHOULD | n/a |
Rules for the catalogue:
- Cloud control plane: log all control plane operations, including API calls and console sign-ins, with read and write activity for Tier 1 resources. Enable organisation-level trails so that new accounts inherit logging.
- SaaS: confirm under the shared responsibility model which audit events the provider exposes, at which licence tier, and for how long the provider keeps them. Pull them into the central platform; do not rely on the provider console as the retention store.
- OT: many OT devices cannot produce detailed logs, and heavy logging can affect constrained controllers. Use passive network sensors and historian data instead, and agree logging changes with the OT engineering owner.
- Mobile: log device posture, sign-ins and mobile device management events. Get legal advice before logging anything from personally owned devices, such as location.
5.3 Event categories that every Tier 1 system must cover
The following categories are the minimum investigative baseline and a sound baseline for any organisation. They cover the data-collection activities listed for US federal agencies in OMB M-26-14 Appendix B item 5 (items a to f, i and j); the detection activities in the same list (hunting for known indicators of compromise, anomalous activity and automated alerts, items g, h and k) are covered by section 12:
- Which identity performed each operation, including service accounts.
- Source and destination network address, protocol, port and session attributes.
- Access to, modification of and deletion of objects and data.
- Changes to privilege levels and role assignments.
- Addition, removal and modification of infrastructure, endpoints and devices.
- Alerts from security tooling such as EDR, intrusion detection and gateways.
- Data that lets responders estimate the quantity and type of data affected, and the attack vector, including initial access and lateral movement.
6. Required fields, format and time synchronisation
6.1 Required fields
| Field | Requirement | Notes |
|---|---|---|
timestamp | MUST | Event time in UTC, ISO 8601, millisecond precision where the source supports it, for example 2026-10-24T09:15:02.481Z |
ingest_time | MUST (added by pipeline) | Used to measure ingestion latency |
event_id | MUST | Unique identifier for correlation and deduplication |
event_type / action | MUST | Normalised action, plus the source's native code |
outcome | MUST | success, failure, unknown |
actor.id | MUST where applicable | Stable identifier (user ID, service principal, role session); never only a display name |
actor.on_behalf_of | SHOULD | Human behind a shared, assumed or service identity |
source.ip, destination.ip | MUST for network events | IPv4 and IPv6 |
source.port, destination.port, network.protocol | MUST for network events | |
host.id, host.name | MUST for host events | Device identifier that survives renaming |
session.id / transaction.id | SHOULD | Links related events |
target.resource | MUST for object events | Resource identifier, account or project |
process.command_line | MUST for process events | Subject to redaction rules in section 10 |
user_agent, HTTP headers | SHOULD for web events | Strip credentials and cookies |
source_system, source_tier | MUST (added by pipeline) | Ties events to the source catalogue |
6.2 Format
- Use structured logs (JSON or key-value pairs) with a consistent schema per log type. Normalise at ingestion to the organisation's schema [Example: Elastic Common Schema or OCSF] and keep the original event.
- Version parsers. SaaS and vendor formats change without notice: alert on parser failure rates, not only on volume.
- Where an event also flows into the operational telemetry pipeline, align attribute names with the OpenTelemetry semantic conventions adopted in the Observability Specification (
ops/observability-spec).
6.3 Time synchronisation
- All systems MUST synchronise to the designated internal time sources using NTP or an equivalent protocol; Tier 1 systems SHOULD use at least two sources so that the loss of one does not skew time (NIST SP 800-53 Rev. 5 SC-45, SC-45(1) and SC-45(2)).
- Record events in UTC. Convert to local time only in presentation.
- OT environments take time from the IT environment, never the reverse.
- Alert when clock drift on a Tier 1 host exceeds [Example: 1 second].
- Log device boots, restarts and time changes, as they explain gaps.
7. Centralisation and SIEM
Requirements:
- The SOC MUST be able to query every Tier 1 source from one place within the latency target, either because the logs are stored centrally or because the central platform has federated query access to them.
- Collectors MUST buffer locally during outages for at least [Example: 24 hours] and replay in order.
- The pipeline MUST tag each event with
source_systemandsource_tier, apply redaction rules (section 10) before the hot tier, and write the raw event to the archive. - Enrichment SHOULD add asset owner, environment, geolocation of public IPs and identity attributes, so that triage does not require lookups.
- Every source MUST have an expected volume baseline; a drop of more than [Example: 50 percent] against the same hour last week, or silence for more than [Example: 30 minutes] on Tier 1, raises an ingestion alert.
- The platform's own audit logs (queries, rule changes, user changes, retention changes) are a Tier 1 source.
8. Integrity, protection and access control
| Control | Requirement |
|---|---|
| Transport | TLS 1.2 or later between collectors and the platform; mutual authentication for forwarders where supported |
| Encryption at rest | Hot and archive tiers encrypted; keys managed in the key management service with separate administrators |
| Immutability | Archive tier uses write-once retention (object lock or equivalent) for the retention period |
| Separation | Log storage lives in a dedicated security account or subscription that production administrators cannot administer |
| Deletion | Early deletion or retention reduction requires two-person approval (SecOps lead and CISO) and is itself logged |
| Integrity checks | Hash or sign archive batches; verify a sample [Example: monthly] and before handing evidence to third parties |
| Access | Role-based: analyst (read hot tier), investigator (read archive, rehydrate), engineer (pipeline and parsers), administrator (platform). Just-in-time elevation for archive access |
| Access review | Quarterly review of all log platform roles, recorded in the Access Review Template (ops/access-review) |
| Tamper detection | Alert on audit policy changes, cleared logs, disabled trails or agents, and stopped forwarders |
9. Retention
9.1 Definitions
- Searchable (hot): data that detections and analysts can query immediately, without preparation.
- Retrievable (cold): data that can be used after one or more preparation steps, such as restoring from archive or rehydrating into the search platform. The standard sets a maximum retrieval time.
These definitions follow the meaning used in OMB M-26-14.
9.2 Retention schedule
| Log class | Searchable | Retrievable (total) | Maximum retrieval time | Basis |
|---|---|---|---|---|
| Identity and authentication (Tier 1) | [Example: 12 months] | [Example: 24 months] | [Example: 24 hours] | Detection, long dwell times, customer contracts |
| Cloud control plane audit | [Example: 12 months] | [Example: 24 months] | [Example: 24 hours] | Investigation of account takeover and persistence |
| EDR and OS security logs | [Example: 6 months] | [Example: 12 months] | [Example: 48 hours] | Investigation |
| Network (firewall, DNS, proxy, flow) | [Example: 3 months] | [Example: 12 months] | [Example: 48 hours] | Volume versus value |
| SaaS audit | [Example: 6 months] | [Example: 18 months] | [Example: 48 hours] | Provider retention often shorter |
| Application security events | [Example: 6 months] | [Example: 12 months] | [Example: 48 hours] | Fraud and abuse investigations |
| Log platform audit | [Example: 12 months] | [Example: 36 months] | [Example: 24 hours] | Evidence integrity |
Set the values from a risk assessment. The joint guide notes that default retention periods are often too short and that intrusions can go undetected for long periods; logs that confirm an intrusion and its impact deserve the longest retention. Check storage allocations at the same time as retention periods, because systems that overwrite logs when storage fills silently shorten retention. US federal agencies: set no log class below 6 months searchable and 12 months retrievable (9.3); several Example rows above are below that baseline.
9.3 Benchmark for US federal agencies (OMB M-26-14)
OMB M-26-14 (22 May 2026) rescinded M-21-31 with immediate effect and replaced its event logging tiers with a baseline and a maturity model. As published, Appendix B requires retained logs to be actively searchable for at least 6 months after creation and retrievable for a year after creation, without relieving agencies of records schedule obligations. Its Appendix C maturity model rates data retention, collection coverage, collection operations, inventory visibility and log management, with overall maturity set by the lowest-scoring element. CISA released the Logging Reference Architecture (LRA) required by the memorandum on 20 August 2026 (cisa.gov/Logging), together with an agency logging plan template; the memorandum's deadlines for agency logging plans and maturity levels run from the LRA release. Check the current LRA version before relying on it. The memorandum applies to US federal agencies as defined in 44 U.S.C. 3502, excluding national security systems and certain Department of Defense and Intelligence Community systems; other organisations can use it as a benchmark. Check the current text at whitehouse.gov before relying on it.
9.4 Legal hold and disposal
- Legal counsel places holds by case ID; the platform MUST suspend deletion for matching data and record the hold.
- At the end of retention, data is deleted automatically and the deletion job is logged. Manual deletion follows LOG-POL-004.
- Records schedules and privacy law can require shorter or longer periods than this standard. Record the governing rule per log class.
10. Privacy and data minimisation
- Necessity: each personal data field in section 6.1 has a documented security purpose. Do not log fields "in case they are useful".
- Never log: passwords, MFA secrets, session cookies, bearer tokens, API keys, private keys, full payment card numbers, document or message content, health data.
- Redact or tokenise at the pipeline: query strings with tokens, authorisation headers, email bodies, form fields. Keep a keyed hash where correlation is needed (for example HMAC-SHA-256 with a key held in the key management service, separate from the log platform administrators), and rotate the key per retention period. A plain or fixed-salt hash of an email address or IP address can be reversed by brute force and is not real pseudonymisation.
- Pseudonymise where analysts do not need the identity for triage, with re-identification restricted to investigators.
- Purpose limitation: security logs MUST NOT be used for performance management of employees except through an approved HR investigation process involving legal counsel.
- Transparency: describe security logging in employee and customer privacy notices, and record processing in the records of processing (
compliance/gdpr-ropawhere GDPR applies). - Data residency: where privacy or sovereignty law applies, record the storage region for each log class and assess transfers.
- Lawful basis and storage limitation: record the lawful basis for each log class (for example legitimate interests in network and information security, GDPR Recital 49) and tie retention to the storage limitation principle through section 9. Check works council or employee consultation duties before monitoring employee activity in jurisdictions that require them.
- Review: the DPO reviews new sources carrying personal data and the redaction rule set at least annually.
Assess high-risk processing, such as user behaviour analytics over employee activity, with a DPIA (compliance/dpia).
11. Coverage measurement and metrics
| Metric ID | Metric | Formula | Target (Example) | Cadence |
|---|---|---|---|---|
| LOG-MET-001 | Source coverage, Tier 1 | systems sending all required Tier 1 sources / Tier 1 systems in inventory x 100 | 95 percent | Monthly |
| LOG-MET-002 | Source coverage, Tier 2 | same as LOG-MET-001 for Tier 2 | 85 percent | Monthly |
| LOG-MET-003 | Inventory completeness | assets in central inventory / assets discovered by network and cloud discovery x 100 | 95 percent | Monthly |
| LOG-MET-004 | Ingestion latency | 95th percentile of (ingest_time minus timestamp) per tier | within tier target | Weekly |
| LOG-MET-005 | Silent source rate | Tier 1 sources silent beyond threshold in the period / Tier 1 sources x 100 | under 2 percent | Weekly |
| LOG-MET-006 | Parse success | events parsed into the schema / events received x 100 | 99 percent | Weekly |
| LOG-MET-007 | Detection coverage | Tier 1 sources with at least one active use case / Tier 1 sources x 100 | 100 percent | Quarterly |
| LOG-MET-008 | Retention compliance | log classes meeting searchable and retrievable targets / log classes x 100 | 100 percent | Quarterly |
| LOG-MET-009 | Retrieval test success | archive retrieval tests completed within maximum retrieval time / tests run x 100 | 100 percent | Quarterly |
| LOG-MET-010 | Gap remediation | gaps closed within SLA / gaps opened x 100 | 90 percent | Monthly |
Worked example (Example): Corvid Commerce has 120 Tier 1 systems in its inventory. 111 send every required Tier 1 source. LOG-MET-001 = 111 / 120 x 100 = 92.5 percent, below the 95 percent target. The 9 gaps are 5 SaaS tools without audit API licences and 4 legacy virtual machines without EDR. Each gap gets an owner and a remediation date, or an exception (section 14).
Gap remediation SLA (Example): Tier 1 gap fixed within 30 days, Tier 2 within 60 days, Tier 3 within 90 days, measured from detection of the gap.
12. Detection use cases
| Use case ID | Use case | Required sources | ATT&CK technique (reference) | Rule owner |
|---|---|---|---|---|
| DUC-001 (Example) | Sign-in from an unfamiliar location followed by MFA method change | SRC-IDN-001 | T1078 Valid Accounts; T1098.005 Account Manipulation: Device Registration | [@detection-engineer] |
| DUC-002 (Example) | Repeated MFA push denials then success (push fatigue) | SRC-IDN-001 | T1621 Multi-Factor Authentication Request Generation | [@detection-engineer] |
| DUC-003 (Example) | Cloud audit trail stopped or logging configuration changed | SRC-CLD-001 | T1685.002 Disable or Modify Tools: Disable or Modify Cloud Log | [@detection-engineer] |
| DUC-004 (Example) | New access key created for a privileged cloud role outside change window | SRC-CLD-001 | T1098.001 Account Manipulation: Additional Cloud Credentials | [@detection-engineer] |
| DUC-005 (Example) | Encoded or obfuscated PowerShell launched by an Office process | SRC-END-001 | T1059.001 PowerShell | [@detection-engineer] |
| DUC-006 (Example) | Security event log cleared on a server | SRC-END-002 | T1685.005 Disable or Modify Tools: Clear Windows Event Logs | [@detection-engineer] |
| DUC-007 (Example) | Mass deletion or snapshot deletion on Tier 1 storage | SRC-CLD-002 | T1485 Data Destruction; T1490 Inhibit System Recovery | [@detection-engineer] |
| DUC-008 (Example) | OAuth application granted broad mailbox or file scopes | SRC-SAS-001 | T1528 Steal Application Access Token | [@detection-engineer] |
| DUC-009 (Example) | Branch protection disabled on a release repository | SRC-SAS-002 | T1195 Supply Chain Compromise (precursor) | [@detection-engineer] |
| DUC-010 (Example) | Large export of customer records by one identity | SRC-APP-001, SRC-DB-001 | T1213 Data from Information Repositories | [@detection-engineer] |
| DUC-011 (Example) | Rare parent-child process using native admin tools on a domain controller (LOTL) | SRC-END-001, SRC-IDN-002 | T1003.003 OS Credential Dumping: NTDS | [@detection-engineer] |
| DUC-012 (Example) | Connection from IT network to OT controller outside approved engineering hosts | SRC-OT-001 | T0886 Remote Services (ATT&CK for ICS) | [@ot-security-engineer] |
Technique IDs were checked against MITRE ATT&CK Enterprise v20 and ATT&CK for ICS (October 2026). ATT&CK v19 split Defense Evasion into Stealth (TA0005) and Defense Impairment (TA0112), and v20 keeps that split: the former Impair Defenses sub-techniques now sit under T1685 Disable or Modify Tools, so disabling a cloud trail is T1685.002 and clearing Windows event logs is T1685.005. The same IDs are used in the SOC Playbook (security/soc-playbook) and the Detection Rule Specification (security/detection-rule-spec). Check every ID against the current release before reuse, because techniques are renamed, merged and revoked between releases. Response procedures for these use cases live in SOC playbooks; proactive searches over the same data live in the Threat Hunting Plan (security/threat-hunting-plan).
Traceability (Example): policy LOG-POL-009 requires a use case per Tier 1 source; source SRC-CLD-001 maps to DUC-003 and DUC-004; DUC-003 is implemented as rule DET-CLD-003 in the detection rule repository; its response is playbook PB-CLD-002 (trigger TRG-04 in the SOC Playbook); its coverage counts toward LOG-MET-007.
13. Onboarding a log source
- Classify: the system owner assigns the tier (5.1) and lists the applicable source IDs (5.2). Verify: tier recorded in the asset inventory.
- Privacy check: the system owner lists personal data fields; the DPO approves or requests redaction. Verify: approval recorded on the onboarding ticket.
- Enable logging: configure required events, time sync and forwarding as code. Verify: configuration merged and deployed.
- Parse and normalise: platform engineering adds or reuses a parser and maps fields to the schema. Verify: parse success above 99 percent on a test sample.
- Baseline volume and health: record the expected volume and set silence and drop alerts. Verify: a test silence triggers the alert.
- Detections: detection engineering links at least one use case for Tier 1. Verify: rule fires on a test event.
- Retention: confirm the hot and archive tiers apply the right log class. Verify: retention settings exported and attached.
- Sign-off: SecOps lead approves. Verify: source added to the catalogue with owner and date.
Rollback: if forwarding harms system performance, reduce verbosity to the Tier minimum rather than disabling logging, inform the SOC, and open an exception if the minimum cannot be met.
Decommissioning: keep the logs for their retention period after the system is retired; remove silence alerts only after confirming the decommission in the inventory.
14. Exceptions and risk acceptance
| Field | Content |
|---|---|
| Exception ID | LOG-EXC-NNN |
| Policy statement | LOG-POL-NNN affected |
| System and tier | [System name, tier] |
| Reason | Technical limit, cost, supplier constraint, legal constraint |
| Risk | What the SOC cannot detect or investigate as a result |
| Compensating controls | Alternative source, network sensor, manual review |
| Approver | SecOps lead up to Tier 2; CISO for Tier 1 |
| Expiry | Maximum [Example: 12 months]; renewal requires fresh approval |
Example (Example): LOG-EXC-004, LOG-POL-001, support desk SaaS (Tier 2). The current plan exposes admin audit events only through the web console with 90 days of history. Risk: limited investigation of support agent account misuse beyond 90 days. Compensating control: weekly export of audit events to the archive and alerting on admin role changes through the identity provider. Approved by [@secops-lead], expires YYYY-MM-DD, pending a plan upgrade.
15. Compliance, review and related documents
Compliance measurement: the SecOps lead reports the metrics in section 11 monthly to the security steering committee. Internal audit tests a sample of systems against sections 5, 6, 8 and 9 at least annually. Non-compliance without an approved exception is recorded as a finding with an owner and due date; repeated Tier 1 gaps escalate to the CISO.
Review cycle: review at least annually, after any major incident where missing logs hindered the investigation, after a SIEM or pipeline change, and when relevant law or guidance changes.
Related documents:
| Document | Relationship |
|---|---|
Observability Specification (ops/observability-spec) | Operational telemetry, naming conventions and operational log retention |
Detection Rule Specification (security/detection-rule-spec) | Specification for each rule implementing a use case |
SOC Playbook (security/soc-playbook) | Response steps for alerts from these logs |
Threat Hunting Plan (security/threat-hunting-plan) | Hypothesis-driven hunts over retained data |
Incident Response Plan (compliance/incident-response-plan) | Evidence handling and incident phases |
Incident Severity Matrix (ops/incident-severity-matrix) | Severity levels used when log gaps cause incidents |
Alerting Policy (ops/alerting-policy) | Paging rules for ingestion health alerts |
Cloud Security Posture Review (security/cloud-security-posture-review) | Periodic check of cloud logging configuration |
Secrets Management Standard (security/secrets-management-standard) | Secrets that must never appear in logs |
Access Review Template (ops/access-review) | Quarterly review of log platform access |
Tabletop Exercise (security/tabletop-exercise) | Exercises that test whether logs answer investigation questions |
16. Glossary and references
16.1 Glossary
| Term | Definition |
|---|---|
| SIEM | Security information and event management platform that stores, correlates and alerts on security events |
| Searchable | Data usable for queries and detections immediately, without preparation |
| Retrievable | Data usable after preparation such as restoration from archive |
| Hot tier / cold tier | Storage optimised for fast query / storage optimised for low cost |
| LOTL | Living off the land: attacker use of legitimate built-in tools to avoid detection |
| Control plane | Management interface of a cloud or platform, such as the API that creates resources and grants permissions |
| Detection use case | A described threat behaviour the SOC must detect, with the sources and rules that implement it |
| Ingestion latency | Time between event creation and its availability for search |
| Legal hold | Instruction to preserve data relevant to a legal matter beyond normal retention |
| Source catalogue | Register of log sources, their owners, tiers and required events |
16.2 References
| Reference | Use |
|---|---|
| ASD's ACSC, CISA, FBI, NSA, NCSC-UK, CCCS, NCSC-NZ, CERT NZ, NISC, JPCERT/CC, NIS, NCSC-Korea, CSA Singapore, AIVD and MIVD, Best Practices for Event Logging and Threat Detection, August 2024 (cyber.gov.au; cisa.gov/resources-tools/resources/best-practices-event-logging-and-threat-detection) | Logging policy, source priorities, timestamps, retention, integrity, LOTL detection |
| OMB Memorandum M-26-14, Ensuring Effective and Efficient Agency Logging and Network Visibility to Defend Against Evolving Cyber Threats, 22 May 2026 (whitehouse.gov) | Searchable and retrievable definitions, baseline, maturity model (9.3) |
| CISA, Logging Reference Architecture (LRA), released 20 August 2026 under OMB M-26-14 (cisa.gov/Logging) | Federal reference architecture that starts the memorandum's agency deadlines (9.3) |
| NIST SP 800-53 Rev. 5, Security and Privacy Controls for Information Systems and Organizations, Release 5.2.0, August 2025 (csrc.nist.gov/pubs/sp/800/53/r5/upd1/final) | AU family control references (4) |
| NIST SP 800-92 Rev. 1, Cybersecurity Log Management Planning Guide, initial public draft, October 2023 (csrc.nist.gov/pubs/sp/800/92/r1/ipd) | Planning concepts only; draft, not final |
| MITRE ATT&CK Enterprise and ATT&CK for ICS, v20, October 2026 (attack.mitre.org) | Technique references (12) |
Observability Specification (ops/observability-spec) | Operational telemetry boundary |
Standard and licence note
Based on OMB Memorandum M-26-14 (22 May 2026) and NIST SP 800-53 Rev. 5 (Release 5.2.0), works of the United States Government not subject to copyright in the United States, and informed by the joint guide Best Practices for Event Logging and Threat Detection (August 2024), © Commonwealth of Australia 2024, published by ASD's ACSC with international partners under the Creative Commons Attribution 4.0 International licence (https://creativecommons.org/licenses/by/4.0/); this template paraphrases its recommendations in original words and is not endorsed by any of the authoring agencies. NIST SP 800-92 Rev. 1 is cited as an initial public draft only. MITRE ATT&CK technique identifiers and names are cited as references: © 2026 The MITRE Corporation. This work is reproduced and distributed with the permission of The MITRE Corporation. MITRE ATT&CK and ATT&CK are registered trademarks of The MITRE Corporation. Product and schema names (Elastic Common Schema, OCSF, AWS) are trademarks of their owners; this template is not affiliated with or endorsed by them. Check the current official versions of every source before relying on this standard, as revisions may have been published. Original text written for this collection. Template licence: MIT.
संबंधित टेम्पलेट
Secrets Management Standard Template (OWASP, NIST SP 800-57)
Secrets standard: classes, inventory, approved stores, issuance, rotation, workload identity, CI/CD and Kubernetes rules, scanning, leak response, break-glass
सुरक्षा इंजीनियरिंगSecure Coding Standard Template
Secure coding rules by area with do/don't code examples, SAST/DAST/secret scanning tooling and an exceptions process
सुरक्षा इंजीनियरिंगAttack Tree Analysis Template
Attack tree for one attacker goal: AND/OR tree as list and Mermaid, leaf cost/skill/likelihood, path analysis, countermeasures