Markdown Editor

AI Risk Assessment Template (NIST AI RMF)

GOVERN, MAP, MEASURE, MANAGE assessment: context, impacts, trustworthiness, scored risk register, controls, residual risk

AI 및 데이터전체NIST AI RMF 1.0 (NIST AI 100-1)riskassessmentmath

사용법: Use before deploying an AI system and on every material change. Map the context and stakeholders first, then score risks on one fixed likelihood times impact scale. The main pitfall is risks without an owner, a measurement and a decision.

미리보기

AI Risk Assessment: [AI system name]

Complete risk assessment for an AI system, organised on the four functions of the NIST AI Risk Management Framework (AI RMF 1.0): GOVERN, MAP, MEASURE and MANAGE, and on its trustworthiness characteristics. It records the system context, who may be affected, the risk register with scores, how each risk is measured, the controls, the residual risk and the approval decision. Replace every [bracketed] value and every row marked Example.

Document control

FieldValue
Document ID[AIRA-SYSTEM-001]
AI system and version[Name] [version]
Assessment type[Initial / Periodic / Change-triggered / Post-incident]
Version[0.1]
Status[Draft / In review / Approved / Superseded]
Owner[@risk-owner]
Assessors[@assessor-1], [@assessor-2]
Classification[Internal / Confidential]
Last updatedYYYY-MM-DD
Next review dueYYYY-MM-DD
Related documents[Model card], [ML system design], [DPIA], [AI policy]

Approvals

RoleNameDecisionDate
System owner[@name][Accept / Accept with conditions / Reject]YYYY-MM-DD
AI governance lead[@name][Decision]YYYY-MM-DD
Risk / compliance[@name][Decision]YYYY-MM-DD
Accountable executive (for high residual risk)[@name][Decision]YYYY-MM-DD

Revision history

VersionDateAuthorChange summary
0.1YYYY-MM-DD[@name]First draft
1.0YYYY-MM-DD[@name]Example: Approved with conditions C-01 and C-02
1.1YYYY-MM-DD[@name]Example: Reassessed after switching to a new foundation model

Contents

1. Summary

ItemSummary
System purposeExample: Chat assistant that answers employee HR policy questions from the policy library
Risk tier[Low / Medium / High / Unacceptable] with reason
Top risksExample: R-01 incorrect policy answers; R-03 disclosure of personal data; R-05 over-reliance
Overall residual risk[Low / Medium / High]
Recommendation[Approve / Approve with conditions / Do not deploy]
ConditionsExample: C-01 groundedness at least 0.95 before launch; C-02 HR review of escalated answers

2. GOVERN: governance context

2.1 Policies and obligations

ItemReferenceHow it applies
Organisational AI policy[AI-POL-001]Example: Requires risk assessment for any AI used on employee data
Legal and regulatory obligations[List, for example data protection law, sector rules, AI Act category][How]
Risk appetite and tolerance[Reference]Example: No High residual risk without executive acceptance
Third-party and supplier terms[Contract references]Example: Model provider does not train on our prompts

2.2 Roles and accountability

RoleNameResponsibility
System owner[@name]Accountable for the system and its risks
Risk owner(s)[@name]Own individual risks in section 6
Independent reviewer[@name]Challenges the assessment; not on the build team
Incident contact[@name]Receives and triages AI incidents

2.3 Diversity of perspectives

[Who took part in the assessment and which perspectives are missing. Example: "Workshops with HR, legal, security, two employee representatives and an accessibility specialist. No external experts."]

3. MAP: system context

3.1 Intended purpose and setting

AspectDescription
Intended purpose[What the system does and the decision or task it supports]
Deployment settingExample: Intranet, available to 8 000 employees in 4 countries
UsersExample: All employees; HR advisers for escalations
Level of autonomyExample: Advisory; no actions taken on behalf of the user
Benefits expectedExample: Faster answers; 30% fewer routine HR tickets
Known limits and assumptionsExample: Policy library is current and complete
Out-of-scope usesExample: Individual legal advice, disciplinary decisions

3.2 System description

ComponentDescriptionProvider
ModelExample: Hosted large language model [name, version][Supplier]
RetrievalExample: Search over 1 200 HR policy documentsIn-house
Data inputsExample: User question, user's country and gradeIn-house
OutputsExample: Answer text with links to cited policy sectionsn/a
Human oversightExample: "Ask HR" button; HR reviews flagged answersn/a

3.3 Alternatives considered

[Including not using AI. Example: "Improved search only; rejected because users could not find answers in long policy documents."]

4. MAP: stakeholders and impacts

StakeholderRelationshipPotential positive impactPotential negative impactVulnerable or under-represented
Example: Employees asking questionsDirect usersFaster, consistent answersWrong answer leads to lost entitlementEmployees with limited language skills
Example: HR advisersOperatorsLess routine workDeskilling; blame for model errorsNo
Example: Employees discussed in questionsIndirectly affectedNonePersonal data exposureEmployees on leave or in disputes
Example: OrganisationOwnerCost savingLegal claims, trust lossn/a
[Stakeholder][Relationship][Positive][Negative][Yes / No, who]

5. Trustworthiness characteristics review

CharacteristicKey question for this systemCurrent evidenceConcern levelLinked risks
Valid and reliableAre answers correct and consistent with policy?Example: Pilot eval 92% correct on 300 questionsMediumR-01
SafeCould an answer lead to harm to a person?Example: Health and safety policies includedMediumR-02
Secure and resilientCan it be manipulated or fail badly?Example: Prompt injection tests not yet runHighR-04
Accountable and transparentDo users know they talk to AI, and who is responsible?Example: Banner and owner namedLowR-06
Explainable and interpretableCan users check why an answer was given?Example: Citations shown for every answerLowR-01
Privacy-enhancedIs personal data minimised and protected?Example: Prompts logged 30 daysMediumR-03
Fair, with harmful bias managedDo answers differ in quality across groups or languages?Example: Not yet tested for 3 of 4 languagesHighR-07

Trade-offs noted: [Example: "Logging prompts helps measure validity but increases privacy risk; resolved by 30-day retention and masking."]

6. Risk register

6.1 Scoring method

Likelihood LL and impact II are each rated on a 1 to 5 scale. The risk score is their product:

S=L×I,1≤S≤25S = L \times I, \qquad 1 \le S \le 25
Score SSRatingRequired response
1 to 4LowAccept; monitor
5 to 9MediumTreat or accept with owner sign-off
10 to 16HighTreat before deployment; governance lead approval
20 to 25CriticalDo not deploy until reduced
LevelLikelihood (in 12 months)Impact
1Rare: under 1%Negligible: no lasting effect on anyone
2Unlikely: 1% to 10%Minor: inconvenience, easily corrected
3Possible: 10% to 50%Moderate: financial or emotional harm to individuals, correctable
4Likely: 50% to 90%Major: significant harm to individuals or many people affected
5Almost certain: over 90%Severe: irreversible harm, rights violated, regulatory action

6.2 Register

IDRisk (cause, event, consequence)CharacteristicLISSRatingOwner
R-01Example: Outdated document retrieved, so the assistant states the wrong leave entitlement and the employee loses leaveValid and reliable4312High[@hr-content]
R-02Example: Ambiguous safety question answered without escalation, so a hazard is not reportedSafe248Medium[@hse]
R-03Example: Users paste colleagues' personal data, which is logged and visible to support staffPrivacy-enhanced4312High[@privacy]
R-04Example: Injected text in a policy document changes the assistant's instructionsSecure and resilient248Medium[@security]
R-05Example: Employees treat answers as binding and skip HR advice on complex casesAccountable and transparent339Medium[@hr-lead]
R-06Example: Responsibility for wrong answers unclear between HR and ITAccountable and transparent224Low[@system-owner]
R-07Example: Answers in less-resourced languages are less accurate, so those employees get worse serviceFair, bias managed339Medium[@ml-lead]
[R-nn][Cause, event, consequence][Characteristic][1-5][1-5][L x I][Rating][@name]

7. MEASURE: measurement plan

RiskMetricMethodDataThresholdFrequencyOwner
R-01Answer correctness; groundednessExpert-graded test set; automated citation check500 questions, refreshed quarterlyCorrect at least 95%; grounded at least 0.95Before release and monthly[@ml-lead]
R-03Personal data in logsPattern scan of logsAll logsUnder 0.5% of prompts after maskingWeekly[@privacy]
R-04Injection success rateRed-team test suite150 attack prompts0 successful instruction overridesBefore release and quarterly[@security]
R-07Correctness gap across languagesSame test set translated4 languagesGap at most 5 pointsBefore release and quarterly[@ml-lead]
[R-nn][Metric][Method][Data][Threshold][Frequency][@name]

Measurement limitations: [Example: "The test set covers the 200 most common topics; rare policies are under-tested."]

8. MANAGE: controls and treatment

Control IDRisk(s)ResponseControlTypeOwnerDueStatus
C-01R-01MitigateRetrieval limited to current policy versions; nightly sync checkPreventive[@hr-content]YYYY-MM-DD[Open]
C-02R-01, R-05Mitigate"Not legal advice" notice; escalation to HR for named topicsPreventive[@hr-lead]YYYY-MM-DD[Open]
C-03R-03MitigateMask personal data before logging; 30-day log retentionPreventive[@privacy]YYYY-MM-DD[Done]
C-04R-04MitigateTreat retrieved text as data; output filter; quarterly red teamPreventive and detective[@security]YYYY-MM-DD[Open]
C-05R-07MitigateLaunch in English and German only until gap closesAvoid (partial)[@product]YYYY-MM-DD[Open]
[C-nn][Risks][Response][Control][Type][@name]YYYY-MM-DD[Status]

Incident response: [How AI incidents are reported, triaged and fed back to this assessment; link to the incident procedure.]

Decommissioning: [Conditions under which the system will be withdrawn, and how users are informed.]

9. Residual risk and decision

IDInherent SSControlsResidual LResidual IResidual SSRatingAccepted by
R-0112C-01, C-02236Medium[@system-owner]
R-0312C-03236Medium[@privacy]
R-048C-04144Low[@security]
R-079C-05224Low[@product]
[R-nn][S][C-nn][1-5][1-5][S][Rating][@name]

Overall decision: [Approve / Approve with conditions / Do not deploy], with reasons and conditions. [Example: "Approved for English and German pilot with 500 users, subject to C-01 and C-04 being complete."]

10. Monitoring and review

ItemPlan
Ongoing indicators[Metrics from section 7 with dashboard link]
User feedback channelExample: Thumbs down with reason; reviewed weekly by HR
Reassessment triggersExample: New model version, new language, new user group, serious incident, threshold breach
Periodic reviewExample: Every 12 months
ReportingExample: Quarterly summary to AI governance board

11. References and glossary

11.1 References

ReferenceUse
NIST AI 100-1, Artificial Intelligence Risk Management Framework (AI RMF 1.0), National Institute of Standards and Technology, January 2023Functions and trustworthiness characteristics
NIST AI RMF PlaybookSuggested actions per subcategory
[Organisational AI policy]Risk appetite and roles

11.2 Glossary

TermMeaning
Inherent riskRisk level before the controls in this assessment
Residual riskRisk level expected after controls work as designed
GroundednessDegree to which an answer is supported by the retrieved sources
Red teamStructured adversarial testing to find failures

Standard and licence note

Based on the NIST Artificial Intelligence Risk Management Framework (AI RMF 1.0, NIST AI 100-1), a work of the United States government in the public domain. The template uses its GOVERN, MAP, MEASURE and MANAGE functions and its trustworthiness characteristics; the wording, scoring scheme and examples are original to this collection. Template licence: MIT.

관련 템플릿