AI 프로덕트 매니저 키트
AI 기능을 아이디어에서 출시까지: 기회 캔버스, 접수, 코파일럿 PRD, 지표, 인간-AI 상호작용 리뷰, 평가, 비용, 출시 리뷰, 모니터링.
문제 정의
AI Opportunity Canvas Template
전체AI problem framing: is AI needed, value hypothesis, data availability, feasibility, risk tier preview, success metrics, non-AI alternatives, go/no-go
Industry practice; PAIR People + AI Guidebook; EU AI Act screening (Art. 5, 6, 50)AI Use Case Intake and Risk Tiering Template (EU AI Act)
표준Screen a proposed AI use case: data, affected people, AI Act prohibited/high-risk/transparency questions, tier, reviews
EU AI Act (Regulation (EU) 2024/1689) Articles 5, 6, 50 and Annex III, as amended by Regulation (EU) 2026/1744
요구사항
Copilot and Agent PRD Template
전체Copilot and agent requirements: jobs, autonomy levels, actions and undo, approval points, eval acceptance criteria, latency and cost, failure UX, rollout
Industry practice; Guidelines for Human-AI Interaction (CHI 2019); PAIR GuidebookAI Feature PRD Template
전체PRD for an AI-powered feature: why AI, failure and uncertainty UX, metrics, eval thresholds, cost per request, rollout
Metric Definition Template (KPI)
표준One metric or KPI: business question, plain definition, formula, grain, SQL sketch, filters, targets, caveats
Human-AI Interaction Review Template (HAX Guidelines)
전체Design review on the 18 Guidelines for Human-AI Interaction: scenarios, evidence log, ratings and severity per guideline, scorecard, trade-offs, findings
Guidelines for Human-AI Interaction (Amershi et al., CHI 2019); Microsoft HAX Toolkit
검증
Human Evaluation Protocol Template
전체Task and rubric, rater recruitment and training, ethics and consent, sample size, blinding, Cohen's/Fleiss' kappa, Krippendorff's alpha, QC, analysis
Human Evaluation Datasheet (HumEval 2022); van der Lee et al. 2021LLM Evaluation Plan Template
전체LLM app evaluation: test sets and red team, metrics, LLM-as-judge calibration, human review, CIs, release gates
LLM Inference Cost Model Template
전체Cost per request and task, tokens in and out, caching and routing scenarios, self-hosted GPU vs API break-even, utilisation, sensitivity table, cost guardrails
릴리스와 이관
AI Launch Readiness Review Template
전체Launch scope and tier, 18 AI gates with owners, eval results vs thresholds, red team findings, Article 50 and register checks, exceptions, go/no-go, post-launch
AI System Card Template
전체System-level card for a deployed AI product: components, uses, limitations, safety and bias evals, red-teaming
AI Content Transparency and Marking Plan Template (AI Act Art. 50, C2PA)
전체Article 50 role and scope, interaction disclosure, C2PA and watermark marking, robustness tests, labels, exceptions, Code of Practice mapping, China labelling
EU AI Act Art. 50 (Reg. (EU) 2024/1689 as amended by 2026/1744); Code of Practice on Transparency of AI-generated Content (2026); C2PA 2.4
운영
AI Post-Market Monitoring Plan Template (EU AI Act Article 72)
표준Post-market monitoring plan for a high-risk AI system: data collection, thresholds, reviews, Article 73 incident reporting
Regulation (EU) 2024/1689 as amended by Regulation (EU) 2026/1744, Articles 72 and 73LLM and Agent Incident Postmortem Template
전체LLM and agent postmortem: impact, harmful output, data exposure, timeline, trace replay, eval regression, AI failure taxonomy, actions, notification check
NIST SP 800-61 Rev. 3; EU AI Act Art. 73; GDPR Art. 33-34; NIST AI 100-2 E2025