Markdown Editor

AI 프로덕트 매니저 키트

AI 기능을 아이디어에서 출시까지: 기회 캔버스, 접수, 코파일럿 PRD, 지표, 인간-AI 상호작용 리뷰, 평가, 비용, 출시 리뷰, 모니터링.

1단계

문제 정의

  1. AI Opportunity Canvas Template

    전체

    AI problem framing: is AI needed, value hypothesis, data availability, feasibility, risk tier preview, success metrics, non-AI alternatives, go/no-go

    Industry practice; PAIR People + AI Guidebook; EU AI Act screening (Art. 5, 6, 50)
  2. AI Use Case Intake and Risk Tiering Template (EU AI Act)

    표준

    Screen a proposed AI use case: data, affected people, AI Act prohibited/high-risk/transparency questions, tier, reviews

    EU AI Act (Regulation (EU) 2024/1689) Articles 5, 6, 50 and Annex III, as amended by Regulation (EU) 2026/1744
2단계

요구사항

  1. Copilot and Agent PRD Template

    전체

    Copilot and agent requirements: jobs, autonomy levels, actions and undo, approval points, eval acceptance criteria, latency and cost, failure UX, rollout

    Industry practice; Guidelines for Human-AI Interaction (CHI 2019); PAIR Guidebook
  2. AI Feature PRD Template

    전체

    PRD for an AI-powered feature: why AI, failure and uncertainty UX, metrics, eval thresholds, cost per request, rollout

  3. Metric Definition Template (KPI)

    표준

    One metric or KPI: business question, plain definition, formula, grain, SQL sketch, filters, targets, caveats

  4. Human-AI Interaction Review Template (HAX Guidelines)

    전체

    Design review on the 18 Guidelines for Human-AI Interaction: scenarios, evidence log, ratings and severity per guideline, scorecard, trade-offs, findings

    Guidelines for Human-AI Interaction (Amershi et al., CHI 2019); Microsoft HAX Toolkit
3단계

검증

  1. Human Evaluation Protocol Template

    전체

    Task and rubric, rater recruitment and training, ethics and consent, sample size, blinding, Cohen's/Fleiss' kappa, Krippendorff's alpha, QC, analysis

    Human Evaluation Datasheet (HumEval 2022); van der Lee et al. 2021
  2. LLM Evaluation Plan Template

    전체

    LLM app evaluation: test sets and red team, metrics, LLM-as-judge calibration, human review, CIs, release gates

  3. LLM Inference Cost Model Template

    전체

    Cost per request and task, tokens in and out, caching and routing scenarios, self-hosted GPU vs API break-even, utilisation, sensitivity table, cost guardrails

4단계

릴리스와 이관

  1. AI Launch Readiness Review Template

    전체

    Launch scope and tier, 18 AI gates with owners, eval results vs thresholds, red team findings, Article 50 and register checks, exceptions, go/no-go, post-launch

  2. AI System Card Template

    전체

    System-level card for a deployed AI product: components, uses, limitations, safety and bias evals, red-teaming

  3. AI Content Transparency and Marking Plan Template (AI Act Art. 50, C2PA)

    전체

    Article 50 role and scope, interaction disclosure, C2PA and watermark marking, robustness tests, labels, exceptions, Code of Practice mapping, China labelling

    EU AI Act Art. 50 (Reg. (EU) 2024/1689 as amended by 2026/1744); Code of Practice on Transparency of AI-generated Content (2026); C2PA 2.4
5단계

운영

  1. AI Post-Market Monitoring Plan Template (EU AI Act Article 72)

    표준

    Post-market monitoring plan for a high-risk AI system: data collection, thresholds, reviews, Article 73 incident reporting

    Regulation (EU) 2024/1689 as amended by Regulation (EU) 2026/1744, Articles 72 and 73
  2. LLM and Agent Incident Postmortem Template

    전체

    LLM and agent postmortem: impact, harmful output, data exposure, timeline, trace replay, eval regression, AI failure taxonomy, actions, notification check

    NIST SP 800-61 Rev. 3; EU AI Act Art. 73; GDPR Art. 33-34; NIST AI 100-2 E2025