Markdown Editor

에이전트 시스템 키트

AI 에이전트 설계, 보안, 운영: 멀티 에이전트 오케스트레이션, 도구 권한, 사람의 감독, A2A와 MCP 인터페이스, 위협 모델, 가드레일, 평가와 관측성.

1단계

설계

  1. Multi-Agent System Design Template (A2A, MCP, OWASP Agentic)

    전체

    Multi-agent design: roster, topology, handoff contracts, shared memory, A2A and MCP links, budgets, cascading-failure controls, oversight, OWASP ASI mapping

    OWASP Top 10 for Agentic Applications 2026; A2A 1.0.1; MCP 2026-07-28
  2. AI Agent Specification Template

    전체

    Specify a tool-using AI agent: autonomy level, tools and permissions, guardrails, security, trajectory evals, cost

  3. Agent Tool and Permission Design Template (OWASP ASI02, ASI03)

    전체

    Agent tool permissions: tool inventory, capability classes, least agency, non-human identity, approval tiers, sandboxing, limits, audit, revocation, tests

    OWASP Top 10 for Agentic Applications 2026 (ASI02, ASI03); OWASP Top 10 for LLM Applications 2026 (LLM03 Excessive Agency)
  4. Human Oversight Design Template (EU AI Act Article 14, ISO/IEC 42001)

    전체

    Human oversight: objectives, decision points (in, on, over the loop), approval gates, override and stop, overseer training, automation bias, UI, logs

    EU AI Act Article 14 and Article 26 (Regulation (EU) 2024/1689 as amended by 2026/1744); ISO/IEC 42001:2023 Annex A
  5. A2A Agent Card and Interface Specification Template (A2A 1.0)

    전체

    A2A agent spec: Agent Card fields, skills, bindings, security schemes, operations, task states, parts, push, errors, discovery, example card, conformance

    A2A Protocol Specification 1.0.1
  6. MCP Server Specification Template (Model Context Protocol)

    표준

    Specify an MCP server (spec revision 2026-07-28): transport, tools, resources, prompts, OAuth, security, testing

    Model Context Protocol specification, revision 2026-07-28
  7. Prompt Specification Template (System Prompt)

    표준

    System prompt spec: purpose, model parameters, role, instructions, safety rules, output schema, examples, tools, tests

  8. AGENTS.md Template for AI Coding Agents

    표준

    Repository instructions for AI coding agents: setup, build and test commands, conventions, architecture map, PR and security rules

    AGENTS.md convention (agents.md)
2단계

위협 모델링

  1. Agentic AI Threat Model Template (OWASP ASI Top 10, MITRE ATLAS)

    전체

    Agent trust boundaries, assets, autonomy, ASI01-ASI10 threat register, MITRE ATLAS mapping, L x I scoring, mitigations, residual risk, test cases

    OWASP Top 10 for Agentic Applications 2026; MITRE ATLAS v2026.09
  2. Guardrails and Safety Filter Specification Template (OWASP LLM Top 10 2026)

    전체

    Policy taxonomy, input, output and tool-call guards, thresholds and actions, false-positive and latency budgets, guard evaluation, OWASP LLM 2026 mapping

    OWASP Top 10 for LLM Applications 2026; OWASP Top 10 for Agentic Applications 2026
  3. AI Red Team Plan and Report Template (OWASP LLM Top 10 2026, Agentic ASI)

    전체

    Red team scope, threat model, NIST AI 100-2 classes, OWASP LLM 2026 and ASI01-ASI10 coverage, MITRE ATLAS, test cases, severity, findings, retest

    OWASP Top 10 for LLM Applications 2026; OWASP Top 10 for Agentic Applications 2026; MITRE ATLAS v2026.09; NIST AI 100-2 E2025
3단계

검증

  1. AI Agent Evaluation Plan Template (Task Success, Trajectory, Tool Calls)

    전체

    Agent task suite, success, trajectory, tool-call and argument metrics, sandboxed harness, online tests, calibrated graders, statistics, ASI safety cases, gates

    OWASP Top 10 for Agentic Applications 2026 (adversarial cases)
  2. LLM Evaluation Plan Template

    전체

    LLM app evaluation: test sets and red team, metrics, LLM-as-judge calibration, human review, CIs, release gates

4단계

운영

  1. LLM and Agent Observability Specification Template (OpenTelemetry GenAI)

    전체

    LLM/agent telemetry: objectives, span model, gen_ai.* attributes, token/latency/cost metrics, prompt capture controls, eval hooks, dashboards, SLOs, retention

    OpenTelemetry semantic conventions for generative AI (Development)
  2. AI Launch Readiness Review Template

    전체

    Launch scope and tier, 18 AI gates with owners, eval results vs thresholds, red team findings, Article 50 and register checks, exceptions, go/no-go, post-launch

  3. AI Incident Report Template

    표준

    Report an AI incident or near miss: harm, severity, timeline, root cause, containment, notifications incl. AI Act Art. 73

    OECD AI incident concepts (2024); EU AI Act Article 73