Markdown Editor

Kit agentische Systeme

KI-Agenten entwerfen, absichern und betreiben: Multi-Agenten-Orchestrierung, Tool-Berechtigungen, menschliche Aufsicht, A2A- und MCP-Schnittstellen, Bedrohungsmodell, Guardrails, Evaluierung, Observability.

Schritt 1

Entwurf

  1. Multi-Agent System Design Template (A2A, MCP, OWASP Agentic)

    Vollständig

    Multi-agent design: roster, topology, handoff contracts, shared memory, A2A and MCP links, budgets, cascading-failure controls, oversight, OWASP ASI mapping

    OWASP Top 10 for Agentic Applications 2026; A2A 1.0.1; MCP 2026-07-28
  2. AI Agent Specification Template

    Vollständig

    Specify a tool-using AI agent: autonomy level, tools and permissions, guardrails, security, trajectory evals, cost

  3. Agent Tool and Permission Design Template (OWASP ASI02, ASI03)

    Vollständig

    Agent tool permissions: tool inventory, capability classes, least agency, non-human identity, approval tiers, sandboxing, limits, audit, revocation, tests

    OWASP Top 10 for Agentic Applications 2026 (ASI02, ASI03); OWASP Top 10 for LLM Applications 2026 (LLM03 Excessive Agency)
  4. Human Oversight Design Template (EU AI Act Article 14, ISO/IEC 42001)

    Vollständig

    Human oversight: objectives, decision points (in, on, over the loop), approval gates, override and stop, overseer training, automation bias, UI, logs

    EU AI Act Article 14 and Article 26 (Regulation (EU) 2024/1689 as amended by 2026/1744); ISO/IEC 42001:2023 Annex A
  5. A2A Agent Card and Interface Specification Template (A2A 1.0)

    Vollständig

    A2A agent spec: Agent Card fields, skills, bindings, security schemes, operations, task states, parts, push, errors, discovery, example card, conformance

    A2A Protocol Specification 1.0.1
  6. MCP Server Specification Template (Model Context Protocol)

    Standard

    Specify an MCP server (spec revision 2026-07-28): transport, tools, resources, prompts, OAuth, security, testing

    Model Context Protocol specification, revision 2026-07-28
  7. Prompt Specification Template (System Prompt)

    Standard

    System prompt spec: purpose, model parameters, role, instructions, safety rules, output schema, examples, tools, tests

  8. AGENTS.md Template for AI Coding Agents

    Standard

    Repository instructions for AI coding agents: setup, build and test commands, conventions, architecture map, PR and security rules

    AGENTS.md convention (agents.md)
Schritt 2

Bedrohungsmodellierung

  1. Agentic AI Threat Model Template (OWASP ASI Top 10, MITRE ATLAS)

    Vollständig

    Agent trust boundaries, assets, autonomy, ASI01-ASI10 threat register, MITRE ATLAS mapping, L x I scoring, mitigations, residual risk, test cases

    OWASP Top 10 for Agentic Applications 2026; MITRE ATLAS v2026.09
  2. Guardrails and Safety Filter Specification Template (OWASP LLM Top 10 2026)

    Vollständig

    Policy taxonomy, input, output and tool-call guards, thresholds and actions, false-positive and latency budgets, guard evaluation, OWASP LLM 2026 mapping

    OWASP Top 10 for LLM Applications 2026; OWASP Top 10 for Agentic Applications 2026
  3. AI Red Team Plan and Report Template (OWASP LLM Top 10 2026, Agentic ASI)

    Vollständig

    Red team scope, threat model, NIST AI 100-2 classes, OWASP LLM 2026 and ASI01-ASI10 coverage, MITRE ATLAS, test cases, severity, findings, retest

    OWASP Top 10 for LLM Applications 2026; OWASP Top 10 for Agentic Applications 2026; MITRE ATLAS v2026.09; NIST AI 100-2 E2025
Schritt 3

Verifikation

  1. AI Agent Evaluation Plan Template (Task Success, Trajectory, Tool Calls)

    Vollständig

    Agent task suite, success, trajectory, tool-call and argument metrics, sandboxed harness, online tests, calibrated graders, statistics, ASI safety cases, gates

    OWASP Top 10 for Agentic Applications 2026 (adversarial cases)
  2. LLM Evaluation Plan Template

    Vollständig

    LLM app evaluation: test sets and red team, metrics, LLM-as-judge calibration, human review, CIs, release gates

Schritt 4

Betrieb

  1. LLM and Agent Observability Specification Template (OpenTelemetry GenAI)

    Vollständig

    LLM/agent telemetry: objectives, span model, gen_ai.* attributes, token/latency/cost metrics, prompt capture controls, eval hooks, dashboards, SLOs, retention

    OpenTelemetry semantic conventions for generative AI (Development)
  2. AI Launch Readiness Review Template

    Vollständig

    Launch scope and tier, 18 AI gates with owners, eval results vs thresholds, red team findings, Article 50 and register checks, exceptions, go/no-go, post-launch

  3. AI Incident Report Template

    Standard

    Report an AI incident or near miss: harm, severity, timeline, root cause, containment, notifications incl. AI Act Art. 73

    OECD AI incident concepts (2024); EU AI Act Article 73