Markdown Editor

GenAI Enterprise Application Integration Design Template (ERP, CRM, ITSM)

Suite use cases, native vs custom scoring, vendor AI baseline, grounding and oversharing, integration, oversight, residency, evals, cost, AI Act

ArchitekturVollständigVendor documentation (SAP Joule, Salesforce Agentforce, Microsoft 365 Copilot, ServiceNow Otto); EU AI Act as amended by 2026/1744genaienterpriseappintegration

Anleitung: Use it when a programme adds copilots or agents to ERP, CRM, ITSM or productivity suites. Fill the use case portfolio and the grounding and permissions register first, and score vendor-native against custom per use case. The main pitfall is switching on an embedded copilot over overshared data and accepting vendor features on a demo without regression tests after each vendor release.

Vorschau

GenAI Enterprise Application Integration Design: [Programme or application landscape]

Design document for bringing generative AI assistants and agents into enterprise applications: ERP, CRM, IT service management and workplace productivity suites. It records the use case portfolio per application, the choice between vendor-native copilots and agents (for example SAP Joule, Salesforce Agentforce, Microsoft 365 Copilot and Copilot Studio, and ServiceNow Otto, formerly Now Assist) and custom agents on the enterprise AI platform, grounding data and permissions, integration points across suites, human oversight, data residency, security, evaluation, licensing and cost, regulatory duties under Regulation (EU) 2024/1689 (the AI Act) as amended by Regulation (EU) 2026/1744, rollout and risks. Vendor product names change often: check each one at the vendor's current documentation. Replace every [bracketed] value and every row marked Example. The regulatory rows are a documentation format, not legal advice.

Document control

FieldValue
Document ID[GEI-001]
Programme[Name]
Applications and tenants in scope[ERP tenant], [CRM org], [ITSM instance], [Productivity tenant]
Vendor AI products in scope[Product names and editions, as named in the contract]
Target releases[Vendor release per suite]
Version[0.1]
Status[Draft / In review / Approved / Superseded]
Owner[@enterprise-architect]
Approvers/reviewers[@application-owners], [@ciso], [@data-protection-officer], [@ai-governance-lead], [@procurement]
Last updatedYYYY-MM-DD
Classification[Internal / Confidential]

Approvals

RoleNameDecisionDate
Business sponsor[@name][Approve / Approve with conditions / Reject]YYYY-MM-DD
Application owners[@name][Decision]YYYY-MM-DD
Security[@name][Decision]YYYY-MM-DD
Data protection[@name][Decision]YYYY-MM-DD
AI governance board[@name][Decision]YYYY-MM-DD

Revision history

VersionDateAuthorChange summary
0.1YYYY-MM-DD[@name]First draft
1.0YYYY-MM-DD[@name]Example: Approved for CRM service agent and ITSM incident summarisation
1.1YYYY-MM-DD[@name]Example: Added ERP finance assistant and cross-suite hand-off

Contents

1. Scope and context

1.1 Outcomes

IDOutcomeBaselineTargetMeasured by
GEI-OUT-001 (Example)Faster first response on customer cases[4 h median][1 h median]CRM case reports
GEI-OUT-002 (Example)Fewer incident tickets reach level 2[38 %][28 %]ITSM reassignment reports
GEI-OUT-003 (Example)Shorter month-end close for accounts payable[6 days][4 days]Close calendar
[GEI-OUT-NNN][Outcome][Baseline][Target][Source]

1.2 Landscape

SuiteRoleSystem of record forUsers in scopeAI product licensed
ERP (Example)Finance and procurementSuppliers, invoices, purchase orders, ledger450 finance users[Vendor ERP assistant and agents]
CRM (Example)Sales and serviceAccounts, contacts, cases, opportunities1,200 service agents, 300 sellers[Vendor CRM agents]
ITSM (Example)IT and HR serviceIncidents, requests, knowledge, configuration items250 IT agents; all employees as requesters[Vendor ITSM assistant]
Productivity (Example)Mail, documents, meetingsFiles and messages6,000 employees[Productivity suite copilot]
[Suite][Role][Data][Users][Product]

2. Use case portfolio

IDApplicationUse caseModeData readRecords changedValue measureRisk tierOwner
UC-001 (Example)CRMCase summary and reply draft for service agentsDraftCase, emails, knowledgeNone (agent sends)Handle timeLow[@service-owner]
UC-002 (Example)CRMCustomer-facing service agent for order statusActOrders, cases, knowledgeCase create, callbackContainment rateMedium[@service-owner]
UC-003 (Example)ITSMIncident summary and resolution suggestionDraftIncident, similar incidents, knowledgeWork noteMean time to resolveLow[@itsm-owner]
UC-004 (Example)ITSMPassword and access request agent for employeesActIdentity directory, catalogueRequest, group membershipRequests fulfilled without agentMedium[@itsm-owner]
UC-005 (Example)ERPInvoice exception explanation for AP clerksReadInvoices, purchase orders, goods receiptsNoneExceptions cleared per dayLow[@ap-lead]
UC-006 (Example)ERPSupplier payment run proposalAct with approvalOpen items, supplier masterProposal only; release stays manualClose daysHigh[@treasury-lead]
UC-007 (Example)ProductivityMeeting summaries and follow-up draftsDraftMeetings, chat, filesNoneSurvey time savedLow[@workplace-owner]
[UC-NNN][App][Use case][Read / Draft / Act / Act with approval][Data][Records][Measure][Tier][@owner]

Prioritise with three questions: does the use case change a measured outcome from section 1.1, is the data it needs clean and correctly permissioned today, and can a person check its output faster than doing the work. Defer use cases that fail the second question until the data work is done.

3. Vendor-native or custom

3.1 Decision criteria

CriterionFavours vendor-nativeFavours custom on the platform
Process scopeTask lives inside one suite and its data modelTask spans several suites or external systems
Data accessData is already in the suite, with its sharing modelData sits in many sources with different permission models
Time to valueFeature exists and needs configurationFeature does not exist or needs deep change
ControlVendor's model choice, guardrails and logging are acceptableModel choice, prompts, evaluation and logs must be owned
Cost shapeLicence or consumption price is predictable at the expected volumeToken cost on the platform is lower at the expected volume
PortabilityLock-in to the suite is acceptable for this processProcess may move between suites
Upgrade cadenceVendor releases are absorbed by regression testsRelease timing must be controlled

3.2 Worked scoring example

Example for UC-002 (customer-facing service agent). Weights sum to 100; scores run from 1 (poor) to 5 (strong); the weighted total is the sum of weight times score, divided by 100. Agree the tie rule before scoring: totals within 0.10 of each other are treated as a tie and decided by the control and portability criterion.

CriterionWeightVendor-nativeCustomHybrid (vendor agent plus platform tools)
Fit to process25434
Data access and permissions20534
Time to value15524
Cost at expected volume15343
Control and portability15254
Vendor roadmap risk10343
Weighted total (of 5)1003.803.403.75

Check: vendor-native is (25 x 4 + 20 x 5 + 15 x 5 + 15 x 3 + 15 x 2 + 10 x 3) / 100 = 380 / 100 = 3.80; custom is (75 + 60 + 30 + 60 + 75 + 40) / 100 = 3.40; hybrid is (100 + 80 + 60 + 45 + 60 + 30) / 100 = 3.75. Vendor-native and hybrid are 0.05 apart, inside the agreed 0.10 tie band, so the control and portability criterion decides (hybrid 4 against vendor-native 2): the Example decision is hybrid, which also lets the order status tool be reused by two other channels. Record the decision in the decision log (architecture/architecture-decision-log) and the wider sourcing case with the build vs buy analysis (architecture/build-vs-buy-analysis).

3.3 Decisions per use case

Use caseDecisionReasonRevisit when
UC-001 (Example)Vendor-nativeData and task inside CRMReply quality below target for two months
UC-002 (Example)HybridVendor agent for the channel; order status tool on the platform reused elsewhereVendor adds equivalent connector
UC-003 (Example)Vendor-nativeIncidents, similar incidents and knowledge all live in the ITSM suiteSuggestion match rate below EVL-003 threshold for a quarter
UC-004 (Example)Vendor-native with directory workflowCatalogue and fulfilment workflow already in ITSM; directory changes go through the existing approval workflow (INT-003)Directory or identity governance tool replaced
UC-005 (Example)Vendor-nativeERP assistant reads the documents in contextNeed for cross-ERP analysis
UC-006 (Example)Custom with ERP approval stepHigh risk; must own evaluation and logsNever without governance review
UC-007 (Example)Vendor-nativeMeetings, chat and files are in the productivity suiteGrounding exposure found in persona tests
[UC-NNN][Decision][Reason][Trigger]

4. Vendor capability baseline

The table lists the main product families as named on vendor pages checked in October 2026. Names and packaging change often; confirm against the vendor documentation and your order form.

SuiteVendor AI products (as named by the vendor)Grounding mechanismExtension and build toolsNotes to verify
SAPJoule (assistant), Joule AgentsSAP business data and APIs; SAP Business Data Cloud and SAP Knowledge Graph for semantic contextJoule Studio, SAP Business AI Platform (formerly SAP Business Technology Platform)Availability per product and region; commercial model under SAP Business AI terms
SalesforceAgentforce, with the Atlas Reasoning EngineCRM data and Data 360Agent Builder, Agent Script, MCP support, multi-agent orchestrationPricing through Flex Credits, per-resolution or per-user options; default enablement settings per release
MicrosoftMicrosoft 365 Copilot, Microsoft Copilot Chat, Copilot in Dynamics 365, Copilot Studio agents and workflowsMicrosoft Graph and Work IQ, scoped to the signed-in user's permissionsCopilot Studio (agents, workflows, agent flows, connectors)Licence tier decides work-data grounding; usage-based billing for some agents; harness choice affects billing; Microsoft Agent 365 as the agent registry and governance control plane (separate licence)
ServiceNowServiceNow Otto (formerly Now Assist; announced 5 May 2026 as one AI experience that brings together Now Assist, Moveworks and AI Experience), AI Agents, AI SpecialistsPlatform records, knowledge, AI SearchAI Agent Studio, AI Skill Kit, MCP and A2A supportAssist consumption metering; AI Control Tower and AI Guardian for governance; rename rolling out across products, and Now Assist SKU names may remain in order forms
[Suite][Products][Grounding][Tools][Notes]

For each product in scope record: general availability or preview status in your region, whether it is on by default after an upgrade, the admin switch that disables it, the model providers and subprocessors the vendor lists, and the audit log it produces.

5. Grounding data and permissions

Embedded copilots answer from what the signed-in user can access. That makes existing oversharing visible: a file shared with "everyone" five years ago becomes an answer today. Treat permission hygiene as a launch prerequisite.

IDSourceSuitePermission modelKnown exposureRemediation before launchOwner
GRD-001 (Example)Shared document sitesProductivitySite membership, sharing links140 sites shared with all employeesReview owners; restrict discovery for sensitive sites during review; apply sensitivity labels[@workplace-owner]
GRD-002 (Example)CRM cases and emailsCRMRole hierarchy, sharing rulesService agents see all regionsRestrict by region before the agent is enabled[@crm-owner]
GRD-003 (Example)HR knowledge articlesITSMKnowledge user criteriaTwo HR bases readable by all IT agentsCorrect user criteria[@hr-it-owner]
GRD-004 (Example)Supplier bank detailsERPAuthorisation objectsNone foundExclude fields from AI context explicitly[@erp-security]
[GRD-NNN][Source][Suite][Model][Exposure][Remediation][@owner]

Rules for grounding:

  • Exclude fields that the AI never needs (bank accounts, national identifiers, health data) using the suite's masking or field-level controls, even when the user may see them.
  • Keep the vendor's grounding inside its own suite. Reach other suites through governed tools (APIs, MCP servers or agent hand-offs) that apply the target suite's permissions, not by copying data into the vendor's index.
  • Review sensitivity labels and retention policies, so that labelled content is handled as designed in answers, summaries and generated files.
  • Test with real personas: run the same questions as users in different roles and compare what each one sees.

6. Integration points

IDFromToPatternIdentity usedProtocol or interfaceLogged in
INT-001 (Example)CRM service agentERP order statusTool call through the enterprise AI platformAgent identity with delegated customer contextMCP server over the ERP order APIPlatform trace, ERP API log
INT-002 (Example)Productivity copilotITSMVendor connector for knowledge and incidentsSigned-in userVendor connector, ITSM REST APIBoth suites' audit logs
INT-003 (Example)ITSM agentIdentity directoryRequest fulfilment workflowWorkflow service identity with approvalDirectory APIITSM workflow log, directory audit
INT-004 (Example)ERP assistantCustom treasury agentAgent hand-offAgent identityA2A specification 1.0.1Platform trace
[INT-NNN][From][To][Pattern][Identity][Interface][Logs]

Use the integration strategy (architecture/integration-strategy) for the general interface rules, and the MCP server specification (ai-data/mcp-server-spec) for each tool the platform exposes.

7. Human oversight and autonomy

Use caseAutonomyHuman stepReviewerVolume checkEscalation
UC-001 (Example)DraftAgent edits and sendsService agentn/aSupervisor review of [2 %] sample weekly
UC-002 (Example)Act within limitsHand-off on low confidence, complaint or requestService queueHand-off rate under [20 %]Live agent within [2 min]
UC-004 (Example)Act with approval for privileged groupsApprover confirms membership in privileged groupsGroup ownerUnder [30] approvals per approver per dayIT security on denial
UC-006 (Example)Propose onlyTreasury releases the payment run under the two-person ruleTreasuryEvery runCFO on variance above [threshold]
[UC-NNN][Level][Step][Reviewer][Check][Path]

Design oversight in detail with the human oversight design (ai-data/human-oversight-design), and record agent behaviour in an AI agent specification (ai-data/ai-agent-spec) per custom agent.

8. Data residency and processing

ProductTenant regionModel processing locationSubprocessors for AIStorage of prompts and outputsRetentionContract reference
Productivity copilot (Example)EUWithin the vendor's EU data boundary for EU users, per vendor documentationAs listed by the vendor; check additional model subprocessors and their default stateWithin tenant, per vendor termsPer tenant retention policies[DPA, product terms]
CRM agents (Example)EU[Region per vendor documentation][List][Location][Period][Reference]
ITSM assistant (Example)EU[Region][List][Location][Period][Reference]
[Product][Region][Location][List][Location][Period][Reference]

Check each product's documentation for overflow routing (calls sent to other regions when capacity is short), the list of model subprocessors, and whether customer data is used to train models. For EU personal data, update the record of processing (compliance/gdpr-ropa) and run or update the DPIA (compliance/dpia). Assess sovereignty requirements with the data residency and sovereignty assessment (compliance/data-residency-sovereignty-assessment).

9. Security

IDThreatExample in this landscapeControl
SEC-001 (Example)Indirect prompt injectionCustomer email in a case tells the agent to issue a refundVendor and platform injection guards; refund action not available to the agent
SEC-002 (Example)Excessive agent privilegesAgent user with broad object permissionsDedicated agent identities with least privilege; quarterly access review (ops/access-review)
SEC-003 (Example)Data leakage through outputsSummary includes masked fieldsField exclusion from AI context; output checks for identifiers
SEC-004 (Example)Shadow agentsBusiness users publish agents with personal connectionsMaker environments, data loss prevention policies, agent inventory
SEC-005 (Example)Connector credential abuseShared service credentials in a cross-suite connectorDelegated tokens; secrets in a vault; connector review
[SEC-NNN][Threat][Example][Control]

Threat-model each acting agent with the agentic threat model (ai-data/agentic-threat-model) and assess each vendor's AI terms with the AI vendor risk questionnaire (compliance/ai-vendor-risk-questionnaire).

10. Evaluation and acceptance

IDUse caseTest setMetricAcceptance thresholdWhen run
EVL-001 (Example)UC-001[300] closed cases with approved repliesReviewer rating of drafts (1 to 5)Mean at least [4.0]Before launch, after each vendor release
EVL-002 (Example)UC-002[500] scripted customer conversations, including [50] adversarialTask success; unsafe action countAt least [85 %]; 0 unsafeBefore launch, monthly sample
EVL-003 (Example)UC-003[200] resolved incidentsSuggestion matches the actual fixAt least [60 %]Before launch, quarterly
EVL-004 (Example)AllPersona permission tests from section 5Answers expose no data beyond the persona's access0 exposuresBefore launch, after permission changes
EVL-005 (Example)UC-004[150] scripted access requests, including [20] for privileged groupsCorrect fulfilment; privileged requests routed to approvalAt least [95 %]; 100 % of privileged requests routedBefore launch, after each vendor release
EVL-006 (Example)UC-005, UC-006[300] historical invoice exceptions and [12] past payment runsExplanation matches the AP clerk's root cause; proposal matches the released runAt least [80 %]; every proposal difference explainedBefore launch, quarterly
[EVL-NNN][Use case][Set][Metric][Threshold][Cadence]

Vendors update models and prompts without your release. Schedule regression runs in each suite's release calendar (preview sandboxes where the vendor offers them) and use the suite's own evaluation tools where they exist. Plan the method with the LLM evaluation plan (ai-data/llm-evaluation-plan) and the agent evaluation plan (ai-data/agent-evaluation-plan).

11. Licensing and cost

11.1 Licence models in scope

ProductLicence modelUnitCommitmentOverage behaviour
[Productivity copilot]Per user per month, plus usage-based billing for some agentsUser; credits[Annual][Billed / blocked]
[CRM agents]Consumption credits, per resolution or per user (options per contract)Credit; resolution[Pre-purchased][Billed at rate]
[ITSM assistant]Subscription with an assist allowanceAssist[Annual allowance][True-up]
[ERP assistant]Per the vendor's AI commercial terms[Unit][Terms][Behaviour]
Custom agents on the platformToken cost via the gatewayTokenNoneBudget alerts

11.2 Worked cost example

Example, using illustrative unit prices that are not vendor list prices.

Use caseOptionVolume per monthUnit priceCost per month
UC-001Per-user add-on for 600 service agents600 usersUSD 30 per userUSD 18,000
UC-002Consumption per resolved conversation20,000 conversationsUSD 0.80 per conversationUSD 16,000
UC-002Platform tools called by the vendor agent20,000 tool calls x 3,000 tokens = 60 million tokensUSD 4.00 per million tokensUSD 240
UC-006Custom agent on the platform400 runs x 50,000 tokens = 20 million tokensUSD 4.00 per million tokensUSD 80
TotalUSD 34,320

The sum is 18,000 + 16,000 + 240 + 80 = USD 34,320. Licence and consumption charges dominate; token cost on the platform is under 1 % of the total, so negotiate the vendor commercial terms first. Compare against the value: if UC-002 contains [6,000] contacts per month that previously cost [USD 4] each, it saves [USD 24,000] against USD 16,240 of cost. Add the cost of review time and of the evaluation runs. Model the full lifecycle in the TCO analysis (architecture/tco-analysis).

12. Regulatory and governance duties

Dates follow Regulation (EU) 2024/1689 as amended by Regulation (EU) 2026/1744; check the consolidated text on EUR-Lex.

DutyArticleApplies fromUse cases affectedEvidence
AI literacy measures for staff using the tools (wording amended by 2026/1744)Article 42 February 2025AllLiteracy plan (ai-data/ai-literacy-plan)
Disclosure that people interact with an AI system: provider duty (the vendor for vendor-native agents, the organisation for custom agents); deployer duties for deep fakes and emotion recognition where applicableArticle 50(1); Article 50(3) and 50(4)2 August 2026UC-002, UC-004Vendor disclosure design, disclosure text and screenshots
Deployer duties for high-risk systemsArticle 262 December 2027 for Annex III systems[Only if a use case is high-risk, for example HR screening]Oversight design, logs, monitoring
Fundamental rights impact assessmentArticle 272 December 2027 for the Annex III systems it covers[If applicable]FRIA (ai-data/ai-act-fria)
Personal data processingGDPR Articles 6, 30 and 35In forceAll using personal dataRecord of processing, DPIA

Register each use case in the AI use case intake (ai-data/ai-use-case-intake) and the regulatory applicability register (compliance/ai-regulatory-applicability-register). A custom agent that the organisation builds and places in service under its own name may make the organisation a provider for that system; record that analysis.

13. Rollout and adoption

WaveScopeUsersEntry criteriaExit criteriaTarget date
W0 (Example)Permission remediation (section 5)NoneApproved designGRD items closed; persona tests passYYYY-MM-DD
W1 (Example)UC-001, UC-00350 service agents, 20 IT agentsW0 completeEVL-001 and EVL-003 met; adoption at least [60 %] of pilot usersYYYY-MM-DD
W2 (Example)UC-002 in one marketCustomers of [market]Disclosure live; hand-off testedEVL-002 met for four weeksYYYY-MM-DD
W3 (Example)All markets; UC-005All service and AP usersW2 exitOutcome targets trending to 1.1 valuesYYYY-MM-DD
[W-N][Scope][Users][Entry][Exit]YYYY-MM-DD

Support adoption with role-based training, prompt guidance in the users' language, champions per team, and a feedback channel whose items are triaged weekly. Track active users, outputs accepted without edit, hand-off rates and complaints per use case.

14. Risks and traceability

IDRiskLikelihoodImpactMitigationOwner
GEI-R-001 (Example)Oversharing exposed through copilot answersHighHighSection 5 remediation as a launch gate[@workplace-owner]
GEI-R-002 (Example)Vendor release changes agent behaviourMediumMediumRegression runs in the release calendar[@application-owners]
GEI-R-003 (Example)Consumption cost exceeds budgetMediumMediumMonthly cost review; caps where the vendor supports them[@finops-lead]
GEI-R-004 (Example)Overlapping agents in several suites answer the same request differentlyMediumMediumOne owning suite per process; hand-off rules[@enterprise-architect]
GEI-R-005 (Example)Product renames and repackaging break contract assumptionsMediumLowContract names products by function and SKU; annual review[@procurement]
[GEI-R-NNN][Risk][L][I][Mitigation][@owner]
OutcomeUse casesTestsEvidence
GEI-OUT-001 (Example)UC-001, UC-002EVL-001, EVL-002Case reports before and after W2
GEI-OUT-002 (Example)UC-003, UC-004EVL-003, EVL-005Reassignment reports
GEI-OUT-003 (Example)UC-005, UC-006EVL-006Close calendar
[GEI-OUT-NNN][Use cases][Tests][Evidence]

15. Glossary and references

TermMeaning in this document
CopilotAssistant embedded in an application that drafts, summarises or answers in context
AgentAI component that plans steps and calls tools to complete a task, possibly changing records
GroundingSupplying the model with enterprise data relevant to the request
HybridVendor-native agent that calls tools or agents hosted on the enterprise AI platform
OversharingContent accessible to more people than its owner intends
ReferenceVersion or date checkedUse
Microsoft Learn, What is Microsoft Copilot (Microsoft 365 Copilot overview)Page dated 2026-10-20Grounding, licences, EU Data Boundary
Microsoft Learn, Microsoft Copilot Studio overviewPage dated 2026-09-25Agents, workflows, harnesses
Salesforce, Agentforce product pageChecked 2026-10-23Agentforce, Atlas Reasoning Engine, pricing options
SAP News Center, SAP Connect keynote: autonomous enterprise in actionOctober 2026Joule, Joule Agents, Joule Studio, Business Data Cloud, Knowledge Graph
ServiceNow press release, "ServiceNow Otto creates the unified AI experience for the enterprise", newsroom.servicenow.com5 May 2026Otto naming and scope
ServiceNow Store release notes, ITSM AI applications, and ServiceNow Community articlesChecked 2026-10-23In-product rename, AI Agents, AI Control Tower, AI Guardian
Regulation (EU) 2024/1689 as amended by Regulation (EU) 2026/1744, EUR-LexConsolidated text, check before useSection 12
A2A Protocol Specification, a2a-protocol.org and github.com/a2aproject/A2A1.0.1 (May 2026, a patch release of 1.0.0; protocol version 1.0; the specification site labels 1.0.0 as the latest release)Section 6

Standard and licence note

Based on the public product documentation of the vendors named above (checked in October 2026) and on Regulation (EU) 2024/1689 as amended by Regulation (EU) 2026/1744 (EU legislative texts are free to reuse). Vendor features are described in original wording for mapping only, and no vendor text, checklist or diagram is reproduced. The structure, criteria and examples are original to this collection. Check the current vendor documentation, your contracts and the consolidated legal text before use. The regulatory rows are a documentation format, not legal advice. SAP, Joule, Salesforce, Agentforce, Microsoft, Microsoft 365 Copilot, Copilot Studio, Dynamics 365, Microsoft Agent 365, ServiceNow, Otto and Moveworks are trademarks of their owners; this template is not affiliated with or endorsed by them. Template licence: MIT.

Ähnliche Vorlagen