Architecture Evaluation Plan and Report: [Architecture or system name]
Plan and report for one architecture evaluation, organised on the architecture evaluation
framework of ISO/IEC/IEEE 42030:2019 (Software, systems and enterprise: Architecture evaluation
framework, first edition, still current; ISO lists it as "to be revised" (stage 90.92 since
2026-01-08), and a second edition, Enterprise, systems and software: Architecture evaluation
framework, is registered as work item AWI 42030 since 2026-05-22). It records why the evaluation is done, the objectives and factors, the approach and
methods (with ATAM as a plug-in analysis method), the architectural analysis, the value
assessment, the synthesis of results, findings, recommendations, confidence and follow-up.
Replace every [bracketed] value and every row marked Example.
Document control
| Field | Value |
|---|
| Document ID | [AE-YYYY-NNN] |
| Document type | [Evaluation plan / Evaluation report / Combined plan and report] |
| Architecture evaluated | [Name of the architecture or architecture collection] |
| Entity of interest | [System, software, service, enterprise or product line] |
| Architecture description used as evidence | [Document ID and version, for example AD-SYSTEM-001 v1.2] |
| Lifecycle stage of the entity | [Concept / Development / Production / Utilisation / Support / Retirement] |
| Evaluation authority (decision owner) | [@name, role] |
| Evaluation lead | [@name] |
| Evaluation framework | [Generic 42030 framework / Customised framework: name and version] |
| Version | [0.1] |
| Status | [Draft plan / Approved plan / In progress / Draft report / Final report / Superseded] |
| Owner | [@evaluation-lead] |
| Approvers / reviewers | [@sponsor], [@chief-architect], [@quality-lead] |
| Last updated | YYYY-MM-DD |
| Classification | [Internal / Confidential] |
Approvals
| Role | Name | Decision | Date |
|---|
| Evaluation authority | [@name] | [Plan approved / Report accepted / Accepted with conditions] | YYYY-MM-DD |
| Evaluation lead | [@name] | [Prepared] | YYYY-MM-DD |
| Architect of the evaluated architecture | [@name] | [Reviewed for factual accuracy] | YYYY-MM-DD |
| Independent reviewer | [@name] | [Reviewed] | YYYY-MM-DD |
Revision history
| Version | Date | Author | Change summary |
|---|
| 0.1 | YYYY-MM-DD | [@name] | Draft evaluation plan |
| 1.0 | YYYY-MM-DD | [@name] | Example: Plan approved by the evaluation authority |
| 1.1 | YYYY-MM-DD | [@name] | Example: Objective EO-004 added after the scope review; ATAM phase 2 rescheduled |
| 2.0 | YYYY-MM-DD | [@name] | Example: Final report issued with synthesis, findings and recommendations |
Contents
1. Evaluation context and scope
1.1 Purpose and decision supported
State the decision the evaluation informs in one sentence, then the reason for evaluating
now. 42030 lists several uses for an evaluation, such as checking that stakeholder
concerns are addressed, judging value and quality, confirming fitness for purpose,
tracking progress, finding risks and opportunities, and supporting decisions; name the
ones that apply here.
| Item | Value |
|---|
| Decision supported | [Example: Approve the target architecture for the Order Management Platform before the build contract is signed] |
| Trigger | [Example: Stage gate 2 of the investment process] |
| Uses of this evaluation | [Example: Address stakeholder concerns; identify risks; compare two candidate architectures] |
| Decision deadline | YYYY-MM-DD |
| Consequence of no evaluation | [Example: Contract signed on an architecture whose availability has never been analysed] |
1.2 Subject of evaluation
| Item | Value |
|---|
| Architecture or architectures evaluated | [Example: Candidate A (event-driven modular monolith) and candidate B (microservices on managed Kubernetes)] |
| Boundary | [Example: Order capture, fulfilment orchestration, inventory reservation, customer notifications] |
| Out of scope | [Example: Warehouse robotics control; finance ledger (evaluated separately)] |
| Related architectures | [Example: Enterprise integration architecture; data platform architecture] |
| Evidence available | [Example: Architecture description v1.2, two prototypes, load test results from the current system] |
1.3 Evaluation context
Describe the environment that shapes the evaluation (clause 4.2 treats the evaluation
context as a first-class concept): organisation, market, regulation, programme
constraints, earlier evaluations and the politics of the decision. Note any conflict of
interest between the evaluation team and the architecture team.
[Context narrative, three to six sentences.]
1.4 Stakeholders and concerns
| ID | Stakeholder | Concerns relevant to this evaluation | Role in evaluation |
|---|
| SH-01 (Example) | Chief operating officer (evaluation authority) | Cost to operate, time to market for new channels | Sets objectives, accepts report |
| SH-02 (Example) | Head of e-commerce | Peak-season availability, checkout latency | Provides value judgements |
| SH-03 (Example) | Security officer | Card data scope, audit trail | Provides criteria and value judgements |
| SH-04 (Example) | Platform engineering lead | Operability, skills, run cost | Provides evidence and value judgements |
| SH-05 (Example) | Lead architect | All architectural concerns | Presents architecture, answers questions |
| [SH-nn] | [Stakeholder] | [Concerns] | [Role] |
2. Evaluation framework and tailoring
2.1 Conceptual model used
The evaluation uses three tiers. Architectural analysis produces facts and estimates about
architecture properties. Value assessment turns those facts into stakeholder value
judgements. Evaluation synthesis combines analysis and assessment results against the
evaluation objectives into conclusions for the evaluation authority.
2.2 Clause map
| 42030:2019 clause | Topic (short label) | Where addressed here |
|---|
| 4.2 | Evaluation context | Section 1.3 |
| 4.3 | Evaluation tiers (synthesis, value assessment, analysis) | Sections 7, 8, 9 |
| 4.4 | Conceptual model | Section 2.1 |
| 4.5 | Assessment compared with analysis | Sections 7 and 8 intros |
| 4.6 | Evaluation factors | Section 4 |
| 4.7, 7 | Customised frameworks | Section 2.3 |
| 4.8 | Tailoring | Section 2.4 |
| 5 | Conformance | Section 2.5 |
| 6.1 | Evaluation synthesis elements (objectives, approaches, factors, results) | Sections 3, 4, 5, 9 |
| 6.2 | Value assessment elements | Section 8 |
| 6.3 | Architectural analysis elements | Section 7 |
| 8.2 | Evaluation plan | Sections 1 to 6 |
| 8.3 | Evaluation report | Sections 7 to 12 |
2.3 Customised framework
If the organisation has its own evaluation framework (for example an architecture review
board method that always uses ATAM plus a cost model), name it and say how its elements
map to the generic framework.
| Item | Value |
|---|
| Framework name and version | [Example: Enterprise Architecture Review Method v3] |
| Owner | [@architecture-office] |
| Mandatory methods | [Example: ATAM for new platforms; lightweight checklist review for changes] |
| Mandatory work products | [Example: This plan and report; risk register entries] |
| Mapping to 42030 elements | [Example: Review board scorecard is the synthesis; ATAM is the analysis method; stakeholder voting is the value assessment method] |
2.4 Tailoring record
| ID | Element | Tailoring decision | Rationale | Approved by |
|---|
| TL-01 (Example) | Value assessment | Use a five-point value scale per objective instead of monetary value | No reliable benefit model at stage gate 2 | [@sponsor] |
| TL-02 (Example) | Architectural analysis | Use the ATAM utility tree as the analysis structure | Organisation standard for platform decisions | [@architecture-office] |
| [TL-nn] | [Element] | [Decision] | [Rationale] | [@name] |
2.5 Conformance claim
State which conformance case applies (clause 5): whether this document is an evaluation
work product created against the generic framework, against a customised framework, or
both. Keep the claim honest; a partial claim with a stated tailoring record is more useful
than an unsupported full claim.
[Example: "This plan and report are prepared as architecture evaluation work products
under the organisation's customised framework, which is mapped to ISO/IEC/IEEE 42030:2019
in section 2.3. Tailoring is listed in section 2.4."]
3. Evaluation objectives
| ID | Objective (question to answer) | Stakeholders | Concerns | Decision impact | Priority |
|---|
| EO-001 (Example) | Can the candidate architectures meet peak-season availability and latency targets? | SH-02, SH-04 | Availability, performance | Go or no-go for build | Must |
| EO-002 (Example) | Which candidate gives the lower three-year run cost at forecast volumes? | SH-01, SH-04 | Cost | Selection between A and B | Must |
| EO-003 (Example) | Does either candidate increase card data scope? | SH-03 | Security, compliance | Selection, compliance budget | Must |
| EO-004 (Example) | How quickly can a new sales channel be added? | SH-01, SH-02 | Modifiability, time to market | Selection | Should |
| EO-005 (Example) | Can the current platform team operate the candidate with its existing skills? | SH-04 | Operability, skills | Staffing plan | Should |
| [EO-nnn] | [Question] | [SH-nn] | [Concerns] | [Impact] | [Must / Should / Could] |
4. Evaluation factors and criteria
4.1 Criteria and thresholds
| ID | Objective | Criterion | Measure | Threshold or target | Source of threshold |
|---|
| EF-001 (Example) | EO-001 | Availability during peak season | Monthly availability of order capture | >= 99.95% | Service level objective, [link] |
| EF-002 (Example) | EO-001 | Checkout latency at peak | p99 order submission latency at 1,200 orders per minute | <= 800 ms | Product performance budget |
| EF-003 (Example) | EO-002 | Three-year run cost | Infrastructure plus licence plus operations staff, USD | Must not exceed USD 4.2 million; lower is better, compared in value assessment | Business case v2 |
| EF-004 (Example) | EO-003 | Card data scope | Number of components that store, process or transmit card data | Not greater than today (2) | Security policy |
| EF-005 (Example) | EO-004 | Channel onboarding effort | Engineering effort to add a marketplace channel | <= 6 person-weeks, no change to core order model | Channel strategy |
| EF-006 (Example) | EO-005 | Skills gap | Number of critical skills not present in the team | <= 1, closable by training in one quarter | Platform team plan |
| [EF-nnn] | [EO-nnn] | [Criterion] | [Measure] | [Threshold] | [Source] |
4.2 Constraints, assumptions and other factors
| ID | Type | Factor | Effect on evaluation |
|---|
| EF-101 (Example) | Constraint | Must run in the existing cloud provider tenancy | Candidate comparison excludes other providers |
| EF-102 (Example) | Assumption | Volume grows 35% per year for three years | Cost and capacity analysis use this curve |
| EF-103 (Example) | Resource | Two evaluation days with stakeholders; four analyst weeks | Limits number of scenarios analysed in depth |
| EF-104 (Example) | Evidence | No production data for candidate B | Lower confidence in B performance results |
| [EF-1nn] | [Constraint / Assumption / Resource / Evidence / Risk] | [Factor] | [Effect] |
5. Evaluation approach and methods
5.1 Method selection
| ID | Method | Tier | Objectives served | Why chosen | Effort |
|---|
| EM-01 (Example) | ATAM (scenario-based tradeoff analysis) | Analysis, with stakeholder prioritisation feeding value assessment | EO-001, EO-003, EO-004 | Surfaces risks and tradeoffs across several quality attributes at once | 2 days plus preparation |
| EM-02 (Example) | Queueing model and load test on prototypes | Analysis | EO-001 | Gives numbers for EF-002 | 2 analyst weeks |
| EM-03 (Example) | Three-year cost model | Analysis | EO-002 | Quantifies EF-003 | 1 analyst week |
| EM-04 (Example) | Data flow review against card data scope rules | Analysis | EO-003 | Counts in-scope components for EF-004 | 2 days |
| EM-05 (Example) | Skills inventory and interviews | Analysis | EO-005 | Measures EF-006 | 3 days |
| EM-06 (Example) | Weighted value scoring by stakeholders | Value assessment | All | Turns analysis results into comparable value | Half-day workshop |
| EM-07 (Example) | CBAM-style cost-benefit comparison of top strategies | Value assessment | EO-002, EO-004 | Relates benefit to cost of each architectural strategy | 1 day |
| [EM-nn] | [Method] | [Analysis / Value assessment / Synthesis] | [EO-nnn] | [Reason] | [Effort] |
Other methods you can plug in: a quality attribute workshop before an architecture exists
(Quality Attribute Workshop Report, architecture/qaw-workshop-report), an active design
review of a partial design (ARID Design Review, architecture/arid-design-review), a
cost-benefit analysis (CBAM Analysis, architecture/cbam-analysis), automated fitness
functions for continuous evaluation (Architecture Fitness Functions,
architecture/fitness-functions), simulation, prototyping, checklist and principle
reviews, and expert judgement panels.
5.2 How ATAM plugs into this framework
ATAM is an architectural analysis method in 42030 terms. Its outputs feed value assessment
and synthesis; it does not on its own make the decision. Record the ATAM itself in
Architecture Evaluation Report (ATAM) (architecture/atam-evaluation) and map its outputs
here.
| ATAM output | 42030 element it feeds | Where recorded here |
|---|
| Business drivers | Evaluation context and objectives | Sections 1.3, 3 |
| Utility tree with importance and difficulty ratings | Analysis objectives and value inputs (importance is a value judgement) | Sections 7.1, 8.1 |
| Architectural approaches | Subject of analysis | Section 7.2 |
| Prioritised stakeholder scenarios | Analysis scope and value inputs | Sections 7.1, 8.1 |
| Sensitivity points and tradeoff points | Analysis results | Section 7.3 |
| Risks, non-risks and risk themes | Analysis results; risk themes feed synthesis | Sections 7.3, 9.2 |
| Business drivers threatened by each risk theme | Value assessment results | Section 8.2 |
5.3 Synthesis rule
State in advance how results combine into a conclusion so the outcome is not argued after
the fact.
[Example: "A candidate is acceptable only if every Must objective is rated Met or Met
with conditions. Among acceptable candidates, the one with the higher weighted value score
in section 8.3 is recommended. A difference of less than 10% of the score is reported as
no material difference, and the lower-cost candidate is then recommended."]
6. Evaluation plan
6.1 Schedule
| Step | Activity | Start | End | Output |
|---|
| P-01 (Example) | Agree objectives, factors and methods | YYYY-MM-DD | YYYY-MM-DD | Approved plan v1.0 |
| P-02 (Example) | Collect evidence (architecture description, prototypes, cost data) | YYYY-MM-DD | YYYY-MM-DD | Evidence register |
| P-03 (Example) | ATAM phase 1 and phase 2 | YYYY-MM-DD | YYYY-MM-DD | ATAM report |
| P-04 (Example) | Load tests and cost model | YYYY-MM-DD | YYYY-MM-DD | Analysis results |
| P-05 (Example) | Value assessment workshop | YYYY-MM-DD | YYYY-MM-DD | Value scores |
| P-06 (Example) | Synthesis, draft report, factual accuracy review | YYYY-MM-DD | YYYY-MM-DD | Draft report |
| P-07 (Example) | Report to evaluation authority | YYYY-MM-DD | YYYY-MM-DD | Final report, decision |
| [P-nn] | [Activity] | YYYY-MM-DD | YYYY-MM-DD | [Output] |
6.2 Team and responsibilities
| Activity | Evaluation authority | Evaluation lead | Analysts | Architect | Stakeholders |
|---|
| Set objectives | A | R | C | C | C |
| Select methods | I | A | R | C | I |
| Provide evidence | I | A | C | R | C |
| Run analysis | I | A | R | C | I |
| Value assessment | C | A | R | I | R |
| Synthesis and findings | I | A | R | C | I |
| Accept results and decide | A | R | I | C | I |
R responsible, A accountable, C consulted, I informed.
6.3 Evidence register
| ID | Evidence | Version or date | Provided by | Used for | Reliability |
|---|
| EV-01 (Example) | Architecture description AD-OMP-001 | v1.2, YYYY-MM-DD | [@architect] | EM-01, EM-04 | High |
| EV-02 (Example) | Prototype load test results, candidate A | YYYY-MM-DD | [@platform] | EM-02 | Medium (synthetic data) |
| EV-03 (Example) | Vendor price list and committed-use discount quote | YYYY-MM-DD | [@procurement] | EM-03 | High |
| EV-04 (Example) | Current system incident history, last 12 months | YYYY-MM-DD | [@sre] | EM-01, EM-02 | High |
| [EV-nn] | [Evidence] | [Version] | [@name] | [EM-nn] | [High / Medium / Low] |
6.4 Risks to the evaluation
| Risk | Effect | Mitigation |
|---|
| Example: Key stakeholders unavailable for phase 2 | Value judgements biased towards technical staff | Book dates at plan approval; accept delegates with written mandate |
| Example: Architecture changes during the evaluation | Results describe an outdated architecture | Freeze the description version for the evaluation (EV-01) |
| [Risk] | [Effect] | [Mitigation] |
7. Architectural analysis
7.1 Analysis objectives and scenarios
| ID | Analysis objective | Derived from | Scenario or question | Method |
|---|
| AO-01 (Example) | Determine order capture availability under single zone and region loss | EO-001, EF-001 | Zone failure at peak; full region outage | EM-01, EM-02 |
| AO-02 (Example) | Measure p99 submission latency at 1,200 orders per minute | EO-001, EF-002 | Black Friday peak load | EM-02 |
| AO-03 (Example) | Estimate three-year run cost for both candidates | EO-002, EF-003 | Forecast volume curve EF-102 | EM-03 |
| AO-04 (Example) | Count card data scope components | EO-003, EF-004 | Payment authorisation flow | EM-04 |
| AO-05 (Example) | Estimate effort to add a marketplace channel | EO-004, EF-005 | Growth scenario from ATAM | EM-01 |
| AO-06 (Example) | Identify skills gaps | EO-005, EF-006 | Operate candidate in production | EM-05 |
| [AO-nn] | [Objective] | [EO-nnn, EF-nnn] | [Scenario] | [EM-nn] |
7.2 Architecture elements and approaches analysed
| ID | Approach or element | Candidate | Quality attributes affected |
|---|
| AP-01 (Example) | Event-driven modules with a transactional outbox | A | Availability, modifiability |
| AP-02 (Example) | Independent services with per-service databases | B | Modifiability, operability, cost |
| AP-03 (Example) | Tokenisation gateway in front of payment provider | A and B | Security, card data scope |
| AP-04 (Example) | Active-passive region pair with asynchronous replication | A and B | Availability, cost |
| [AP-nn] | [Approach] | [Candidate] | [Attributes] |
7.3 Analysis results
| ID | Analysis objective | Candidate | Result (fact, measurement or estimate) | Basis | Related risk or tradeoff |
|---|
| AR-01 (Example) | AO-01 | A | Zone loss: no outage, 20 s degradation. Region loss: recovery estimated at 18 min, up to 5 s of orders at risk | EM-01 scenario walk-through, EV-04 | Risk R-01 (recovery time) |
| AR-02 (Example) | AO-01 | B | Zone loss: no outage. Region loss: recovery estimated at 40 min because 14 databases fail over separately | EM-01, EV-01 | Risk R-02; tradeoff T-01 (independence vs recovery coordination) |
| AR-03 (Example) | AO-02 | A | p99 610 ms at 1,200 orders per minute on prototype | EM-02, EV-02 | None |
| AR-04 (Example) | AO-02 | B | p99 920 ms; three synchronous service hops dominate | EM-02 | Sensitivity point S-01 (hop count) |
| AR-05 (Example) | AO-03 | A | USD 3.1 million over three years | EM-03, EV-03 | None |
| AR-06 (Example) | AO-03 | B | USD 3.9 million over three years | EM-03, EV-03 | Tradeoff T-02 (team autonomy vs platform cost) |
| AR-07 (Example) | AO-04 | A and B | 2 components in scope with tokenisation gateway | EM-04 | Non-risk NR-01 |
| AR-08 (Example) | AO-05 | A | 4 to 5 person-weeks; touches the order module | EM-01 | Sensitivity point S-02 (shared order schema) |
| AR-09 (Example) | AO-05 | B | 3 person-weeks; new adapter service only | EM-01 | None |
| AR-10 (Example) | AO-06 | B | Three critical skills missing (service mesh, distributed tracing, per-service database operations) | EM-05 | Risk R-03 |
| AR-11 (Example) | AO-06 | A | One critical skill missing (event streaming operations), covered by a vendor course of four weeks | EM-05 | None |
| [AR-nn] | [AO-nn] | [Candidate] | [Result] | [Method, evidence] | [Risk / tradeoff / sensitivity point] |
8. Value assessment
8.1 Value scale and weights
| Score | Meaning |
|---|
| 5 | Exceeds the threshold with margin; creates new options |
| 4 | Meets the threshold with margin |
| 3 | Meets the threshold |
| 2 | Misses the threshold, but a known change closes the gap |
| 1 | Misses the threshold; no known remedy within constraints |
| Objective | Weight | Weight set by | Rationale |
|---|
| EO-001 (Example) | 30% | SH-01 with SH-02 | Peak season is 40% of annual revenue |
| EO-002 (Example) | 25% | SH-01 | Run cost is a business case condition |
| EO-003 (Example) | 20% | SH-03 | Compliance scope drives audit cost |
| EO-004 (Example) | 15% | SH-02 | Channel strategy |
| EO-005 (Example) | 10% | SH-04 | Staffing is adjustable |
| Total | 100% | | |
8.2 Value judgements
| ID | Objective | Candidate | Analysis results used | Score | Stakeholder rationale |
|---|
| VA-01 (Example) | EO-001 | A | AR-01, AR-03 | 3 | Latency has margin; an 18 min region recovery fits the 21.6 min monthly downtime budget of EF-001, with little margin |
| VA-02 (Example) | EO-001 | B | AR-02, AR-04 | 1 | Latency misses EF-002 by 15% and a 40 min region recovery exceeds the 21.6 min monthly budget; no tested remedy within constraints |
| VA-03 (Example) | EO-002 | A | AR-05 | 4 | 26% below the cap |
| VA-04 (Example) | EO-002 | B | AR-06 | 3 | 7% below the cap |
| VA-05 (Example) | EO-003 | A | AR-07 | 3 | Scope unchanged |
| VA-06 (Example) | EO-003 | B | AR-07 | 3 | Scope unchanged |
| VA-07 (Example) | EO-004 | A | AR-08 | 4 | Inside the 6 person-week target |
| VA-08 (Example) | EO-004 | B | AR-09 | 5 | Half the target, no core change |
| VA-09 (Example) | EO-005 | A | AR-11 | 4 | One gap, closable by training |
| VA-10 (Example) | EO-005 | B | AR-10 | 2 | Three gaps; hiring needed |
| [VA-nn] | [EO-nnn] | [Candidate] | [AR-nn] | [1 to 5] | [Rationale] |
8.3 Weighted value
| Candidate | EO-001 (30%) | EO-002 (25%) | EO-003 (20%) | EO-004 (15%) | EO-005 (10%) | Weighted score |
|---|
| A (Example) | 3 | 4 | 3 | 4 | 4 | 3.50 |
| B (Example) | 1 | 3 | 3 | 5 | 2 | 2.60 |
Computation for A: 0.30 x 3 + 0.25 x 4 + 0.20 x 3 + 0.15 x 4 + 0.10 x 4 = 0.90 + 1.00 +
0.60 + 0.60 + 0.40 = 3.50. For B: 0.30 + 0.75 + 0.60 + 0.75 + 0.20 = 2.60. Recompute
whenever a score or weight changes.
9. Evaluation synthesis and results
9.1 Result per objective
| Objective | Candidate A | Candidate B | Evidence |
|---|
| EO-001 (Example) | Met | Not met (latency, region recovery) | VA-01, VA-02 |
| EO-002 (Example) | Met | Met | VA-03, VA-04 |
| EO-003 (Example) | Met | Met | VA-05, VA-06 |
| EO-004 (Example) | Met | Met | VA-07, VA-08 |
| EO-005 (Example) | Met | Met with conditions (hiring) | VA-09, VA-10 |
| [EO-nnn] | [Met / Met with conditions / Not met / Not determined] | [Result] | [VA-nn] |
9.2 Risk themes and opportunities
| ID | Theme | Risks grouped | Objectives threatened | Candidates |
|---|
| RT-01 (Example) | Regional recovery depends on manual, multi-step failover | R-01, R-02 | EO-001 | A and B (worse in B) |
| RT-02 (Example) | Operating a distributed platform exceeds current team capability | R-03 | EO-005, EO-001 | B |
| OP-01 (Example) | Outbox events can feed the planned analytics platform with no extra integration | Not a risk | EO-004 | A |
| [RT-nn / OP-nn] | [Theme] | [R-nn] | [EO-nnn] | [Candidates] |
9.3 Overall conclusion
[Example: "Candidate A satisfies all Must objectives and scores 3.50 against 2.60 for
candidate B. Candidate B fails EO-001 on latency and regional recovery and needs three new skills.
The evaluation recommends candidate A, subject to REC-01 on regional recovery and REC-02
on latency monitoring. Candidate B's advantage in channel onboarding (EO-004) is real but does
not offset the latency and skills gaps at the current weights."]
10. Findings and recommendations
10.1 Findings
| ID | Finding | Evidence | Objectives | Severity |
|---|
| FND-01 (Example) | Region recovery in both candidates relies on runbook steps never rehearsed | AR-01, AR-02, EV-04 | EO-001 | High |
| FND-02 (Example) | Candidate B latency is sensitive to the number of synchronous hops on the order path | AR-04 | EO-001 | Medium |
| FND-03 (Example) | The shared order schema in candidate A is the main constraint on channel onboarding | AR-08 | EO-004 | Low |
| [FND-nn] | [Finding] | [AR-nn, VA-nn, EV-nn] | [EO-nnn] | [High / Medium / Low / Information] |
10.2 Recommendations
| ID | Recommendation | Addresses | Owner | Due | Acceptance criterion |
|---|
| REC-01 (Example) | Automate region failover and rehearse it in a game day before go-live | FND-01 | [@sre-lead] | YYYY-MM-DD | Rehearsal recovers in <= 15 min with no lost orders |
| REC-02 (Example) | Add a fitness function that fails the release if p99 submission latency exceeds 800 ms in the performance environment | FND-02, EF-002 | [@platform] | YYYY-MM-DD | Function FF-nn live in the pipeline |
| REC-03 (Example) | Version the order schema and add an extension area for channel attributes | FND-03 | [@lead-architect] | YYYY-MM-DD | Architecture decision recorded; next channel added without schema change |
| [REC-nn] | [Recommendation] | [FND-nn] | [@owner] | YYYY-MM-DD | [Criterion] |
11. Confidence, limitations and assumptions
| Result or objective | Confidence | Reason | What would raise confidence |
|---|
| EO-001, candidate A (Example) | Medium | Prototype load test with synthetic data; region recovery estimated, not measured | Rehearsed failover (REC-01) and a production-like load test |
| EO-002 (Example) | High | Vendor quote and committed-use discount confirmed | Not needed |
| EO-005, candidate B (Example) | Medium | Skills inventory self-reported | Practical assessment |
| [Result] | [High / Medium / Low] | [Reason] | [Action] |
Limitations of this evaluation:
- [Example: Only the five highest-priority ATAM scenarios were analysed in depth; 19 lower-priority scenarios were recorded but not analysed.]
- [Example: Security was evaluated for card data scope only; a full threat model is out of scope (see Threat Model,
security/threat-model).]
- [Example: Cost model assumes the volume curve in EF-102; at half that growth the cost gap between candidates narrows to USD 0.4 million.]
12. Traceability and follow-up
12.1 Traceability matrix
| Objective | Factors | Methods | Analysis results | Value judgements | Result | Findings | Recommendations |
|---|
| EO-001 (Example) | EF-001, EF-002 | EM-01, EM-02 | AR-01 to AR-04 | VA-01, VA-02 | A met, B not met | FND-01, FND-02 | REC-01, REC-02 |
| EO-002 (Example) | EF-003 | EM-03, EM-07 | AR-05, AR-06 | VA-03, VA-04 | Both met | None | None |
| EO-003 (Example) | EF-004 | EM-04 | AR-07 | VA-05, VA-06 | Both met | None | None |
| EO-004 (Example) | EF-005 | EM-01, EM-07 | AR-08, AR-09 | VA-07, VA-08 | Both met | FND-03 | REC-03 |
| EO-005 (Example) | EF-006 | EM-05 | AR-10, AR-11 | VA-09, VA-10 | A met, B met with conditions | None | None |
| [EO-nnn] | [EF-nnn] | [EM-nn] | [AR-nn] | [VA-nn] | [Result] | [FND-nn] | [REC-nn] |
12.2 Follow-up actions
| ID | Action | Owner | Due | Status |
|---|
| ACT-01 (Example) | Record the decision and conditions in an architecture decision record | [@lead-architect] | YYYY-MM-DD | Open |
| ACT-02 (Example) | Add RT-01 and RT-02 to the programme risk register | [@pm] | YYYY-MM-DD | Open |
| [ACT-nn] | [Action] | [@owner] | YYYY-MM-DD | [Open / Done] |
12.3 Re-evaluation triggers
Re-run the evaluation, or the affected part of it, when any of these occur:
- A Must objective, threshold or weight changes.
- The architecture changes an approach analysed in section 7.2.
- Evidence with low confidence (section 11) is replaced by measured data that contradicts the estimate.
- A fitness function linked to an evaluation factor fails repeatedly in production.
- [Organisation-specific trigger, for example the annual architecture health check in Architecture Health Check (
architecture/architecture-health-check)].
12.4 Report completeness check
Before issuing the report (clause 8.3), confirm:
13. Glossary and references
| Term | Meaning in this document |
|---|
| Architecture evaluation | Determining how well an architecture meets its objectives and serves its stakeholders, for a stated decision |
| Architectural analysis | Work that establishes facts or estimates about architecture properties, using models, tests, walk-throughs or calculations |
| Value assessment | Judging how much the analysis results are worth to the stakeholders, on a declared scale |
| Evaluation synthesis | Combining analysis and value results against the objectives into conclusions |
| Evaluation factor | Anything that shapes how an objective is judged: criteria, thresholds, constraints, assumptions, resources, evidence |
| Evaluation authority | The person or body that commissions the evaluation and acts on its results |
| Sensitivity point | An architectural property that strongly affects one quality attribute response (ATAM term) |
| Tradeoff point | A property that affects more than one quality attribute in opposite directions (ATAM term) |
| Risk theme | A group of related risks that together threaten a business driver (ATAM term) |
| ID | Reference | Version | Use |
|---|
| REF-01 | ISO/IEC/IEEE 42030, Software, systems and enterprise: Architecture evaluation framework | 2019, first edition (stage 90.92, to be revised since 2026-01-08; AWI 42030 Enterprise, systems and software: Architecture evaluation framework registered 2026-05-22) | Structure of this template |
| REF-02 | ISO/IEC/IEEE 42020, Software, systems and enterprise: Architecture processes, clause 9 Architecture Evaluation process | 2019 | Process context; see Architecture Process Plan and Records (architecture/architecture-practice-42020) |
| REF-03 | ISO/IEC/IEEE 42010, Software, systems and enterprise: Architecture description | 2022 | Evidence: the architecture description |
| REF-04 | Kazman, Klein, Clements, ATAM: Method for Architecture Evaluation, SEI CMU/SEI-2000-TR-004 | August 2000 | Plug-in analysis method |
| REF-05 | Related templates: Architecture Evaluation Report (ATAM) (architecture/atam-evaluation), Non-Functional Requirements and Quality Attribute Scenarios (requirements/quality-attributes), Architecture Fitness Functions (architecture/fitness-functions), CBAM Analysis (architecture/cbam-analysis) | Current | Methods and inputs |
| [REF-nn] | [Title] | [Version] | [Use] |
Standard and licence note
Structure aligned with ISO/IEC/IEEE 42030:2019, Software, systems and enterprise:
Architecture evaluation framework (clauses 4 to 8: evaluation context, the three
evaluation tiers, evaluation factors, customised frameworks, conformance, and the
evaluation plan and report work products), with the Architecture Evaluation process of
ISO/IEC/IEEE 42020:2019 as process context and the SEI Architecture Tradeoff Analysis
Method as an example analysis method. Only clause numbers and short topic labels are used;
all explanations, tables and examples are original text written for this collection, and
no text, definition or table of the standards is reproduced. ISO lists the 2019 edition as
"to be revised" (stage 90.92 since 2026-01-08), and a second edition is registered as work
item AWI 42030 (2026-05-22) under the reordered title Enterprise, systems and software:
Architecture evaluation framework; check the current edition in the ISO catalogue before
claiming conformance. ATAM may be a trademark or service mark of
Carnegie Mellon University; this template is not affiliated with or endorsed by the SEI. Template licence: MIT.