Markdown Editor

Test Completion Report Template (ISO/IEC/IEEE 29119-3)

Test completion report: criteria evaluation, deviations, metrics with defect density, outstanding defects, residual risks, sign-off

테스트 및 품질전체ISO/IEC/IEEE 29119-3testcompletionreportmath

사용법: Use it at the end of a release or test level to support the go or no-go decision. Fill the completion evaluation against the plan's criteria first, then residual risks with named owners. The main pitfall is numbers that do not reconcile or a recommendation without evidence.

미리보기

Test Completion Report: [Project or release name]

Test completion report for a project, release or test level. The structure follows the test completion report information item of ISO/IEC/IEEE 29119-3: summary of testing, deviations from the plan, completion evaluation, metrics, residual risks, lessons learned and a recommendation. Replace every [bracketed] value and every row marked Example.

Document control

FieldValue
Document ID[TCR-PROJECT-001]
Project / release[Project name] [release]
Scope of report[Whole project / System test level / Performance testing]
Test plan closed[TP-PROJECT-001 version x.y]
Reporting periodYYYY-MM-DD to YYYY-MM-DD
Version[0.1]
Status[Draft / In review / Approved]
Author[@test-manager]
Classification[Internal / Confidential]
Last updatedYYYY-MM-DD

Approvals

RoleNameDecisionDate
Test manager[@name][Approved]YYYY-MM-DD
Product owner[@name][Release / Release with conditions / Do not release]YYYY-MM-DD
Engineering lead[@name][Decision]YYYY-MM-DD
Release manager[@name][Decision]YYYY-MM-DD

Revision history

VersionDateAuthorChange summary
0.1YYYY-MM-DD[@name]Draft for go/no-go meeting
1.0YYYY-MM-DD[@name]Example: Updated after retest of BUG-3412; approved

Contents

1. Summary and recommendation

1.1 Recommendation

[Release / Release with conditions / Do not release]

Example: Release with conditions. All high-risk features passed; four of seven completion criteria are fully met, two are met with approved exceptions and one is not met (see RR-01); one severity-2 defect (BUG-3412) remains open with a documented workaround and a fix scheduled for 4.2.1 within 10 days.

1.2 Key facts

ItemValue
Test cases planned / executed[412 / 398]
Passed / failed / blocked[389 / 9 / 6]
Must-have requirements covered by a passed test[97 of 98 (99%)]
Defects found / fixed / rejected / open[86 / 68 / 11 / 7]
Open by severity (S1 / S2 / S3 / S4)[0 / 1 / 4 / 2]
Escaped defects from previous release found during this cycle[2]

1.3 Conditions attached to the recommendation

  • [Condition, for example: hotfix 4.2.1 with BUG-3412 fix released by YYYY-MM-DD.]
  • [Condition, for example: support team briefed on the workaround before go-live.]

2. Testing performed

Test sub-processBuilds testedEnvironmentPeriodResult
Unit and integrationAll merges to release/4.2CIYYYY-MM-DD to YYYY-MM-DD3,412 automated tests, 100% pass on final build
System test cycle 14.2.0-rc1System testYYYY-MM-DD to YYYY-MM-DD61 defects raised
System test cycle 24.2.0-rc3System testYYYY-MM-DD to YYYY-MM-DDExit criteria met with exceptions
Performance4.2.0-rc3PerformanceYYYY-MM-DD to YYYY-MM-DDp95 within SLA at 120% forecast peak
UAT4.2.0-rc3UATYYYY-MM-DD to YYYY-MM-DDSigned off by finance and operations
[Sub-process][Build][Env][Period][Result]

2.1 Features not tested

Feature or requirementReasonConsequenceCovered elsewhere
Example: Bulk export (SRS-FR-118)Storage emulator unavailable in system testNot verified end to endUnit tests only; see RR-01
Example: Legacy coupon importUnchanged since 4.0, low riskNo regression run this cycleNightly automated suite
[Feature][Reason][Consequence][Where]

2.2 Test environment observations

Record availability problems, configuration differences from production and data issues that affected the results, so readers can judge how far the results carry over to production.

  • Example: System test environment unavailable for 1.5 days in week 3 (database migration failure); cycle 2 extended by one day.
  • Example: Payment sandbox does not simulate issuer timeouts; timeout handling tested with a stub only.
  • [Observation and its effect on results.]

3. Deviations from the test plan

IDPlannedActualReasonEffect on confidenceApproved by
DV-01Example: Soak test 8 hoursSoak test 4 hoursEnvironment shared with another releaseMemory leaks with slow growth may be missed; production memory alert added[@pm]
DV-02Example: Device lab covers 12 devices9 devicesThree devices failedAndroid 12 low-end coverage reduced; beta channel monitoring extended[@test-manager]
[DV-nn][Planned][Actual][Reason][Effect][@name]

4. Test completion evaluation

Criterion (from plan)TargetActualStatusComment
High-risk test cases executed100%100%Met
All planned test cases executed>= 95%96.6%Met14 low-priority cases not run
Pass rate of executed tests>= 98%97.7%Met with exception9 failures linked to 7 open S3/S4 defects
Open S1 defects00Met
Open S2 defects0 or approved workaround1 with workaroundMet with exceptionBUG-3412, see 6.2
Must-have requirements covered by passed test100%99%Not metSRS-FR-118 blocked by environment, see 7
Performance targets at forecast peakMetMetMet

5. Test metrics

5.1 Execution summary by feature area

Feature areaPlannedExecutedPassedFailedBlockedNot run
Example: Checkout120120117300
Example: Promotions646463100
Example: Account888278224
Example: Warehouse140132131344
Total412398389968

5.2 Defect density

Defect density normalises defects by size so components can be compared:

Defect density=defects foundsize in KLOC changed\text{Defect density} = \frac{\text{defects found}}{\text{size in KLOC changed}}

ComponentDefects foundKLOC changedDensityPrevious release
Example: Checkout UI3112.42.51.8
Example: Pricing service184.14.42.0
Example: Orders API229.72.32.6
[Component][n][KLOC][d][d]

Example interpretation: Pricing density more than doubled; the rewrite of the rule engine is the likely cause and is listed as a residual risk.

5.3 Defect trend

Defects opened and closed per week show whether the product was stabilising at the end of testing. A closing rate above the opening rate for the final two weeks is expected before release.

WeekOpenedClosedOpen at end of week
W124618
W2312029
W3192721
W481910
W5477

Example interpretation: The open count peaked in week 2, when cycle 1 results were triaged, and fell in each of the last three weeks. The closing rate exceeded the opening rate from week 3 onward, which supports the view that the product stabilised before the release decision.

5.4 Requirements coverage

Coverage shows how much of the agreed test basis has evidence behind it. It is reported separately for must-have requirements because the release decision depends on them.

Requirement classTotalCovered by a passed testCovered, test failedNot coveredCoverage
Must-have98970199%
Should-have54492391%
Could-have21150671%
[Class][n][n][n][n][%]

Requirements not covered are listed with the reason in section 7 or in the deviation log in section 3.

5.5 Other measures

MeasureValueComment
Automated regression suite duration[38 min]Within 45-minute budget
Flaky tests quarantined[3]All tickets assigned
Defect detection percentage (previous release, 90 days)[91%]Target 90%
Test effort planned / actual (person-days)[69 / 74]Overrun from third retest cycle

6. Defects

6.1 Summary by severity

SeverityFoundFixed and verifiedRejected or duplicateOpen
S1 Critical3300
S2 Major141211
S3 Minor413344
S4 Cosmetic282062

6.2 Outstanding defects

IDTitleSeverityPriorityWorkaroundDecisionTarget fix
BUG-3412Example: Gift card plus promotion code shows wrong total until page refreshS2P1Refresh summary page; charged amount is correctAccept for release; fix in 4.2.1YYYY-MM-DD
BUG-3420Example: Sort by date ignores time zone on order historyS3P3None neededAccept; backlog4.3
[ID][Title][S][P][Workaround][Decision][Release or date]

7. Residual risks

IDResidual riskSourceMitigation in productionAccepted by
RR-01Example: SRS-FR-118 (bulk export) not verified end to endBlocked by environmentFeature flag off at launch; enable after verification in staging[@product-owner]
RR-02Example: Slow memory growth beyond 4 hours not observedDV-01Memory alert at 80%; automatic restart policy[@sre-lead]
RR-03Example: Pricing engine defect density high5.2Extra monitoring of discount totals for 14 days[@engineering-lead]
[RR-nn][Risk][Source][Mitigation][@name]

8. Test deliverables and archive

DeliverableLocationRetention
Test plan and design specifications[Repository path or wiki link][Two years]
Test runs and logs[Test management tool project][Two years]
Defect reports[Issue tracker filter][Indefinite]
Performance results[Results bucket or report link][One year]
UAT sign-off[Document link][Regulatory period]

Test environments released: [system test environment returned to platform team on YYYY-MM-DD; test data purged].

9. Lessons learned

IDObservationEffectActionOwnerDue
LL-01Example: Contract tests caught 11 API breaking changes before system testSaved roughly one test cycleExtend contract testing to warehouse APIs[@name]YYYY-MM-DD
LL-02Example: Shared performance environment caused DV-01Reduced soak coverageBook environment at release planning[@name]YYYY-MM-DD
LL-03Example: UAT testers had no training on defect reporting20% of UAT reports needed reworkAdd 1-hour onboarding to UAT plan[@name]YYYY-MM-DD
[LL-nn][Observation][Effect][Action][@name]YYYY-MM-DD

10. Sign-off

By approving this report, the signatories confirm that the testing described has been completed or deviations accepted, and that the residual risks and outstanding defects listed above are accepted for the release decision recorded below.

Decision[Release / Release with conditions / Do not release]
Decision dateYYYY-MM-DD
Recorded in[Go/no-go meeting minutes link]
RoleNameSignature or approval referenceDate
Test manager[@name][Reference]YYYY-MM-DD
Product owner[@name][Reference]YYYY-MM-DD
Release manager[@name][Reference]YYYY-MM-DD

Standard and licence note

Structure aligned with ISO/IEC/IEEE 29119-3, Software and systems engineering: Software testing, Part 3: Test documentation, test completion report information item. This template is original text written for this collection and reproduces no text from the standard; obtain the standard from ISO, IEC or IEEE for its normative requirements. Template licence: MIT.

관련 템플릿