Markdown Editor

Vendor Evaluation Scorecard Template

Evaluation plan, panel and conflicts, anchored scale, knock-outs, weighted criteria, individual and consensus scores, demos, due diligence, price score

商务完整ISO/IEC/IEEE 41062:2024; ISO/IEC 25040:2024vendorevaluationscorecardmath

使用方法: Use it when several evaluators score RFI or RFP responses and the award must be defensible. Fill and approve the plan, scale, knock-outs, weights and price method before opening any response, then score individually and moderate to consensus. The main pitfall is changing weights after seeing responses or letting quality evaluators see prices before moderation.

预览

Vendor Evaluation Scorecard: [Procurement or RFP name]

Evaluation record for selecting a supplier from RFI or RFP responses: evaluation plan, evaluators and conflict of interest declarations, anchored scoring scale, knock-out criteria, weighted quality criteria, individual and consensus scores, demonstrations and proof of concept, reference checks, due diligence (financial, security, privacy, regulatory, roadmap, exit), price normalisation and scoring, combined ranking with sensitivity, risks and negotiation points, and the recommendation. Structure aligned with the supplier selection concerns of ISO/IEC/IEEE 41062:2024 (software acquisition) and the evaluation framework of ISO/IEC 25040:2024. Replace every [bracketed] value and every row marked Example. This is a documentation format, not legal or procurement advice; public bodies must follow their procurement law and rules, which take precedence.

Document control

FieldValue
Document ID[VES-001]
Procurement[RFP ID and title]
Lot or scope[Lot name]
Procurement route[Open / Restricted / Negotiated / Framework call-off / Private sector competitive tender]
Responses received[Number], closing date YYYY-MM-DD
Evaluation chair[@procurement-lead]
Version[0.1]
Status[Plan approved / Evaluation in progress / Moderated / Recommended / Awarded]
Owner[@solution-architect]
Approvers/reviewers[@procurement-lead], [@business-owner], [@security-architect], [@legal]
Last updatedYYYY-MM-DD
Classification[Commercial in confidence, evaluation panel only]

Approvals

RoleNameDecisionDate
Evaluation chair (plan, sections 1 to 6)[@name][Approved before opening]YYYY-MM-DD
Business owner[@name][Approve / Approve with conditions / Reject]YYYY-MM-DD
Procurement or sourcing board[@name][Decision]YYYY-MM-DD
Budget holder[@name][Decision]YYYY-MM-DD

Revision history

VersionDateAuthorChange summary
0.1YYYY-MM-DD[@name]Evaluation plan, criteria and weights
1.0YYYY-MM-DD[@name]Example: Plan approved and locked before responses opened
1.1YYYY-MM-DD[@name]Example: Knock-out results, individual and consensus scores
2.0YYYY-MM-DD[@name]Example: Recommendation after due diligence and best and final offers

Contents

1. Evaluation scope and plan

ItemValue
RequirementExample: Cloud contact centre platform (voice, chat, email, workforce management) for 250 agents in 3 countries
ContractExample: 5 years, with optional 2-year extension
Budget envelopeExample: USD 1.6 million over 5 years (not disclosed to bidders)
Award basisExample: Best value: quality 70%, price 30%
BiddersExample: 4 responses: V1, V2, V3, V4
StageActivityOutputDates
0Plan, criteria and weights approved; evaluators briefedThis document v1.0YYYY-MM-DD
1Compliance check (completeness, mandatory forms)Section 4YYYY-MM-DD
2Knock-out screeningSection 4YYYY-MM-DD
3Individual written scoringSection 7YYYY-MM-DD to YYYY-MM-DD
4Moderation to consensusSection 8YYYY-MM-DD
5Scripted demonstrations and proof of concept (shortlist)Section 9YYYY-MM-DD
6References and due diligenceSections 10, 11YYYY-MM-DD
7Price opening and normalisationSection 12YYYY-MM-DD
8Best and final offer (if used)Section 12YYYY-MM-DD
9Recommendation and approvalSection 15YYYY-MM-DD

2. Evaluation team and conflicts of interest

EvaluatorRoleCriteria scoredDeclaration signedConflict declaredAction
E1 (Example)Contact centre operations managerQ1, Q5YYYY-MM-DDNone
E2 (Example)Solution architectQ1, Q2, Q4YYYY-MM-DDNone
E3 (Example)Security architectQ1, Q3YYYY-MM-DDNone
E4 (Example)Integration leadQ1, Q2, Q4YYYY-MM-DDFormer employee of V4, left 2 years agoDeclared; V4 excluded at knock-out, no further action
E5 (Example)Commercial analystPrice only (section 12)YYYY-MM-DDNoneDoes not see quality scores until moderated
Chair (Example)Procurement leadDoes not score; runs moderationYYYY-MM-DDNone
ActivityChairEvaluatorsCommercial analystBusiness ownerLegal
Approve plan and weightsRCCAC
Individual scoringIRIII
ModerationRCIII
Price evaluationAIRII
Due diligenceACCIR
RecommendationRCCAC

R = responsible, A = accountable, C = consulted, I = informed.

3. Scoring scale and rules

ScoreLabelAnchor
5ExcellentFully meets the requirement with strong evidence; adds value beyond it with no material risk
4GoodFully meets the requirement with good evidence; minor weaknesses only
3AcceptableMeets the requirement; evidence adequate; some weaknesses or risks that are manageable
2WeakPartly meets the requirement; gaps or risks that need significant mitigation
1PoorBarely addresses the requirement; major gaps or unsupported claims
0No responseRequirement not addressed

Rules:

  1. Score only what is in the response, the demo, the PoC or the references. Knowledge of the bidder from outside the process is not evidence.
  2. Write a justification of at least one sentence for every score, citing the response section.
  3. Score each criterion for all bidders before moving to the next criterion, to keep the scale consistent.
  4. Clarification questions go through the chair, in writing, to all bidders where the answer could change their position.
  5. Weighted points for a criterion are the criterion weight times the score divided by 5.

4. Knock-out criteria

IDKnock-out criterionEvidence requiredV1V2V3V4
KO-1 (Example)Customer data stored and processed in the EU, including support accessData processing annex, sub-processor listPassPassPassFail
KO-2 (Example)Current ISO/IEC 27001 certificate or SOC 2 Type II report covering the serviceCertificate or reportPassPassPassPass
KO-3 (Example)Accepts the mandatory contract terms (liability cap, audit rights, exit assistance)Signed compliance statementPassPassPassPass
KO-4 (Example)Native or API integration with the CRM in useDocumentation, referencePassPassPassPass
KO-5 (Example)Response complete and on timeCompliance checkPassPassPassPass
ResultContinueContinueContinueExcluded

Example note: V4's sub-processor list places tier 2 support in a non-EU location with access to call recordings (response section 7.3), which fails KO-1. The chair confirmed the reading with V4 by written clarification CQ-09 on YYYY-MM-DD.

5. Weighted quality criteria

IDCriterionWhat good looks likeWeightEvaluators
Q1 (Example)Functional fitCovers routing, omnichannel, workforce management and reporting requirements in RFP section 4 with little customisation25E1, E2, E3, E4
Q2 (Example)Integration and APIsDocumented APIs and events for CRM, identity and data platform; sandbox access12E2, E4
Q3 (Example)Security, privacy and complianceControls, certifications, data protection terms, recording security, AI feature transparency12E3
Q4 (Example)Non-functional qualitiesAvailability commitment, voice quality, scalability for seasonal peaks, regional resilience8E2, E4
Q5 (Example)Delivery approach and referencesCredible plan, named team, migration method, similar customers8E1
Q6 (Example)Vendor viability and roadmapFinancial health, product investment, roadmap fit5E2 with input from section 11
Total quality70

6. Price evaluation method

Price is scored on the normalised 5-year total cost of each bid (section 12). The lowest normalised cost CminC_{min} receives the full price weight WpW_p; others receive a proportional score:

Pv=Wp×CminCvP_v = W_p \times \frac{C_{min}}{C_v}
RuleValue
Price weight WpW_pExample: 30
Volume basisExample: 250 named agents for 60 months, 2 supervisors per 25 agents included in the agent price
IncludedExample: Subscription, telephony bundles, implementation, data migration, training, premium support
ExcludedExample: Call minutes beyond the bundle (priced separately at the same assumed volume for all bidders), taxes
Abnormally low bidsExample: A bid more than 30% below the average is investigated in writing before scoring
Best and final offerExample: Allowed once, for the top two bidders, on price and contract terms only

The ratio method is simple and widely used, but it makes each bidder's score depend on the lowest bid. If that is a concern, use a method fixed against the budget envelope instead, and state it in the RFP.

7. Individual scores

CriterionBidderE1E2E3E4MeanRangeModeration needed
Q1 (Example)V144354.002Yes
Q1 (Example)V233343.251No
Q1 (Example)V354554.751No
Q2 (Example)V1333.000No
Q2 (Example)V2544.501No
Q2 (Example)V3243.002Yes
[Qn][Vn][ ][ ][ ][ ][ ][ ][Yes / No]

Justification log (one row per score, kept in the evaluator's sheet):

EvaluatorCriterionBidderScoreJustification and evidence
E3 (Example)Q1V13Workforce management is a partner add-on with a separate login (response 4.6); reporting meets RFP 4.9
E4 (Example)Q1V15All routing scenarios in RFP 4.2 shown natively in response 4.2 annex B

8. Consensus scores

CriterionWeightV1 scoreV1 pointsV2 scoreV2 pointsV3 scoreV3 points
Q1 Functional fit25420.0315.0525.0
Q2 Integration and APIs1237.2512.037.2
Q3 Security, privacy and compliance1249.649.637.2
Q4 Non-functional qualities846.434.846.4
Q5 Delivery approach and references834.846.446.4
Q6 Vendor viability and roadmap544.033.044.0
Quality total (of 70)7052.050.856.2

Example arithmetic: points = weight x score / 5, so V3 Q1 is 25 x 5 / 5 = 25.0 and V2 Q4 is 8 x 3 / 5 = 4.8.

Moderation itemIndividual rangeConsensusRationale
Q1 V1 (Example)3 to 54Panel agreed that the partner add-on for workforce management meets the requirement but adds a second login; core routing is strong
Q2 V2 (Example)4 to 5 (not flagged; reviewed because the consensus differs from the mean 4.50)5Response section 5 documents an event stream, webhooks and self-service sandbox access; API coverage exceeds RFP section 5. The PoC in section 9 later tests this claim
Q2 V3 (Example)2 to 43APIs adequate; no event stream, polling needed for real-time agent state (response 5.4)

9. Demonstrations and proof of concept

ItemValue
ShortlistExample: V1, V2, V3 (all bidders that passed knock-outs)
ScriptExample: Demo Script DS-03 (business/demo-script), 6 scenarios, 2 hours per bidder
PoC scopeExample: CRM screen pop and call recording export in our sandbox, 2 weeks, for V2 and V3, whose responses relied on screen pop features released in the last 6 months
PoC success criteriaExample: Screen pop within 1 second of answer in 95% of 200 test calls; recording export by API within 5 minutes
ScenarioV1V2V3Effect on score
DS-03-1 Inbound call with CRM screen pop (Example)ShownShownShownNone
DS-03-4 Supervisor rebalances queues during a peak (Example)ShownPartly: manual stepsShownConfirms V2 Q1 score of 3
PoC-1 Screen pop timing (Example)Not in PoC0.6 s at p950.8 s at p95Confirms Q2 consensus

10. Reference checks

BidderReferenceSize and sectorDelivered on time?Service qualityWould choose again?Concerns raised
V1 (Example)Retail bank, 400 agentsSimilar2 weeks lateGood; 1 major outage in 2 yearsYesWorkforce management add-on support is slow
V2 (Example)Utility, 300 agentsSimilarYesGoodYesSupervisor tools less mature
V3 (Example)Insurer, 220 agentsSimilar3 months lateVery good after go-liveYesImplementation team turnover

11. Due diligence

AreaCheckV1V2V3Source
Financial viabilityCredit report, audited accounts, fundingExample: Stable, profitableExample: Stable, listed companyExample: Venture funded, 3 years of runway reportedCredit agency report YYYY-MM-DD
Information securitySupplier security assessmentExample: Low residual riskExample: LowExample: Medium: penetration test findings opencompliance/supplier-security-assessment
PrivacyData processing terms, sub-processors, transfersExample: AcceptableExample: AcceptableExample: AcceptableDPIA reference
AI featuresTransparency, training on customer data, opt-outExample: Opt-out by contractExample: No training on customer dataExample: Opt-in onlycompliance/ai-vendor-risk-questionnaire
Regulatory (if applicable)For a financial entity, ICT third-party register entry and contract terms required by DORA[ ][ ][ ]compliance/dora-ict-third-party-register
RoadmapCommitments relevant to our needsExample: Native workforce management in 12 monthsExample: Supervisor tooling upgrade announcedExample: StrongRoadmap briefings under NDA
ExitData export formats, exit assistance, noticeExample: Full export, 6 months assistanceExample: Full export, 12 months assistanceExample: Export of recordings only on requestResponse section 9
Supply chainKey sub-processors and their locationsExample: 3 sub-processors, all EUExample: 4, all EUExample: 2, all EUSub-processor lists

Outcome: [Example: No bidder excluded at due diligence. V3's open penetration test findings and runway are carried as risks in section 14.]

12. Price normalisation and scores

All figures in USD thousand over 60 months, Example values.

Price componentV1V2V3
Agent subscription per agent per month (USD)9575105
Subscription, 250 agents x 60 months1,4251,1251,575
Telephony bundles and premium support (included in the agent price for V1 to V3, confirmed in each price schedule)000
Implementation, migration and training (one-time)255545
Normalised 5-year cost CvC_v1,4501,1801,620
Price score Pv=30×1180/CvP_v = 30 \times 1180 / C_v24.4130.0021.85

Example arithmetic: 250 x 60 = 15,000 agent-months; V1 is 15,000 x 95 = USD 1,425,000. V1 price score is 30 x 1,180 / 1,450 = 24.41, and V3 is 30 x 1,180 / 1,620 = 21.85. V1 and V2 are inside the USD 1.6 million envelope; V3 (1.62 million) is 1.25% over and is flagged to the budget holder.

13. Combined ranking and sensitivity

BidderQuality (of 70)Price (of 30)Total (of 100)Rank
V152.024.4176.413
V250.830.0080.801
V356.221.8578.052
ScenarioV1V2V3Leader
Baseline 70 / 3076.4180.8078.05V2
Example: 80 / 2075.7078.0678.80V3
Example: 60 / 4077.1283.5477.31V2
Example: V3 lowers price by 10% at best and final offer (70 / 30)76.4180.8080.48V2

Example arithmetic for 80 / 20: quality points are scaled by 80 / 70 and price points by 20 / 30, so V3 is 56.2 x 80 / 70 + 21.85 x 20 / 30 = 64.23 + 14.57 = 78.80. For the last row, V3's cost becomes 1,458 and its price score 30 x 1,180 / 1,458 = 24.28, giving 56.2 + 24.28 = 80.48.

Example reading: V2 leads at the published 70 / 30 split by 2.75 points, but V3 leads if quality is weighted more. The published weights govern the award; the sensitivity shows that the result is close and that V2's weaker supervisor tooling (Q1) should be addressed in negotiation.

14. Risks and negotiation points

IDBidderRisk or gapSourceTreatmentOwner
VES-RSK-001 (Example)V2Supervisor queue tools need manual stepsDemo DS-03-4, Q1Contractual roadmap commitment with service credit if not delivered in 9 months@procurement-lead
VES-RSK-002 (Example)V2Availability commitment 99.9% versus target 99.95%Q4Negotiate 99.95% for voice routing, or accept with credits@solution-architect
VES-RSK-003 (Example)V3Venture funded; implementation team turnoverSection 11, referenceEscrow of configuration exports; named key personnel clause@legal
VES-RSK-004 (Example)AllPrice increase at renewalCommercial reviewCap of [x]% per year in the contract@procurement-lead

15. Recommendation and debrief

ItemValue
Recommended bidderExample: V2, total 80.80
BasisExample: Highest combined score under the published 70 / 30 method; passed all knock-outs and due diligence
Conditions of awardExample: VES-RSK-001 and VES-RSK-002 resolved in contract; PoC results confirmed in acceptance tests
Reserve bidderExample: V3, total 78.05
Standstill or notice period[Example: 10 days, if the procurement rules require one]
Approval[Approved / Approved with conditions / Rejected], [@approver], YYYY-MM-DD
BidderDebrief dateStrengths notedWeaknesses notedDelivered by
V1 (Example)YYYY-MM-DDRouting, security controlsWorkforce management add-on, delivery plan detail@procurement-lead, @solution-architect
V3 (Example)YYYY-MM-DDFunctional fit, referencesIntegration events, price@procurement-lead, @solution-architect
V4 (Example)YYYY-MM-DDNot scoredFailed KO-1, with the evidence cited@procurement-lead

16. Glossary and references

16.1 Glossary

TermMeaning in this template
Knock-out criterionPass or fail condition; failing it excludes the bid before scoring
Weighted criterionScored criterion whose points depend on its weight and score
Consensus scoreSingle score per criterion and bidder agreed in moderation, with recorded rationale
ModerationMeeting where evaluators reconcile individual scores using the evidence
Normalised costBid price converted to a common volume, term and scope for comparison
Best and final offerFinal revised offer requested from shortlisted bidders, within published rules
DebriefExplanation to a bidder of how its bid was scored
Standstill periodPause between award notice and contract signature in some procurement regimes

16.2 References

ReferenceVersion or date checkedUse
ISO/IEC/IEEE 41062:2024, Software engineering, Life cycle processes, Software acquisition, iso.org and standards.ieee.orgEdition 2, published October 2024Supplier selection concerns (structure only)
ISO/IEC 25040:2024, Quality evaluation framework, iso.orgEdition 2, September 2024Planned, criteria-based evaluation (structure only)
ISO/IEC 25010:2023, Product quality model, iso.orgEdition 2, November 2023Vocabulary for Q4 non-functional qualities
NIST SP 800-161 Rev. 1, Cybersecurity Supply Chain Risk Management Practices for Systems and Organizations, csrc.nist.govMay 2022, updated 1 November 2024Supply chain due diligence topics in section 11
[RFP document and addenda][ID, version]Published criteria and weights
[Procurement policy or law that applies][Version]Process rules that take precedence

Standard and licence note

Structure aligned with the supplier selection concerns of ISO/IEC/IEEE 41062:2024 and the quality evaluation framework of ISO/IEC 25040:2024, which are copyrighted standards: only their numbers and titles are used and no clause text, tables or definitions are reproduced. Supply chain due diligence topics are based on NIST SP 800-161 Rev. 1 (public domain in the United States). The scoring scale, price formula, moderation rules and all other text are original and follow common procurement practice; figures in the worked example are illustrative. Check the current editions at iso.org and csrc.nist.gov and the procurement rules that apply to you. This is a documentation format, not legal advice. Template licence: MIT.

相关模板