Markdown Editor

Data Catalogue Metadata Standard Template (DCAT 3)

Minimum metadata set mapped to W3C DCAT 3, asset identifiers, catalogue roles and RACI, certification badges, completeness scoring, harvesting, review

Ingeniería y gobierno de datosCompletaW3C DCAT Version 3 (Recommendation, 2024-08-22)catalogmetadatastandard

Cómo usar: Use it when you set up or clean up a data catalogue and need every shared dataset to describe itself the same way. Fill the scope, the minimum metadata set and the badge criteria first. The main pitfall is making every field mandatory and manual, so publishers type filler text and the catalogue goes stale.

Vista previa

Data Catalogue Metadata Standard: [Organisation name]

Standard for what every dataset, data service and data product must say about itself in the data catalogue: the minimum metadata set and who fills each field, the mapping to the W3C Data Catalog Vocabulary (DCAT) Version 3 (W3C Recommendation, 22 August 2024), catalogue roles, certification badges with entry and exit criteria, completeness scoring, harvesting and review. Replace every [bracketed] value and every row marked Example. Worked examples use Corvid Commerce, a fictional SaaS retailer with a lakehouse, dbt transformations and domain-owned data products.

Document control

FieldValue
Document ID[STD-META-001]
Version[0.1]
Status[Draft / In review / Approved / Superseded]
Owner[@head-of-data-governance]
Approvers/reviewers[@governance-council-chair], [@platform-lead], [@data-protection-officer], [@domain-data-owners]
Scope[Catalogues, data estates and asset types covered]
Catalogue tool[Tool name and version, or "tool-neutral"]
Vocabulary baselineW3C DCAT Version 3 (Recommendation, 2024-08-22) [plus profile, for example DCAT-AP 3.0.1]
Effective fromYYYY-MM-DD
Next scheduled reviewYYYY-MM-DD
Last updatedYYYY-MM-DD
Classification[Internal]

Approvals

RoleNameDecisionDate
Governance council chair[@name][Approve / Approve with conditions / Reject]YYYY-MM-DD
Platform lead[@name][Decision]YYYY-MM-DD
Data protection officer[@name][Decision]YYYY-MM-DD

Revision history

VersionDateAuthorChange summary
0.1YYYY-MM-DD[@name]First draft
1.0YYYY-MM-DD[@name]Example: Approved; minimum set mandatory for all shared datasets
1.1YYYY-MM-DD[@name]Example: Added the Gold badge and the checksum field for file distributions

Contents

1. Purpose and scope

1.1 Purpose

[Two to four sentences on the outcome: consumers find the right data, understand it and know whether they can trust and use it.]

Example: Analysts at Corvid Commerce spend part of every request finding out which of three order tables is current and who can approve access. This standard makes every shared dataset findable by business name, states who owns it, what it contains, how fresh it is, whether it holds personal data and whether it is certified, so that a consumer can decide to use it without asking around.

1.2 Scope

ItemIn scopeOut of scope
Asset typesExample: Shared datasets, data products, data services (APIs), dashboards, metrics, ML feature setsExample: Staging and intermediate dbt models, scratch schemas
EstatesExample: Lakehouse, warehouse, event streams on the shared Kafka clusterExample: Operational databases not exposed for analytics
OrganisationExample: All domains of Corvid CommerceExample: Acquired subsidiary until migration
[Item][In scope][Out of scope]

An asset is shared when anyone outside the owning team reads it. Every shared asset must meet the minimum set in section 4. Private assets may be listed but are hidden from default search.

2. Principles

IDPrincipleWhat it means in practice
PRN-001Harvest first, type secondTechnical fields come from the platform; people write only what a machine cannot know (purpose, meaning, caveats)
PRN-002One record per assetEach asset has one authoritative record with a stable identifier; copies in other tools link to it
PRN-003Owner on every recordNo shared asset without a named accountable owner and steward
PRN-004Business words firstTitles and descriptions use the approved terms from the business glossary, not table names
PRN-005Badges mean checksA certification badge is shown only while its automated checks pass
PRN-006Standard vocabulary for exchangeRecords can be exported as DCAT 3 so that other catalogues and portals can read them

3. Asset types and identifiers

Asset typeDCAT 3 classIdentifier patternExample
Datasetdcat:Dataseturn:[org]:dataset:[domain]:[name]Example: urn:corvid:dataset:sales:orders
Distribution (a form of a dataset: table, file, topic)dcat:Distribution[dataset id]:dist:[format]Example: urn:corvid:dataset:sales:orders:dist:iceberg
Data service (API, query endpoint)dcat:DataServiceurn:[org]:service:[name]Example: urn:corvid:service:orders-api
Dataset series (periodic releases)dcat:DatasetSeriesurn:[org]:series:[name]Example: urn:corvid:series:monthly-finance-close
Data product (governed bundle)dcat:Dataset with product extensionurn:[org]:product:[domain]:[name]Example: urn:corvid:product:sales:orders
Cataloguedcat:Catalogurn:[org]:catalog:[name]Example: urn:corvid:catalog:enterprise
Catalogue recorddcat:CatalogRecordGenerated by the toolTracks who registered or changed the entry and when

Rules:

  1. Identifiers are assigned once and never reused, even after the asset is retired.
  2. The physical location (database, schema, table, bucket path) is a property of the distribution, not part of the identifier.
  3. A data product record links to its datasets and services with dcat:qualifiedRelation or the tool equivalent, so that consumers see the parts behind the product.

4. Minimum metadata set

Fields marked M are mandatory for every shared asset. R means recommended; it counts towards the completeness score in section 8.

IDFieldMeaningDCAT 3 propertySourceM/RValidation
META-001TitleBusiness name of the assetdcterms:titleOwnerM3 to 80 characters, uses glossary terms, not a table name
META-002DescriptionWhat the data is, what one row means, main usedcterms:descriptionOwnerMAt least 40 words; states the grain
META-003IdentifierStable identifier from section 3dcterms:identifierToolMMatches pattern, unique
META-004Owner (accountable)Person or role who answers for the assetdcterms:publisher (organisation) plus tool owner fieldGovernanceMActive person in the directory
META-005StewardPerson who maintains definitions and qualityTool fieldOwnerMActive person; may equal owner in small domains
META-006Contact pointTeam channel or mailbox for questionsdcat:contactPointOwnerMGroup address, not a personal one
META-007DomainOwning business domaindcat:theme (domain scheme)GovernanceMValue from the domain register
META-008KeywordsSearch terms people actually usedcat:keywordOwnerR3 to 10 terms
META-009Glossary termsApproved business terms the asset implementsdcat:theme (glossary scheme)StewardRTerms in Approved status in data/business-glossary
META-010ClassificationConfidentiality levelTool tag; dcterms:accessRights for exchangeStewardMLevel from data/data-classification-policy
META-011Personal data flagWhether the asset holds personal data and which categoriesTool tagStewardMYes or No; categories when Yes
META-012Access rights and request routeWho may use it and how to askdcterms:accessRightsOwnerMLink to the access request form (data/data-access-request)
META-013Licence or terms of useInternal terms or licence for external datadcterms:licenseOwnerM for external data, R otherwiseLicence URI or policy link
META-014Update frequencyHow often new data arrivesdcterms:accrualPeriodicityHarvestedMValue from a frequency vocabulary
META-015Last modifiedWhen the data last changeddcterms:modifiedHarvestedMTimestamp from the platform
META-016Temporal coveragePeriod the data coversdcterms:temporalHarvested or ownerRStart and end dates
META-017Schema and conformanceContract, schema or standard the data followsdcterms:conformsToHarvestedM for productsLink to the data contract
META-018VersionRelease or schema versiondcat:versionHarvestedRSemantic version where a contract exists
META-019Distribution locationWhere and in what format to read itdcat:accessURL, dcat:mediaType, dcterms:formatHarvestedMResolvable location
META-020Lineage linkUpstream and downstream assetsTool lineage view; dcat:qualifiedRelation for exchangeHarvestedRLineage present for certified assets (data/data-lineage-specification)
META-021Quality statusResult of the latest quality checksTool fieldHarvestedM for certifiedFrom data/data-quality-standard checks
META-022Retention ruleHow long data is kept and how it is deletedTool fieldStewardM when personal dataRule ID from data/data-retention-deletion-standard
META-023Certification badgeBadge level from section 7Tool fieldComputedMSet only by the certification workflow
META-024Known caveatsGaps, biases, late data, known errorsTool fieldOwnerRFree text; dated

Example: urn:corvid:dataset:sales:orders is a Silver dataset that holds personal data, uses no external data and is not itself a data product. For it, 16 fields are mandatory (META-001 to META-007, META-010 to META-012, META-014, META-015, META-019, META-021 to META-023) and 8 are recommended (META-008, META-009, META-013, META-016 to META-018, META-020, META-024). All 16 mandatory fields are filled; 6 of the 8 recommended fields are filled (licence and temporal coverage are empty), which gives the scores in section 8.

5. Extended metadata by asset type

Asset typeExtra fieldsDCAT 3 property where one existsWhy
File distributionByte size, checksum, download URLdcat:byteSize, spdx:checksum, dcat:downloadURLIntegrity checks for consumers who copy files
Data serviceEndpoint URL, endpoint description, datasets serveddcat:endpointURL, dcat:endpointDescription, dcat:servesDatasetConsumers find the API and its contract
Dataset seriesSeries members, first and last releasedcat:inSeries, dcat:first, dcat:lastNavigate periodic releases
Data productProduct owner, output ports, service levels, data contractProduct extension; dcterms:conformsTo for the contractConsumers judge fitness before subscribing
Geospatial dataSpatial coverage and resolutiondcterms:spatial, dcat:spatialResolutionInMetersMap and region filters
Time seriesTemporal resolutiondcat:temporalResolutionAvoid mixing daily and hourly data
Dashboard or reportMetrics shown, refresh, audienceTool fieldsLink reports to certified metrics (data/metric-definition)
ML feature setFeature definitions, training windows, point-in-time keysTool fieldsPrevent training and serving skew

6. Catalogue roles and responsibilities

RoleResponsibilitiesTypical holder
Catalogue ownerOwns this standard, the tool configuration and the metrics in section 11Head of data governance
Catalogue administratorRuns harvesters, manages vocabularies and access to the toolPlatform team
Data ownerAccountable for the asset and its record; approves access and certification requestsDomain lead
Data stewardMaintains descriptions, glossary links, classification and caveatsDomain analyst or engineer
PublisherRegisters a new asset and fills the minimum setProducing team
CertifierChecks certification criteria and grants or removes badgesGovernance team with a second domain reviewer
ConsumerSearches, rates, asks questions and reports problemsAnyone with catalogue access

6.1 RACI for catalogue activities

ActivityCatalogue ownerAdministratorData ownerStewardPublisherCertifier
Register a new shared assetICACRI
Maintain descriptions and caveatsIIARCI
Configure harvestingARIICI
Grant a certification badgeCICCIA/R
Remove a badge after a failed checkIR (automated)IIIA
Retire a recordIRACCI

R: responsible, A: accountable, C: consulted, I: informed.

7. Certification badges

BadgePromise to the consumerEntry criteriaExit trigger
NoneListed, use at your own riskMinimum mandatory fields completeNot applicable
Bronze: DocumentedYou can understand itAll mandatory fields complete; description reviewed by the steward; owner confirmed in the last 6 monthsOwner leaves without a successor, or a mandatory field becomes empty
Silver: TestedYou can rely on it for routine workBronze, plus a published data contract, automated quality checks with a pass rate of at least [95]% over the last 30 days, and dataset-level lineagePass rate below threshold for 7 consecutive days, or contract broken without a version change
Gold: CertifiedYou can use it for decisions and external reportingSilver, plus service levels met for 3 consecutive months, column-level lineage for key fields, reconciliation against the system of record, and sign-off by the certifier and the data ownerAny service level breach left open beyond its deadline, a failed reconciliation, or the annual review not completed
DeprecatedDo not start new useOwner decision with a replacement namedRemoved when the record is retired

Rules:

  1. Only the certification workflow sets a badge; owners cannot set it by editing the record.
  2. A downgrade is automatic when the exit trigger is detected and notifies the owner, the steward and the consumers who follow the asset.
  3. A badge is shown with its date and the evidence link (check results, sign-off ticket).

8. Completeness and quality scoring

Completeness of one record:

  • Mandatory completeness = filled mandatory fields divided by mandatory fields that apply to the asset type.
  • Recommended completeness = filled recommended fields divided by recommended fields that apply.
  • Record score = 0.7 times mandatory completeness plus 0.3 times recommended completeness, shown as a percentage.

Example: For the Orders record in section 4 the mandatory completeness is 16 of 16 (100%) and the recommended completeness is 6 of 8 (75%), so the record score is 0.7 x 100 + 0.3 x 75 = 92.5%.

Domain (Example)Shared assetsRecords with all mandatory fieldsMandatory complianceMedian record score
Sales484593.8%91%
Marketing624064.5%72%
Finance3030100.0%95%
Total14011582.1%Not aggregated

A field counts as filled only when it passes the validation rule in section 4. Placeholder text such as "n/a" or a copy of the title fails validation.

9. Harvesting, publication and exchange

SourceFields suppliedMethodFrequencyOwner
Lakehouse metastore (Example)Distribution location, schema, last modified, row countsPull connectorHourlyPlatform team
dbt artifacts (Example)Descriptions of models and columns, tests, lineage between modelsPush on deployEvery deploymentAnalytics engineering
Lineage backend (Example)Job and dataset lineage from run eventsPullEvery 15 minutesPlatform team
Data contract repository (Example)Contract link, version, service levelsPush on mergeEvery mergeProducing teams
Classification scanner (Example)Suggested classification and personal data flagPull, steward confirmsDailyGovernance team
[Source][Fields][Method][Frequency][@owner]

Rule of single writer: each field has exactly one writing source. When a person edits a harvested field, the edit is stored as an override with a reason and an expiry date.

9.1 Exchange format

Records are exported in DCAT 3 (RDF, serialised as JSON-LD or Turtle) so that a data portal or a partner catalogue can harvest them. Where the organisation publishes open data in the EU, follow the DCAT application profile used by the target portal (DCAT-AP 3.0.1 at the time of writing; check the current release at SEMIC).

{
  "@context": {
    "dcat": "http://www.w3.org/ns/dcat#",
    "dcterms": "http://purl.org/dc/terms/"
  },
  "@id": "urn:corvid:dataset:sales:orders",
  "@type": "dcat:Dataset",
  "dcterms:title": "Orders",
  "dcterms:description": "One row per customer order placed on any Corvid Commerce storefront, with status, totals and channel. Example record for this template.",
  "dcat:keyword": ["orders", "sales", "checkout"],
  "dcterms:accrualPeriodicity": {"@id": "http://purl.org/cld/freq/daily"},
  "dcat:contactPoint": {"@id": "urn:corvid:team:sales-data"},
  "dcat:distribution": {
    "@type": "dcat:Distribution",
    "dcat:accessURL": {"@id": "https://catalog.example.com/datasets/sales-orders"},
    "dcterms:format": "Apache Iceberg table"
  }
}

The example uses a reserved example.com host. For file distributions, state dcat:mediaType with a media type registered at IANA, and check the registration before relying on it in exports.

10. Lifecycle, review and deprecation

StageTriggerRequired actionWho
RegisterNew shared assetMinimum set filled before first consumer is granted accessPublisher
ReviewEvery 6 months for Bronze, every 3 months for Silver and Gold (Example)Owner confirms ownership, steward checks description and caveatsOwner, steward
ChangeContract version change, new personal data, owner changeRecord updated within 5 working daysSteward
DeprecateReplacement available or no consumers for 90 daysDeprecated badge, replacement named, consumers notifiedOwner
RetireDeprecation period ended (default 90 days)Record archived, identifier kept as retired, distribution removed under the retention ruleAdministrator

11. Compliance, exceptions and metrics

11.1 Metrics

IDMetricDefinitionTarget (Example)
CATM-001Mandatory complianceShared assets with all mandatory fields valid, divided by shared assets95%
CATM-002Ownership coverageShared assets with an active owner and steward100%
CATM-003Certified usage shareQueries on Silver or Gold assets divided by all queries on shared assets70%
CATM-004Stale recordsRecords whose review is overdueBelow 5%
CATM-005Search successSearches followed by opening a record within one minuteTrend up quarter on quarter

11.2 Exceptions

IDAssetField or ruleReasonCompensating controlExpiryApproved by
EXC-001 (Example)urn:corvid:dataset:marketing:campaign-spendMETA-017 Schema and conformanceVendor file has no stable schemaWeekly schema diff alertYYYY-MM-DDGovernance council
[EXC-nnn][Asset][Field][Reason][Control]YYYY-MM-DD[@approver]

Exceptions expire after at most 6 months and are listed in the council pack.

12. Glossary and references

12.1 Glossary

TermMeaning in this document
AssetAnything recorded in the catalogue: dataset, distribution, data service, product, report
Catalogue recordThe entry that describes an asset, with its own history
Certification badgeA label that states which checks an asset currently passes
DistributionOne accessible form of a dataset, such as a table, a file or a topic
HarvestingAutomatic collection of metadata from a source system
MetadataData that describes an asset so it can be found, understood and trusted
StewardThe person who keeps the meaning and quality of an asset's metadata current

12.2 References

ReferenceVersion or date checkedUse
W3C, Data Catalog Vocabulary (DCAT) Version 3, https://www.w3.org/TR/vocab-dcat-3/W3C Recommendation, 2024-08-22; checked 2026-10-30Class and property names in sections 3 to 5 and 9
SEMIC, DCAT application profile for data portals in Europe (DCAT-AP), https://interoperable-europe.ec.europa.eu/collection/semic-support-centre/solution/dcat-application-profile-data-portals-europe/releases3.0.1, published 2025-10-27; checked 2026-10-30Profile named for EU open data exchange
[Catalogue tool documentation][Version][Field mapping]

Standard and licence note

Based on the W3C Data Catalog Vocabulary (DCAT) Version 3, a W3C Recommendation of 22 August 2024, which is published under the W3C Document License; class and property names are used as identifiers and no specification text is reproduced. DCAT-AP is named only. The metadata set, badges, scoring formula, roles and examples are original, and Corvid Commerce is fictional. This template is original text written for this collection. Check the current official versions of DCAT and of any application profile before use. Template licence: MIT.

Plantillas relacionadas