Data Catalogue Metadata Standard Template (DCAT 3)
Minimum metadata set mapped to W3C DCAT 3, asset identifiers, catalogue roles and RACI, certification badges, completeness scoring, harvesting, review
Cara menggunakan: Use it when you set up or clean up a data catalogue and need every shared dataset to describe itself the same way. Fill the scope, the minimum metadata set and the badge criteria first. The main pitfall is making every field mandatory and manual, so publishers type filler text and the catalogue goes stale.
Pratinjau
Data Catalogue Metadata Standard: [Organisation name]
Standard for what every dataset, data service and data product must say about itself in the data catalogue: the minimum metadata set and who fills each field, the mapping to the W3C Data Catalog Vocabulary (DCAT) Version 3 (W3C Recommendation, 22 August 2024), catalogue roles, certification badges with entry and exit criteria, completeness scoring, harvesting and review. Replace every
[bracketed]value and every row marked Example. Worked examples use Corvid Commerce, a fictional SaaS retailer with a lakehouse, dbt transformations and domain-owned data products.
Document control
| Field | Value |
|---|---|
| Document ID | [STD-META-001] |
| Version | [0.1] |
| Status | [Draft / In review / Approved / Superseded] |
| Owner | [@head-of-data-governance] |
| Approvers/reviewers | [@governance-council-chair], [@platform-lead], [@data-protection-officer], [@domain-data-owners] |
| Scope | [Catalogues, data estates and asset types covered] |
| Catalogue tool | [Tool name and version, or "tool-neutral"] |
| Vocabulary baseline | W3C DCAT Version 3 (Recommendation, 2024-08-22) [plus profile, for example DCAT-AP 3.0.1] |
| Effective from | YYYY-MM-DD |
| Next scheduled review | YYYY-MM-DD |
| Last updated | YYYY-MM-DD |
| Classification | [Internal] |
Approvals
| Role | Name | Decision | Date |
|---|---|---|---|
| Governance council chair | [@name] | [Approve / Approve with conditions / Reject] | YYYY-MM-DD |
| Platform lead | [@name] | [Decision] | YYYY-MM-DD |
| Data protection officer | [@name] | [Decision] | YYYY-MM-DD |
Revision history
| Version | Date | Author | Change summary |
|---|---|---|---|
| 0.1 | YYYY-MM-DD | [@name] | First draft |
| 1.0 | YYYY-MM-DD | [@name] | Example: Approved; minimum set mandatory for all shared datasets |
| 1.1 | YYYY-MM-DD | [@name] | Example: Added the Gold badge and the checksum field for file distributions |
Contents
- 1. Purpose and scope
- 2. Principles
- 3. Asset types and identifiers
- 4. Minimum metadata set
- 5. Extended metadata by asset type
- 6. Catalogue roles and responsibilities
- 7. Certification badges
- 8. Completeness and quality scoring
- 9. Harvesting, publication and exchange
- 10. Lifecycle, review and deprecation
- 11. Compliance, exceptions and metrics
- 12. Glossary and references
- Standard and licence note
1. Purpose and scope
1.1 Purpose
[Two to four sentences on the outcome: consumers find the right data, understand it and know whether they can trust and use it.]
Example: Analysts at Corvid Commerce spend part of every request finding out which of three order tables is current and who can approve access. This standard makes every shared dataset findable by business name, states who owns it, what it contains, how fresh it is, whether it holds personal data and whether it is certified, so that a consumer can decide to use it without asking around.
1.2 Scope
| Item | In scope | Out of scope |
|---|---|---|
| Asset types | Example: Shared datasets, data products, data services (APIs), dashboards, metrics, ML feature sets | Example: Staging and intermediate dbt models, scratch schemas |
| Estates | Example: Lakehouse, warehouse, event streams on the shared Kafka cluster | Example: Operational databases not exposed for analytics |
| Organisation | Example: All domains of Corvid Commerce | Example: Acquired subsidiary until migration |
| [Item] | [In scope] | [Out of scope] |
An asset is shared when anyone outside the owning team reads it. Every shared asset must meet the minimum set in section 4. Private assets may be listed but are hidden from default search.
2. Principles
| ID | Principle | What it means in practice |
|---|---|---|
| PRN-001 | Harvest first, type second | Technical fields come from the platform; people write only what a machine cannot know (purpose, meaning, caveats) |
| PRN-002 | One record per asset | Each asset has one authoritative record with a stable identifier; copies in other tools link to it |
| PRN-003 | Owner on every record | No shared asset without a named accountable owner and steward |
| PRN-004 | Business words first | Titles and descriptions use the approved terms from the business glossary, not table names |
| PRN-005 | Badges mean checks | A certification badge is shown only while its automated checks pass |
| PRN-006 | Standard vocabulary for exchange | Records can be exported as DCAT 3 so that other catalogues and portals can read them |
3. Asset types and identifiers
| Asset type | DCAT 3 class | Identifier pattern | Example |
|---|---|---|---|
| Dataset | dcat:Dataset | urn:[org]:dataset:[domain]:[name] | Example: urn:corvid:dataset:sales:orders |
| Distribution (a form of a dataset: table, file, topic) | dcat:Distribution | [dataset id]:dist:[format] | Example: urn:corvid:dataset:sales:orders:dist:iceberg |
| Data service (API, query endpoint) | dcat:DataService | urn:[org]:service:[name] | Example: urn:corvid:service:orders-api |
| Dataset series (periodic releases) | dcat:DatasetSeries | urn:[org]:series:[name] | Example: urn:corvid:series:monthly-finance-close |
| Data product (governed bundle) | dcat:Dataset with product extension | urn:[org]:product:[domain]:[name] | Example: urn:corvid:product:sales:orders |
| Catalogue | dcat:Catalog | urn:[org]:catalog:[name] | Example: urn:corvid:catalog:enterprise |
| Catalogue record | dcat:CatalogRecord | Generated by the tool | Tracks who registered or changed the entry and when |
Rules:
- Identifiers are assigned once and never reused, even after the asset is retired.
- The physical location (database, schema, table, bucket path) is a property of the distribution, not part of the identifier.
- A data product record links to its datasets and services with
dcat:qualifiedRelationor the tool equivalent, so that consumers see the parts behind the product.
4. Minimum metadata set
Fields marked M are mandatory for every shared asset. R means recommended; it counts towards the completeness score in section 8.
| ID | Field | Meaning | DCAT 3 property | Source | M/R | Validation |
|---|---|---|---|---|---|---|
| META-001 | Title | Business name of the asset | dcterms:title | Owner | M | 3 to 80 characters, uses glossary terms, not a table name |
| META-002 | Description | What the data is, what one row means, main use | dcterms:description | Owner | M | At least 40 words; states the grain |
| META-003 | Identifier | Stable identifier from section 3 | dcterms:identifier | Tool | M | Matches pattern, unique |
| META-004 | Owner (accountable) | Person or role who answers for the asset | dcterms:publisher (organisation) plus tool owner field | Governance | M | Active person in the directory |
| META-005 | Steward | Person who maintains definitions and quality | Tool field | Owner | M | Active person; may equal owner in small domains |
| META-006 | Contact point | Team channel or mailbox for questions | dcat:contactPoint | Owner | M | Group address, not a personal one |
| META-007 | Domain | Owning business domain | dcat:theme (domain scheme) | Governance | M | Value from the domain register |
| META-008 | Keywords | Search terms people actually use | dcat:keyword | Owner | R | 3 to 10 terms |
| META-009 | Glossary terms | Approved business terms the asset implements | dcat:theme (glossary scheme) | Steward | R | Terms in Approved status in data/business-glossary |
| META-010 | Classification | Confidentiality level | Tool tag; dcterms:accessRights for exchange | Steward | M | Level from data/data-classification-policy |
| META-011 | Personal data flag | Whether the asset holds personal data and which categories | Tool tag | Steward | M | Yes or No; categories when Yes |
| META-012 | Access rights and request route | Who may use it and how to ask | dcterms:accessRights | Owner | M | Link to the access request form (data/data-access-request) |
| META-013 | Licence or terms of use | Internal terms or licence for external data | dcterms:license | Owner | M for external data, R otherwise | Licence URI or policy link |
| META-014 | Update frequency | How often new data arrives | dcterms:accrualPeriodicity | Harvested | M | Value from a frequency vocabulary |
| META-015 | Last modified | When the data last changed | dcterms:modified | Harvested | M | Timestamp from the platform |
| META-016 | Temporal coverage | Period the data covers | dcterms:temporal | Harvested or owner | R | Start and end dates |
| META-017 | Schema and conformance | Contract, schema or standard the data follows | dcterms:conformsTo | Harvested | M for products | Link to the data contract |
| META-018 | Version | Release or schema version | dcat:version | Harvested | R | Semantic version where a contract exists |
| META-019 | Distribution location | Where and in what format to read it | dcat:accessURL, dcat:mediaType, dcterms:format | Harvested | M | Resolvable location |
| META-020 | Lineage link | Upstream and downstream assets | Tool lineage view; dcat:qualifiedRelation for exchange | Harvested | R | Lineage present for certified assets (data/data-lineage-specification) |
| META-021 | Quality status | Result of the latest quality checks | Tool field | Harvested | M for certified | From data/data-quality-standard checks |
| META-022 | Retention rule | How long data is kept and how it is deleted | Tool field | Steward | M when personal data | Rule ID from data/data-retention-deletion-standard |
| META-023 | Certification badge | Badge level from section 7 | Tool field | Computed | M | Set only by the certification workflow |
| META-024 | Known caveats | Gaps, biases, late data, known errors | Tool field | Owner | R | Free text; dated |
Example: urn:corvid:dataset:sales:orders is a Silver dataset that holds personal data, uses no external data and is not itself a data product. For it, 16 fields are mandatory (META-001 to META-007, META-010 to META-012, META-014, META-015, META-019, META-021 to META-023) and 8 are recommended (META-008, META-009, META-013, META-016 to META-018, META-020, META-024). All 16 mandatory fields are filled; 6 of the 8 recommended fields are filled (licence and temporal coverage are empty), which gives the scores in section 8.
5. Extended metadata by asset type
| Asset type | Extra fields | DCAT 3 property where one exists | Why |
|---|---|---|---|
| File distribution | Byte size, checksum, download URL | dcat:byteSize, spdx:checksum, dcat:downloadURL | Integrity checks for consumers who copy files |
| Data service | Endpoint URL, endpoint description, datasets served | dcat:endpointURL, dcat:endpointDescription, dcat:servesDataset | Consumers find the API and its contract |
| Dataset series | Series members, first and last release | dcat:inSeries, dcat:first, dcat:last | Navigate periodic releases |
| Data product | Product owner, output ports, service levels, data contract | Product extension; dcterms:conformsTo for the contract | Consumers judge fitness before subscribing |
| Geospatial data | Spatial coverage and resolution | dcterms:spatial, dcat:spatialResolutionInMeters | Map and region filters |
| Time series | Temporal resolution | dcat:temporalResolution | Avoid mixing daily and hourly data |
| Dashboard or report | Metrics shown, refresh, audience | Tool fields | Link reports to certified metrics (data/metric-definition) |
| ML feature set | Feature definitions, training windows, point-in-time keys | Tool fields | Prevent training and serving skew |
6. Catalogue roles and responsibilities
| Role | Responsibilities | Typical holder |
|---|---|---|
| Catalogue owner | Owns this standard, the tool configuration and the metrics in section 11 | Head of data governance |
| Catalogue administrator | Runs harvesters, manages vocabularies and access to the tool | Platform team |
| Data owner | Accountable for the asset and its record; approves access and certification requests | Domain lead |
| Data steward | Maintains descriptions, glossary links, classification and caveats | Domain analyst or engineer |
| Publisher | Registers a new asset and fills the minimum set | Producing team |
| Certifier | Checks certification criteria and grants or removes badges | Governance team with a second domain reviewer |
| Consumer | Searches, rates, asks questions and reports problems | Anyone with catalogue access |
6.1 RACI for catalogue activities
| Activity | Catalogue owner | Administrator | Data owner | Steward | Publisher | Certifier |
|---|---|---|---|---|---|---|
| Register a new shared asset | I | C | A | C | R | I |
| Maintain descriptions and caveats | I | I | A | R | C | I |
| Configure harvesting | A | R | I | I | C | I |
| Grant a certification badge | C | I | C | C | I | A/R |
| Remove a badge after a failed check | I | R (automated) | I | I | I | A |
| Retire a record | I | R | A | C | C | I |
R: responsible, A: accountable, C: consulted, I: informed.
7. Certification badges
| Badge | Promise to the consumer | Entry criteria | Exit trigger |
|---|---|---|---|
| None | Listed, use at your own risk | Minimum mandatory fields complete | Not applicable |
| Bronze: Documented | You can understand it | All mandatory fields complete; description reviewed by the steward; owner confirmed in the last 6 months | Owner leaves without a successor, or a mandatory field becomes empty |
| Silver: Tested | You can rely on it for routine work | Bronze, plus a published data contract, automated quality checks with a pass rate of at least [95]% over the last 30 days, and dataset-level lineage | Pass rate below threshold for 7 consecutive days, or contract broken without a version change |
| Gold: Certified | You can use it for decisions and external reporting | Silver, plus service levels met for 3 consecutive months, column-level lineage for key fields, reconciliation against the system of record, and sign-off by the certifier and the data owner | Any service level breach left open beyond its deadline, a failed reconciliation, or the annual review not completed |
| Deprecated | Do not start new use | Owner decision with a replacement named | Removed when the record is retired |
Rules:
- Only the certification workflow sets a badge; owners cannot set it by editing the record.
- A downgrade is automatic when the exit trigger is detected and notifies the owner, the steward and the consumers who follow the asset.
- A badge is shown with its date and the evidence link (check results, sign-off ticket).
8. Completeness and quality scoring
Completeness of one record:
- Mandatory completeness = filled mandatory fields divided by mandatory fields that apply to the asset type.
- Recommended completeness = filled recommended fields divided by recommended fields that apply.
- Record score = 0.7 times mandatory completeness plus 0.3 times recommended completeness, shown as a percentage.
Example: For the Orders record in section 4 the mandatory completeness is 16 of 16 (100%) and the recommended completeness is 6 of 8 (75%), so the record score is 0.7 x 100 + 0.3 x 75 = 92.5%.
| Domain (Example) | Shared assets | Records with all mandatory fields | Mandatory compliance | Median record score |
|---|---|---|---|---|
| Sales | 48 | 45 | 93.8% | 91% |
| Marketing | 62 | 40 | 64.5% | 72% |
| Finance | 30 | 30 | 100.0% | 95% |
| Total | 140 | 115 | 82.1% | Not aggregated |
A field counts as filled only when it passes the validation rule in section 4. Placeholder text such as "n/a" or a copy of the title fails validation.
9. Harvesting, publication and exchange
| Source | Fields supplied | Method | Frequency | Owner |
|---|---|---|---|---|
| Lakehouse metastore (Example) | Distribution location, schema, last modified, row counts | Pull connector | Hourly | Platform team |
| dbt artifacts (Example) | Descriptions of models and columns, tests, lineage between models | Push on deploy | Every deployment | Analytics engineering |
| Lineage backend (Example) | Job and dataset lineage from run events | Pull | Every 15 minutes | Platform team |
| Data contract repository (Example) | Contract link, version, service levels | Push on merge | Every merge | Producing teams |
| Classification scanner (Example) | Suggested classification and personal data flag | Pull, steward confirms | Daily | Governance team |
| [Source] | [Fields] | [Method] | [Frequency] | [@owner] |
Rule of single writer: each field has exactly one writing source. When a person edits a harvested field, the edit is stored as an override with a reason and an expiry date.
9.1 Exchange format
Records are exported in DCAT 3 (RDF, serialised as JSON-LD or Turtle) so that a data portal or a partner catalogue can harvest them. Where the organisation publishes open data in the EU, follow the DCAT application profile used by the target portal (DCAT-AP 3.0.1 at the time of writing; check the current release at SEMIC).
{
"@context": {
"dcat": "http://www.w3.org/ns/dcat#",
"dcterms": "http://purl.org/dc/terms/"
},
"@id": "urn:corvid:dataset:sales:orders",
"@type": "dcat:Dataset",
"dcterms:title": "Orders",
"dcterms:description": "One row per customer order placed on any Corvid Commerce storefront, with status, totals and channel. Example record for this template.",
"dcat:keyword": ["orders", "sales", "checkout"],
"dcterms:accrualPeriodicity": {"@id": "http://purl.org/cld/freq/daily"},
"dcat:contactPoint": {"@id": "urn:corvid:team:sales-data"},
"dcat:distribution": {
"@type": "dcat:Distribution",
"dcat:accessURL": {"@id": "https://catalog.example.com/datasets/sales-orders"},
"dcterms:format": "Apache Iceberg table"
}
}
The example uses a reserved example.com host. For file distributions, state dcat:mediaType with a media type registered at IANA, and check the registration before relying on it in exports.
10. Lifecycle, review and deprecation
| Stage | Trigger | Required action | Who |
|---|---|---|---|
| Register | New shared asset | Minimum set filled before first consumer is granted access | Publisher |
| Review | Every 6 months for Bronze, every 3 months for Silver and Gold (Example) | Owner confirms ownership, steward checks description and caveats | Owner, steward |
| Change | Contract version change, new personal data, owner change | Record updated within 5 working days | Steward |
| Deprecate | Replacement available or no consumers for 90 days | Deprecated badge, replacement named, consumers notified | Owner |
| Retire | Deprecation period ended (default 90 days) | Record archived, identifier kept as retired, distribution removed under the retention rule | Administrator |
11. Compliance, exceptions and metrics
11.1 Metrics
| ID | Metric | Definition | Target (Example) |
|---|---|---|---|
| CATM-001 | Mandatory compliance | Shared assets with all mandatory fields valid, divided by shared assets | 95% |
| CATM-002 | Ownership coverage | Shared assets with an active owner and steward | 100% |
| CATM-003 | Certified usage share | Queries on Silver or Gold assets divided by all queries on shared assets | 70% |
| CATM-004 | Stale records | Records whose review is overdue | Below 5% |
| CATM-005 | Search success | Searches followed by opening a record within one minute | Trend up quarter on quarter |
11.2 Exceptions
| ID | Asset | Field or rule | Reason | Compensating control | Expiry | Approved by |
|---|---|---|---|---|---|---|
| EXC-001 (Example) | urn:corvid:dataset:marketing:campaign-spend | META-017 Schema and conformance | Vendor file has no stable schema | Weekly schema diff alert | YYYY-MM-DD | Governance council |
| [EXC-nnn] | [Asset] | [Field] | [Reason] | [Control] | YYYY-MM-DD | [@approver] |
Exceptions expire after at most 6 months and are listed in the council pack.
12. Glossary and references
12.1 Glossary
| Term | Meaning in this document |
|---|---|
| Asset | Anything recorded in the catalogue: dataset, distribution, data service, product, report |
| Catalogue record | The entry that describes an asset, with its own history |
| Certification badge | A label that states which checks an asset currently passes |
| Distribution | One accessible form of a dataset, such as a table, a file or a topic |
| Harvesting | Automatic collection of metadata from a source system |
| Metadata | Data that describes an asset so it can be found, understood and trusted |
| Steward | The person who keeps the meaning and quality of an asset's metadata current |
12.2 References
| Reference | Version or date checked | Use |
|---|---|---|
| W3C, Data Catalog Vocabulary (DCAT) Version 3, https://www.w3.org/TR/vocab-dcat-3/ | W3C Recommendation, 2024-08-22; checked 2026-10-30 | Class and property names in sections 3 to 5 and 9 |
| SEMIC, DCAT application profile for data portals in Europe (DCAT-AP), https://interoperable-europe.ec.europa.eu/collection/semic-support-centre/solution/dcat-application-profile-data-portals-europe/releases | 3.0.1, published 2025-10-27; checked 2026-10-30 | Profile named for EU open data exchange |
| [Catalogue tool documentation] | [Version] | [Field mapping] |
Standard and licence note
Based on the W3C Data Catalog Vocabulary (DCAT) Version 3, a W3C Recommendation of 22 August 2024, which is published under the W3C Document License; class and property names are used as identifiers and no specification text is reproduced. DCAT-AP is named only. The metadata set, badges, scoring formula, roles and examples are original, and Corvid Commerce is fictional. This template is original text written for this collection. Check the current official versions of DCAT and of any application profile before use. Template licence: MIT.
Templat terkait
Data Quality Standard Template (ISO/IEC 25012, ODCS)
Organisation DQ standard: ISO/IEC 25012 vocabulary, tiers, rule catalogue, severity, enforcement points, observability, scorecard, issues, waivers
Rekayasa & Tata Kelola DataData Retention and Deletion Standard Template (GDPR Art. 17, SP 800-88)
Retention rule method, deletion classes, standard periods, deletion per store (OLTP, Iceberg, Delta, search, logs, ML, backups), erasure propagation, evidence, sanitisation
Rekayasa & Tata Kelola Datadbt Project Standard Template (Analytics Engineering)
Layers and folder layout, naming, sources and freshness, tests, contracts, versions, groups and access, docs, macros, environments, slim CI, review checklist, cost guardrails