Skip to Content
Last modified by Helena K. on 2026/06/08 15:16
From version 36.29
edited by Helena K.
on 2026/06/08 13:32
Change comment: There is no comment for this version
To version 35.2
edited by Helena K.
on 2026/06/08 12:06
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -10,61 +10,61 @@
10 10  
11 11  = 1 Introduction =
12 12  
13 -The [[Statistical Data and Metadata Exchange>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] ([[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]) initiative ([[https:~~/~~/www.sdmx.org>>https://https:www.sdmx.org||rel="noopener noreferrer" target="_blank"]]) sets standards that can facilitate the exchange of statistical data and metadata using modern information technology.
13 +The Statistical Data and Metadata Exchange (SDMX) initiative ([[https:~~/~~/www.sdmx.org>>https://https:www.sdmx.org||rel="noopener noreferrer" target="_blank"]]) sets standards that can facilitate the exchange of statistical data and metadata using modern information technology.
14 14  
15 -The [[SDMX Technical Specifications>>doc:sdmx:Glossary 2\.1.SDMX Technical Specification.WebHome]] are organised into several discrete sections.
15 +The SDMX Technical Specifications are organised into several discrete sections.
16 16  
17 -The following are published on the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] website ([[__https:~~/~~/www.sdmx.org__>>https://https:www.sdmx.org||rel="noopener noreferrer" target="_blank"]]):
17 +The following are published on the SDMX website ([[__https:~~/~~/www.sdmx.org__>>https://https:www.sdmx.org||rel="noopener noreferrer" target="_blank"]]):
18 18  
19 -**Section 1** **Framework for [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Standards** – this document providing an introduction to the technical standards.
19 +**Section 1** **Framework for SDMX Technical Standards** – this document providing an introduction to the technical standards.
20 20  
21 -**Section 2** **SDMX Information Model** - the [[SDMX information model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]] is a standardised object model for modelling [[statistical domains>>doc:sdmx:Glossary 2\.1.Statistical subject-matter domain.WebHome]] centring on the structure of their data and [[metadata sets>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]], the coding schemes used for [[classification>>doc:sdmx:Glossary 2\.1.Statistical Classification.WebHome]], and the rules for controlling the exchange of data and metadata between organisations. This document provides a UML specification with supporting narrative.
21 +**Section 2** **SDMX Information Model** - the SDMX information model is a standardised object model for modelling statistical domains centring on the structure of their data and metadata sets, the coding schemes used for classification, and the rules for controlling the exchange of data and metadata between organisations. This document provides a UML specification with supporting narrative.
22 22  
23 -**Section 5** **SDMX Registry Specification** – an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] ‘registry’ acts as a repository for [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] and provisioning information, and a registry of data and metadata sources. This document sets out the specification.
23 +**Section 5** **SDMX Registry Specification** – an SDMX ‘registry’ acts as a repository for structural metadata and provisioning information, and a registry of data and metadata sources. This document sets out the specification.
24 24  
25 -**Section 6** **SDMX Technical Notes** – detailed technical guidance for implementors of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] standard.
25 +**Section 6** **SDMX Technical Notes** – detailed technical guidance for implementors of the SDMX standard.
26 26  
27 -The following are published on the GitHub repository of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Standards Technical Working Group ([[__https:~~/~~/github.com/sdmx-twg__>>https://https:github.comsdmx-twg||rel="noopener noreferrer" target="_blank"]]): sdmx-twg/sdmx-rest – REST API
27 +The following are published on the GitHub repository of the SDMX Standards Technical Working Group ([[__https:~~/~~/github.com/sdmx-twg__>>https://https:github.comsdmx-twg||rel="noopener noreferrer" target="_blank"]]): sdmx-twg/sdmx-rest – REST API
28 28  
29 -Technical specifications for the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] RESTful web services application programming interfaces (API).
29 +Technical specifications for the SDMX RESTful web services application programming interfaces (API).
30 30  
31 31  (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-ml2013SDMX-ML" %)
32 32  **sdmx-twg/sdmx-ml – SDMX-ML**
33 -Technical specifications for the XML transmission format including XSD schemas, documentation and samples for data, structure and [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] messages.
33 +Technical specifications for the XML transmission format including XSD schemas, documentation and samples for data, structure and reference metadata messages.
34 34  
35 35  (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-json2013SDMX-JSON" %)
36 36  **sdmx-twg/sdmx-json – SDMX-JSON**
37 -Technical specifications for the JSON transmission format including documentation, schemas and samples for data, structure and [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] messages.
37 +Technical specifications for the JSON transmission format including documentation, schemas and samples for data, structure and reference metadata messages.
38 38  
39 39  (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-csv2013SDMX-CSV" %)
40 40  **sdmx-twg/sdmx-csv – SDMX-CSV**
41 -Technical specifications for the [[SDMX-CSV>>doc:sdmx:Glossary 2\.1.SDMX-CSV.WebHome]] transmission format for ‘comma-separated values’ (CSV) data and [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]].
41 +Technical specifications for the SDMX-CSV transmission format for ‘comma-separated values’ (CSV) data and reference metadata.
42 42  
43 43  The following sections are obsolete:
44 44  
45 -Section 3 - [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] - replaced by the sdmx-twg/sdmx-ml GitHub repository
45 +Section 3 - SDMX-ML - replaced by the sdmx-twg/sdmx-ml GitHub repository
46 46  
47 -Section 4 - [[SDMX-EDI>>doc:sdmx:Glossary 2\.1.SDMX-EDI.WebHome]]
47 +Section 4 - SDMX-EDI
48 48  
49 -Section 7 - API - replaced by the sdmx-twg/sdmx-rest GitHub repository [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]]
49 +Section 7 - API - replaced by the sdmx-twg/sdmx-rest GitHub repository VTL
50 50  
51 -In July 2020 the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 2.1 specifications were revised to add support for the [[Validation and Transformation Language>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] ([[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]]). For 3.0, the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] specification has been updated to align with changes to the information model and other modifications to the Standard such as the introduction of Semantic Versioning for the versioning of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] [[artefacts>>doc:sdmx:Glossary 2\.1.Artefact.WebHome]]. Section 2 (Information Model) sets out details of the ‘Transformation and Expressions’ package for defining and managing [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 2.0 programs and Section 6 (Technical Notes) provides detailed guidance on implementing and using [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] with [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]].
51 +In July 2020 the SDMX 2.1 specifications were revised to add support for the Validation and Transformation Language (VTL). For 3.0, the VTL specification has been updated to align with changes to the information model and other modifications to the Standard such as the introduction of Semantic Versioning for the versioning of structural metadata artefacts. Section 2 (Information Model) sets out details of the ‘Transformation and Expressions’ package for defining and managing VTL 2.0 programs and Section 6 (Technical Notes) provides detailed guidance on implementing and using VTL with SDMX.
52 52  
53 53  = 2 Change History =
54 54  
55 55  The 2.0 version of this standard represented a significant increase in scope, and also provided more complete support in those areas covered in the version 1.0 specification. Version 2.0 of this standard is backward-compatible with version 1.0, so that existing implementations can be easily migrated to conformance with version 2.0.
56 56  
57 -The 2.1 version of this standard represents a set of changes resulting from several years of implementation experience with the 2.0 standard. The changes do not represent a major increase in scope or functionality, but do correct some bugs, and add functionalities in some cases. Major changes in [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] include a much stronger alignment of the XML Schemas with the Information Model, to emphasize inheritance and object-oriented features, and increased precision and flexibility in the attachment of metadata reports to specific objects in the [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]].
57 +The 2.1 version of this standard represents a set of changes resulting from several years of implementation experience with the 2.0 standard. The changes do not represent a major increase in scope or functionality, but do correct some bugs, and add functionalities in some cases. Major changes in SDMX-ML include a much stronger alignment of the XML Schemas with the Information Model, to emphasize inheritance and object-oriented features, and increased precision and flexibility in the attachment of metadata reports to specific objects in the SDMX Information Model.
58 58  
59 -The 3.0 version incorporates new features, improvements and changes arising from the collective knowledge gained from a decade of operating experience with the 2.1 standard. In pursuit of modernisation and simplification, features considered obsolete have been deprecated – in particular the EDI transmission format, the lesser-used XML data messages and the SOAP web services API. Many areas remain backwardly compatible with 2.1, but there are some breaking changes where the information model has been redesigned to better support practical use case. Structure mapping and [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] are examples. The opportunity has been taken to revise the RESTful web services API which is also not backwardly compatible, but benefits from a rationalisation and better organisations of resources, and a much richer data query URL syntax.
59 +The 3.0 version incorporates new features, improvements and changes arising from the collective knowledge gained from a decade of operating experience with the 2.1 standard. In pursuit of modernisation and simplification, features considered obsolete have been deprecated – in particular the EDI transmission format, the lesser-used XML data messages and the SOAP web services API. Many areas remain backwardly compatible with 2.1, but there are some breaking changes where the information model has been redesigned to better support practical use case. Structure mapping and reference metadata are examples. The opportunity has been taken to revise the RESTful web services API which is also not backwardly compatible, but benefits from a rationalisation and better organisations of resources, and a much richer data query URL syntax.
60 60  
61 61  The 3.1 version provides supports for data models to increase dimensionality over time without impacting existing data collections. The Data Constraint model was adjusted to separate concerns of data reporting and data dissemination.
62 62  
63 63  == 2.1 Major Changes from 1.0 to 2.0 ==
64 64  
65 -* **[[Reference Metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]]**: In addition to describing and specifying data structures and formats (along with related [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]), the version 2.0 specification also provides for the exchange of metadata which is distinct from the [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] in the 1.0 version. This [[category>>doc:sdmx:Glossary 2\.1.Category.WebHome]] includes “reference” metadata (regarding data quality, methodology, and similar types – it can be configured by the user to include whatever concepts require reporting); metadata related to data provisioning ([[release calendar>>doc:sdmx:Glossary 2\.1.Release policy - release calendar.WebHome]] information, description of the data and metadata provided, etc.); and metadata relevant to the exchange of categorization schemes.
66 -* **[[SDMX Registry>>doc:sdmx:Glossary 2\.1.SDMX Registry.WebHome]]**: Provision is made in the 2.0 standard for standard communication with registry services, to support a data-sharing model of statistical exchange. These services include registration of data and metadata, querying of registered data and metadata, and [[subscription>>doc:sdmx:Glossary 2\.1.Subscription.WebHome]]/[[notification>>doc:sdmx:Glossary 2\.1.Notification.WebHome]].
67 -** **[[Structural Metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]**: The support for exchange of statistical data and related [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] has been expanded. Some support is provided for qualitative data; data cube structures are described; [[hierarchical code lists>>doc:sdmx:Glossary 2\.1.Hierarchical code list.WebHome]] are supported; relationships between data structures can be expressed, providing support for extensibility of data structures; and the description of functional dependencies within cubes are supported.
65 +* **Reference Metadata**: In addition to describing and specifying data structures and formats (along with related structural metadata), the version 2.0 specification also provides for the exchange of metadata which is distinct from the structural metadata in the 1.0 version. This category includes “reference” metadata (regarding data quality, methodology, and similar types – it can be configured by the user to include whatever concepts require reporting); metadata related to data provisioning (release calendar information, description of the data and metadata provided, etc.); and metadata relevant to the exchange of categorization schemes.
66 +* **SDMX Registry**: Provision is made in the 2.0 standard for standard communication with registry services, to support a data-sharing model of statistical exchange. These services include registration of data and metadata, querying of registered data and metadata, and subscription/notification.
67 +* **Structural Metadata**: The support for exchange of statistical data and related structural metadata has been expanded. Some support is provided for qualitative data; data cube structures are described; hierarchical code lists are supported; relationships between data structures can be expressed, providing support for extensibility of data structures; and the description of functional dependencies within cubes are supported.
68 68  
69 69  == 2.2 Major Changes from 2.0 to 2.1 ==
70 70  
... ... @@ -75,7 +75,7 @@
75 75  * **Optimization for XML Technologies:** Implementation has shown that it is possible to better organize the XML schemas for use within common technology development tools which work with XML. These changes are primarily focused on leveraging the objectoriented features of W3C XML Schema to allow for easier processing of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] data and metadata.
76 76  * **Consistency between the [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] and the [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]]: **Certain aspects of the XML schemas and UML model have been more closely aligned, to allow for easier comprehension of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] model.
77 77  * **Technical Bugs:** Some minor technical bugs have been identified in the registry interfaces and elsewhere. These bugs have been addressed.
78 -* **Support for Non-Time-Series Data in the Generic Format: **One area which has been extended is the ability to express non-time-[[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] data as part of the generic data message.
78 +* **Support for Non-Time-[[Series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] Data in the Generic Format: **One area which has been extended is the ability to express non-time-[[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] data as part of the generic data message.
79 79  * **Simplification of the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] - specific message types: **Both [[time series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] (version 2.0 Compact) and non-[[time series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] (version 2.0 Cross Sectional) use the same underlying structure for a structure-specific formatted message, which is specific to the [[Data Structure Definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] of the [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]].
80 80  * **Simplification and better support for the metadata structure: **New use cases have been reported and these are now supported by a re-modelled [[metadata structure definition>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]].
81 81  * **Support for partial [[item schemes>>doc:sdmx:Glossary 2\.1.Item scheme.WebHome]] such as a [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]]: **The concept of a partial (subset) [[item scheme>>doc:sdmx:Glossary 2\.1.Item scheme.WebHome]] such as a partial [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]] for use in exchange scenarios has been introduced**.**
... ... @@ -137,11 +137,11 @@
137 137  (% class="wikigeneratedid" id="HInformationModel-1" %)
138 138  **Information Model**
139 139  
140 -* Addition of Dimension Constraint property to a Dataflow
141 -* Addition of evolving structure property to a Data Structure Definition
142 -* Remove [[version>>doc:sdmx:Glossary 2\.1.Version.WebHome]] property on Categorisation
140 +* Addition of Dimension Constraint property to a [[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]
141 +* Addition of evolving structure property to a [[Data Structure Definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]
142 +* Remove [[version>>doc:sdmx:Glossary 2\.1.Version.WebHome]] property on [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]]
143 143  * Simplification of Constraints
144 -** Removal of Advanced Release Calendar
144 +** Removal of Advanced [[Release Calendar>>doc:sdmx:Glossary 2\.1.Release policy - release calendar.WebHome]]
145 145  ** Removal of Role, Data Constraints only restrict data that can be reported
146 146  ** Restrict [[constraint>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] targets to Identifiable structures (not URLs)
147 147  ** Addition of Availability Constraint to define actual data
... ... @@ -159,7 +159,7 @@
159 159  
160 160  [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] identifies three basic process patterns regarding the exchange of statistical data and metadata. These can be described as follows:
161 161  
162 -1. //**Bilateral exchange**~:// All aspects of the exchange process are agreed between counterparties, including the mechanism for exchange of data and metadata, the formats, the frequency or schedule, and the mode used for communications regarding the exchange. This is perhaps the most common process pattern.
162 +1. //**[[Bilateral exchange>>doc:sdmx:Glossary 2\.1.Bilateral exchange.WebHome]]**~:// All aspects of the exchange process are agreed between counterparties, including the mechanism for exchange of data and metadata, the formats, the frequency or schedule, and the mode used for communications regarding the exchange. This is perhaps the most common process pattern.
163 163  1. //**Gateway exchange**~:// Gateway exchanges are an organized set of [[bilateral exchanges>>doc:sdmx:Glossary 2\.1.Bilateral exchange.WebHome]], in which several data and metadata collecting organizations or individuals agree to exchange the collected information with each other in a single, known format, and according to a single, known process. This pattern has the effect of reducing the burden of managing multiple [[bilateral exchanges>>doc:sdmx:Glossary 2\.1.Bilateral exchange.WebHome]] (in data and metadata collection) across the sharing organizations/individuals. This is also a very common process pattern in the statistical area, where communities of institutions agree on ways to gain efficiencies within the scope of their collective responsibilities.
164 164  1. //**Data-sharing exchange**~:// Open, freely available data formats and process patterns are known and standard. Thus, any organization or individual can use any counterparty’s data and metadata (assuming they are permitted access to it). This model requires no bilateral agreement, but only requires that data and metadata providers and consumers adhere to the standards.
165 165  
... ... @@ -237,7 +237,7 @@
237 237  * //**[[Concept Scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]:**// A [[concept scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] is a maintained list of [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] that are used in [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and [[metadata structure definitions>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]. There can be many such [[concept schemes>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]. A “core” [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] of the [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] can be specified (e.g. a core [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]], or other [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] such as “date”). Note that this core [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] can be overridden in the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] or [[metadata structure definition>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]] that uses the [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]]. Indeed, organisations wishing to remain with version 1.0 key family schema specifications will continue to declare the [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] in the key family definition.
238 238  * //**[[Metadata Set>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]]:**// A [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] set is a set of information pertaining to an object within the formal [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] view of statistical exchange: they may describe the maintainers of data or structural definitions; they may describe the schedule on which data is released; they may describe the flow of a single type of data over time; they may describe the quality of data, etc. In [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]], the creators of [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] may take whatever [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] they are concerned with, or obliged to report, and provide a [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] set containing that information.
239 239  * //**[[Metadata Structure Definition>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]:**// A [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] set also has a set of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] which describes how it is organized. This [[metadata set>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]] identifies what [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] are being reported, how these [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] relate to each other (typically as [[hierarchies>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]]), what their presentational structure is, how they may be represented (as free text, as coded values, etc.), and with which formal [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] object types they are associated.
240 -* //**[[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] Definition:**// In [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]], [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] are reported or disseminated according to a [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition. The [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition identifies the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and may be associated with one or more subject matter domains via a [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]] (this facilitates the search for data according to organised [[category schemes>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]]). [[Constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]], in terms of reporting [[periodicity>>doc:sdmx:Glossary 2\.1.Frequency of observation.WebHome]] or sub set of possible keys that are allowed in a [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]], may be attached to the [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition.
240 +* //**[[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] Definition:**// In [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]], [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] are reported or disseminated according to a [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition. The [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition identifies the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and may be associated with one or more subject matter domains via a [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]] (this facilitates the search for data according to organised [[category schemes>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]]). [[Constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]], in terms of reporting [[periodicity>>doc:Glossary 2\.1.Frequency of observation.WebHome]] or sub set of possible keys that are allowed in a [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]], may be attached to the [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition.
241 241  * //**[[Metadataflow>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]] Definition:**// A [[metadata flow>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]] definition is very similar to a [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition, but describes, categorises, and constrains [[metadata sets>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]].
242 242  * //**[[Data Provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]]: **//An organization which produces data is termed a [[data provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]].
243 243  * //**Metadata Provider: **//An organization which produces [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] is termed a metadata provider.
... ... @@ -374,23 +374,23 @@
374 374  
375 375  The Metadata Common Vocabulary is an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] guideline which provides definition of terms to be used for the comparison and mapping of terminology found in [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and in other aspects of statistical metadata management. Essentially, it provides ISOcompliant definitions for a wide range of statistical terms, which may be used directly, or against which other terminology systems may be mapped. This set of terms is inclusive of the terminology used within the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Standards.
376 376  
377 -The MCV provides definitions for terms on which the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Cross-Domain Metadata (% style="color:#e74c3c" %)Concepts(%%) work is built.
377 +The MCV provides definitions for terms on which the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Cross-Domain Metadata [[Concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] work is built.
378 378  
379 379  == 6.3 Statistical Subject-Matter Domains ==
380 380  
381 -The [[Statistical Subject-Matter Domains>>doc:sdmx:Glossary 2\.1.Statistical subject-matter domain.WebHome]] is a listing of the breadth of statistical information for the purposes of organizing widespread statistical exchange and categorization. It acts as a standard scheme against which the categorization schemes of various counterparties can be (% style="color:#e74c3c" %)mapped(%%), to facilitate interoperable data and metadata exchange. It serves another useful purpose, however, which is to allow an organization of corresponding “domain groups”, each of which could define standard [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]], (% style="color:#e74c3c" %)concepts(%%), etc. within their domains. Such groups already exist within the international community. [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] would use the [[Statistical Subject-Matter Domains>>doc:sdmx:Glossary 2\.1.Statistical subject-matter domain.WebHome]] list to facilitate the efforts of these groups to develop the kinds of content standards which could support the interoperation of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]-conformant technical systems within and across [[statistical domains>>doc:sdmx:Glossary 2\.1.Statistical subject-matter domain.WebHome]]. The organisation of the content of such schemes is supported in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] as a [[Category Scheme>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]].
381 +The [[Statistical Subject-Matter Domains>>doc:sdmx:Glossary 2\.1.Statistical subject-matter domain.WebHome]] is a listing of the breadth of statistical information for the purposes of organizing widespread statistical exchange and categorization. It acts as a standard scheme against which the categorization schemes of various counterparties can be mapped, to facilitate interoperable data and metadata exchange. It serves another useful purpose, however, which is to allow an organization of corresponding “domain groups”, each of which could define standard [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]], [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]], etc. within their domains. Such groups already exist within the international community. [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] would use the [[Statistical Subject-Matter Domains>>doc:sdmx:Glossary 2\.1.Statistical subject-matter domain.WebHome]] list to facilitate the efforts of these groups to develop the kinds of content standards which could support the interoperation of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]-conformant technical systems within and across [[statistical domains>>doc:sdmx:Glossary 2\.1.Statistical subject-matter domain.WebHome]]. The organisation of the content of such schemes is supported in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] as a [[Category Scheme>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]].
382 382  
383 383  [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Statistical Subject-Matter Domains>>doc:sdmx:Glossary 2\.1.Statistical subject-matter domain.WebHome]] will be listed and maintained by the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Initiative and will be subject to [[adjustment>>doc:sdmx:Glossary 2\.1.Adjustment.WebHome]].
384 384  
385 385  == 6.4 SDMX Concept Roles ==
386 386  
387 -These guidelines define the standard set of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] (% style="color:#e74c3c" %)Concept(%%) Roles and their use. This set of standard [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] (% style="color:#e74c3c" %)Concepts(%%) are implemented as a [[cross-domain Concept>>doc:sdmx:Glossary 2\.1.Cross-domain concept.WebHome]] Scheme that defines the set of (% style="color:#e74c3c" %)concept(%%) roles and gives examples on (% style="color:#e74c3c" %)concept(%%) role implementation in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 2.0, 2.1 and 3.0. A (% style="color:#e74c3c" %)concept(%%) role gives a particular context to a (% style="color:#e74c3c" %)concept(%%) for easy and systematic interpretation by machine processing and visualization tools. For example, the (% style="color:#e74c3c" %)concepts(%%) REPORTING_AREA and COUNTERPART_AREA are different (% style="color:#e74c3c" %)concepts(%%) but they are both geographical characteristics, therefore they can be associated with the same (% style="color:#e74c3c" %)concept(%%) role ID: "GEO". This allows visualization systems to interpret these (% style="color:#e74c3c" %)concepts(%%) as geographical data in order to generate (% style="color:#e74c3c" %)maps(%%). The implementation of (% style="color:#e74c3c" %)concept(%%) roles is different in (% style="color:#e74c3c" %)versions(%%) 2.0 and 2.1/3.0 of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] technical standard. Specifically for [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0, this set of roles is considered a normative list that must be interpreted in the same way by all organisations. Additional roles may be provided via the standard roles’ mechanism in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0, i.e., via [[Concept Schemes>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]; the semantics of these roles have to be agreed bilateraly in [[data exchanges>>doc:sdmx:Glossary 2\.1.Data exchange.WebHome]]. The (% style="color:#e74c3c" %)Concept(%%) Roles are available as an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Concept Scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] on the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Global Registry>>doc:sdmx:Glossary 2\.1.Global registry.WebHome]].
387 +These guidelines define the standard set of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] Roles and their use. This set of standard [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] are implemented as a [[cross-domain Concept>>doc:sdmx:Glossary 2\.1.Cross-domain concept.WebHome]] Scheme that defines the set of [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] roles and gives examples on [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] role implementation in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 2.0, 2.1 and 3.0. A [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] role gives a particular context to a [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] for easy and systematic interpretation by machine processing and visualization tools. For example, the [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] REPORTING_AREA and COUNTERPART_AREA are different [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] but they are both geographical characteristics, therefore they can be associated with the same [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] role ID: "GEO". This allows visualization systems to interpret these [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] as geographical data in order to generate [[maps>>doc:sdmx:Glossary 2\.1.Map.WebHome]]. The implementation of [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] roles is different in [[versions>>doc:sdmx:Glossary 2\.1.Version.WebHome]] 2.0 and 2.1/3.0 of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] technical standard. Specifically for [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0, this set of roles is considered a normative list that must be interpreted in the same way by all organisations. Additional roles may be provided via the standard roles’ mechanism in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0, i.e., via [[Concept Schemes>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]; the semantics of these roles have to be agreed bilateraly in [[data exchanges>>doc:sdmx:Glossary 2\.1.Data exchange.WebHome]]. The [[Concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] Roles are available as an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Concept Scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] on the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Global Registry>>doc:sdmx:Glossary 2\.1.Global registry.WebHome]].
388 388  
389 389  = 7 Validation and Transformation Language =
390 390  
391 391  For many years the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] initiative has been fostering and supporting the development of a standard calculation [[language>>doc:sdmx:Glossary 2\.1.Language.WebHome]], called [[Validation and Transformation Language>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] ([[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]]). A blueprint for defining calculations was already described in the original [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 2.1 specifications (package 13 of the Information Model - “Transformations and Expressions”). It was just a basic framework that required further developments to became operational in order to achieve a calculation [[language>>doc:sdmx:Glossary 2\.1.Language.WebHome]] able to manipulate [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[artefacts>>doc:sdmx:Glossary 2\.1.Artefact.WebHome]].
392 392  
393 -These developments started in late 2012 and were put in charge of the [[Validation and Transformation Language>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] Task Force ([[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] TF), which included members of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Working Group (TWG) and Statistical Working Group (SWG), besides experts coming from the DDI and GSIM communities. The intent was to define a standard [[language>>doc:sdmx:Glossary 2\.1.Language.WebHome]] to be implemented in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] and applicable also to GSIM and DDI. This brought to the publication of the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 1.0 in 2015. Then new requirements came from a number of proofs of (% style="color:#e74c3c" %)concepts(%%) and tests of [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 1.0 made by several organisations and triggered a large improvement of the [[language>>doc:sdmx:Glossary 2\.1.Language.WebHome]]. A new provisional (% style="color:#e74c3c" %)version(%%), the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 1.1, was released in public consultation in 2017. The high number of [[comments>>doc:sdmx:Glossary 2\.1.Comment.WebHome]] received triggered another phase of intensive work, with the main goal of achieving a more robust and forward compatible (% style="color:#e74c3c" %)version(%%). Finally, the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 2.0 was published between April and July 2018 (see the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] website).
393 +These developments started in late 2012 and were put in charge of the [[Validation and Transformation Language>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] Task Force ([[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] TF), which included members of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Working Group (TWG) and Statistical Working Group (SWG), besides experts coming from the DDI and GSIM communities. The intent was to define a standard [[language>>doc:sdmx:Glossary 2\.1.Language.WebHome]] to be implemented in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] and applicable also to GSIM and DDI. This brought to the publication of the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 1.0 in 2015. Then new requirements came from a number of proofs of concepts and tests of [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 1.0 made by several organisations and triggered a large improvement of the [[language>>doc:sdmx:Glossary 2\.1.Language.WebHome]]. A new provisional version, the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 1.1, was released in public consultation in 2017. The high number of [[comments>>doc:sdmx:Glossary 2\.1.Comment.WebHome]] received triggered another phase of intensive work, with the main goal of achieving a more robust and forward compatible version. Finally, the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 2.0 was published between April and July 2018 (see the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] website).
394 394  
395 395  The implementation of the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 2.0 in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] started in late 2018 and was published as an incremental revision to the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 2.1 standards in July 2020. It allows users to write [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 2.0 programs for validating and transforming [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] data, to store these programs in a [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] metadata registry and to exchange them through [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] messages, also together the definition of the data structures of the involved data.
396 396  
© Semantic R&D Group, 2026