Last modified by Helena on 2025/09/10 11:19
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Tags
-
... ... @@ -1,0 +1,1 @@ 1 +Artefact|Metadata set|Reference metadata|SDMX Information Model|SDMX Technical Specification|SDMX-JSON|SDMX-ML|Statistical data and metadata exchange|Statistical subject-matter domain|Structural metadata|Validation and transformation language - Content
-
... ... @@ -11,65 +11,69 @@ 11 11 12 12 = 1 Introduction = 13 13 14 -The Statistical Data and Metadata Exchange (SDMX) initiative (https:~/~/www.sdmx.org) sets 3 standards that can facilitate the exchange of statistical data and metadata using modern 4 information technology. 14 +The [[Statistical Data and Metadata Exchange>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] ([[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]) initiative (https:~/~/www.[[sdmx>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]].org) sets 3 standards that can facilitate the exchange of statistical data and metadata using modern 4 information technology. 15 15 16 -The SDMX Technical Specifications are organised into several discrete sections. 16 +The [[SDMX Technical Specifications>>doc:xwiki:Glossary.SDMX Technical Specification.WebHome]] are organised into several discrete sections. 17 17 18 -The following are published on the SDMX website ([[__https:~~/~~/www.sdmx.org__>>https://https:www.sdmx.org]]).18 +The following are published on the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] website 19 19 20 +([[__https:~~/~~/www.sdmx.org__>>https://https:www.sdmx.org]]). 21 + 20 20 **Section 1** **Framework for SDMX Technical Standards** – this document providing an introduction to the technical standards. 21 21 22 -**Section 2** **SDMX Information Model** - the SDMX information model is a standardised object model for modelling statistical domains centring on the structure of their data and metadata sets, the coding schemes used for classification, and the rules for controlling the exchange of data and metadata between organisations. This document provides a UML specification with supporting narrative.24 +**Section 2** **SDMX Information Model** - 23 23 24 - **Section5** **SDMXRegistrySpecification**–anSDMX‘registry’actsasarepositoryforstructuralmetadataandprovisioninginformation, andaregistryof data and metadatasources. This documentsetsoutthespecification.26 +the [[SDMX information model>>doc:xwiki:Glossary.SDMX Information Model.WebHome]] is a standardised object model for modelling [[statistical domains>>doc:xwiki:Glossary.Statistical subject-matter domain.WebHome]] centring on the structure of their data and [[metadata sets>>doc:xwiki:Glossary.Metadata set.WebHome]], the coding schemes used for classification, and the rules for controlling the exchange of data and metadata between organisations. This document provides a UML specification with supporting narrative. 25 25 26 -**Section 6** **SDMXTechnical Notes** – detailed technicalguidance forimplementors of theSDMXstandard.28 +**Section 5** **SDMX Registry Specification** – an [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] ‘registry’ acts as a repository for [[structural metadata>>doc:xwiki:Glossary.Structural metadata.WebHome]] and provisioning information, and a registry of data and metadata sources. This document sets out the specification. 27 27 28 - ThefollowingarepublishedontheGitHubrepositoryof the SDMXStandards Technical WorkingGroup (__[[https:~~/~~/github.com/sdmx-twg>>https://github.com/sdmx-twg]]__):30 +**Section 6** **SDMX Technical Notes** – detailed technical guidance for implementors of the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] standard. 29 29 32 +The following are published on the GitHub repository of the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] Standards Technical Working Group ([[__https:~~/~~/github.com/sdmx-twg__>>https://https:github.comsdmx-twg]]): 33 + 30 30 (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-rest2013RESTAPI" %) 31 31 **sdmx-twg/sdmx-rest – REST API** 32 32 33 -Technical specifications for the SDMX RESTful web services application programming interfaces (API). 37 +Technical specifications for the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] RESTful web services application programming interfaces (API). 34 34 35 35 (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-ml2013SDMX-ML" %) 36 -**sdmx-twg/sdmx-ml – SDMX-ML** 40 +**sdmx-twg/sdmx-ml – [[SDMX-ML>>doc:xwiki:Glossary.SDMX-ML.WebHome]]** 37 37 38 -Technical specifications for the XML transmission format including XSD schemas, documentation and samples for data, structure and reference metadata messages. 42 +Technical specifications for the XML transmission format including XSD schemas, documentation and samples for data, structure and [[reference metadata>>doc:xwiki:Glossary.Reference metadata.WebHome]] messages. 39 39 40 40 (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-json2013SDMX-JSON" %) 41 -**sdmx-twg/sdmx-json – SDMX-JSON** 45 +**sdmx-twg/sdmx-json – [[SDMX-JSON>>doc:xwiki:Glossary.SDMX-JSON.WebHome]]** 42 42 43 -Technical specifications for the JSON transmission format including documentation, schemas and samples for data, structure and reference metadata messages. 47 +Technical specifications for the JSON transmission format including documentation, schemas and samples for data, structure and [[reference metadata>>doc:xwiki:Glossary.Reference metadata.WebHome]] messages. 44 44 45 45 (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-csv2013SDMX-CSV" %) 46 -**sdmx-twg/sdmx-csv – SDMX-CSV** 50 +**sdmx-twg/sdmx-csv – [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]-CSV** 47 47 48 -Technical specifications for the SDMX-CSV transmission format for ‘comma-separated values’ (CSV) data and reference metadata. 52 +Technical specifications for the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]-CSV transmission format for ‘comma-separated values’ (CSV) data and [[reference metadata>>doc:xwiki:Glossary.Reference metadata.WebHome]]. 49 49 50 50 The following sections are obsolete: 51 51 52 -Section 3 - SDMX-ML - replaced by the sdmx-twg/sdmx-ml GitHub repository 56 +Section 3 - [[SDMX-ML>>doc:xwiki:Glossary.SDMX-ML.WebHome]] - replaced by the [[sdmx>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]-twg/[[sdmx-ml>>doc:xwiki:Glossary.SDMX-ML.WebHome]] GitHub repository 53 53 54 -Section 4 - SDMX-EDI 58 +Section 4 - [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]-EDI 55 55 56 -Section 7 - API - replaced by the sdmx-twg/sdmx-rest GitHub repository VTL 60 +Section 7 - API - replaced by the [[sdmx>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]-twg/[[sdmx>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]-rest GitHub repository [[VTL>>doc:xwiki:Glossary.Validation and transformation language.WebHome]] 57 57 58 -In July 2020 the SDMX 2.1 specifications were revised to add support for the Validation and Transformation Language (VTL). For 3.0, the VTL specification has been updated to align with changes to the information model and other modifications to the Standard such as the introduction of Semantic Versioning for the versioning of structural metadata artefacts. Section 2 (Information Model) sets out details of the ‘Transformation and Expressions’ package for defining and managing VTL 2.0 programs and Section 6 (Technical Notes) provides detailed guidance on implementing and using VTL with SDMX. 62 +In July 2020 the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] 2.1 specifications were revised to add support for the [[Validation and Transformation Language>>doc:xwiki:Glossary.Validation and transformation language.WebHome]] ([[VTL>>doc:xwiki:Glossary.Validation and transformation language.WebHome]]). For 3.0, the [[VTL>>doc:xwiki:Glossary.Validation and transformation language.WebHome]] specification has been updated to align with changes to the information model and other modifications to the Standard such as the introduction of Semantic Versioning for the versioning of [[structural metadata>>doc:xwiki:Glossary.Structural metadata.WebHome]] [[artefacts>>doc:xwiki:Glossary.Artefact.WebHome]]. Section 2 (Information Model) sets out details of the ‘Transformation and Expressions’ package for defining and managing [[VTL>>doc:xwiki:Glossary.Validation and transformation language.WebHome]] 2.0 programs and Section 6 (Technical Notes) provides detailed guidance on implementing and using [[VTL>>doc:xwiki:Glossary.Validation and transformation language.WebHome]] with [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]. 59 59 60 60 = 2 Change History = 61 61 62 -The 2.0 version of this standard represented a significant increase in scope, and also provided more complete support in those areas covered in the version 1.0 specification. Version 2.0 of this standard is backward-compatible with version 1.0, so that existing implementations can be easily migrated to conformance with version 2.0. 66 +The 2.0 (% style="color:#2ecc71" %)version(%%) of this standard represented a significant increase in scope, and also provided more complete support in those areas covered in the (% style="color:#2ecc71" %)version(%%) 1.0 specification. (% style="color:#2ecc71" %)Version(%%) 2.0 of this standard is backward-compatible with (% style="color:#2ecc71" %)version(%%) 1.0, so that existing implementations can be easily migrated to conformance with (% style="color:#2ecc71" %)version(%%) 2.0. 63 63 64 -The 2.1 version of this standard represents a set of changes resulting from several years of implementation experience with the 2.0 standard. The changes do not represent a major increase in scope or functionality, but do correct some bugs, and add functionalities in some cases. Major changes in SDMX-ML include a much stronger alignment of the XML Schemas with the Information Model, to emphasize inheritance and object-oriented features, and increased precision and flexibility in the attachment of metadata reports to specific objects in the SDMX Information Model. 68 +The 2.1 (% style="color:#2ecc71" %)version(%%) of this standard represents a set of changes resulting from several years of implementation experience with the 2.0 standard. The changes do not represent a major increase in scope or functionality, but do correct some bugs, and add functionalities in some cases. Major changes in [[SDMX-ML>>doc:xwiki:Glossary.SDMX-ML.WebHome]] include a much stronger alignment of the XML Schemas with the Information Model, to emphasize inheritance and object-oriented features, and increased precision and flexibility in the attachment of metadata reports to specific objects in the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] Information Model. 65 65 66 -The 3.0 version incorporates new features, improvements and changes arising from the collective knowledge gained from a decade of operating experience with the 2.1 standard. In pursuit of modernisation and simplification, features considered obsolete have been deprecated – in particular the EDI transmission format, the lesser-used XML data messages and the SOAP web services API. Many areas remain backwardly compatible with 2.1, but there are some breaking changes where the information model has been redesigned to better support practical use case. Structure mapping and reference metadata are examples. The opportunity has been taken to revise the RESTful web services API which is also not backwardly compatible, but benefits from a rationalisation and better organisations of resources, and a much richer data query URL syntax. 70 +The 3.0 (% style="color:#2ecc71" %)version(%%) incorporates new features, improvements and changes arising from the collective knowledge gained from a decade of operating experience with the 2.1 standard. In pursuit of modernisation and simplification, features considered obsolete have been deprecated – in particular the EDI transmission format, the lesser-used XML data messages and the SOAP web services API. Many areas remain backwardly compatible with 2.1, but there are some breaking changes where the information model has been redesigned to better support practical use case. Structure mapping and [[reference metadata>>doc:xwiki:Glossary.Reference metadata.WebHome]] are examples. The opportunity has been taken to revise the RESTful web services API which is also not backwardly compatible, but benefits from a rationalisation and better organisations of resources, and a much richer data query URL syntax. 67 67 68 68 == 2.1 Major Changes from 1.0 to 2.0 == 69 69 70 -* **Reference Metadata**: In addition to describing and specifying data structures and formats (along with related structural metadata), the version 2.0 specification also provides for the exchange of metadata which is distinct from the structural metadata in the 1.0 version. This category includes “reference” metadata (regarding data quality, methodology, and similar types – it can be configured by the user to include whatever concepts require reporting); metadata related to data provisioning (release calendar information, description of the data and metadata provided, etc.); and metadata relevant to the exchange of categorization schemes. 74 +* **[[Reference Metadata>>doc:xwiki:Glossary.Reference metadata.WebHome]]**: In addition to describing and specifying data structures and formats (along with related [[structural metadata>>doc:xwiki:Glossary.Structural metadata.WebHome]]), the (% style="color:#2ecc71" %)version(%%) 2.0 specification also provides for the exchange of metadata which is distinct from the [[structural metadata>>doc:xwiki:Glossary.Structural metadata.WebHome]] in the 1.0 (% style="color:#2ecc71" %)version(%%). This [[category>>doc:xwiki:Glossary.Category.WebHome]] includes “reference” metadata (regarding data quality, methodology, and similar types – it can be configured by the user to include whatever (% style="color:#2ecc71" %)concepts(%%) require reporting); metadata related to data provisioning ([[release calendar>>doc:xwiki:Glossary.Release policy - release calendar.WebHome]] information, description of the data and metadata provided, etc.); and metadata relevant to the exchange of categorization schemes. 71 71 * **SDMX Registry**: Provision is made in the 2.0 standard for standard communication with registry services, to support a data-sharing model of statistical exchange. These services include registration of data and metadata, querying of registered data and metadata, and subscription. 72 -* **Structural Metadata**: The support for exchange of statistical data and related structural metadata has been expanded. Some support is provided for qualitative data; data cube structures are described; hierarchical code lists are supported; relationships between data structures can be expressed, providing support for extensibility of data structures; 101 and the description of functional dependencies within cubes are supported. 76 +* **[[Structural Metadata>>doc:xwiki:Glossary.Structural metadata.WebHome]]**: The support for exchange of statistical data and related [[structural metadata>>doc:xwiki:Glossary.Structural metadata.WebHome]] has been expanded. Some support is provided for qualitative data; data cube structures are described; [[hierarchical code lists>>doc:xwiki:Glossary.Hierarchical code list.WebHome]] are supported; relationships between data structures can be expressed, providing support for extensibility of data structures; 101 and the description of functional dependencies within cubes are supported. 73 73 74 74 == 2.2 Major Changes from 2.0 to 2.1 == 75 75