Last modified by Helena on 2025/09/10 11:19
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Tags
-
... ... @@ -1,1 +1,0 @@ 1 -Artefact|Metadata set|Reference metadata|SDMX Information Model|SDMX Technical Specification|SDMX-JSON|SDMX-ML|Statistical data and metadata exchange|Statistical subject-matter domain|Structural metadata|Validation and transformation language - Content
-
... ... @@ -11,69 +11,65 @@ 11 11 12 12 = 1 Introduction = 13 13 14 -The [[Statistical Data and Metadata Exchange>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]]([[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]) initiative (https:~/~/www.[[sdmx>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]].org) sets 3 standards that can facilitate the exchange of statistical data and metadata using modern 4 information technology.14 +The Statistical Data and Metadata Exchange (SDMX) initiative (https:~/~/www.sdmx.org) sets 3 standards that can facilitate the exchange of statistical data and metadata using modern 4 information technology. 15 15 16 -The [[SDMX Technical Specifications>>doc:xwiki:Glossary.SDMXTechnical Specification.WebHome]] are organised into several discrete sections.16 +The SDMX Technical Specifications are organised into several discrete sections. 17 17 18 -The following are published on the [[SDMX>>doc:xwiki:Glossary.Statistical data andmetadata exchange.WebHome]]website18 +The following are published on the SDMX website ([[__https:~~/~~/www.sdmx.org__>>https://https:www.sdmx.org]]). 19 19 20 -([[__https:~~/~~/www.sdmx.org__>>https://https:www.sdmx.org]]). 21 - 22 22 **Section 1** **Framework for SDMX Technical Standards** – this document providing an introduction to the technical standards. 23 23 24 -**Section 2** **SDMX Information Model** - 22 +**Section 2** **SDMX Information Model** - the SDMX information model is a standardised object model for modelling statistical domains centring on the structure of their data and metadata sets, the coding schemes used for classification, and the rules for controlling the exchange of data and metadata between organisations. This document provides a UML specification with supporting narrative. 25 25 26 - the[[SDMX informationmodel>>doc:xwiki:Glossary.SDMX InformationModel.WebHome]]isastandardisedobjectmodel formodelling[[statisticaldomains>>doc:xwiki:Glossary.Statisticalsubject-matterdomain.WebHome]]centringonthestructure of their dataand [[metadatasets>>doc:xwiki:Glossary.Metadata set.WebHome]], the codingschemes usedforclassification, andtherulesfor controllingthe exchangeof data and metadatabetweenorganisations. This documentprovidesaUMLspecificationwith supporting narrative.24 +**Section 5** **SDMX Registry Specification** – an SDMX ‘registry’ acts as a repository for structural metadata and provisioning information, and a registry of data and metadata sources. This document sets out the specification. 27 27 28 -**Section 5** **SDMXRegistry Specification** –an [[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadataexchange.WebHome]] ‘registry’ actsasarepositoryfor[[structural metadata>>doc:xwiki:Glossary.Structuralmetadata.WebHome]] and provisioning information, and aregistryofdataandmetadata sources. Thisdocument sets out the specification.26 +**Section 6** **SDMX Technical Notes** – detailed technical guidance for implementors of the SDMX standard. 29 29 30 - **Section6** **SDMX Technical Notes**– detailed technicalguidanceforimplementorsof the[[SDMX>>doc:xwiki:Glossary.Statistical data andmetadata exchange.WebHome]]standard.28 +The following are published on the GitHub repository of the SDMX Standards Technical Working Group (__[[https:~~/~~/github.com/sdmx-twg>>https://github.com/sdmx-twg]]__): 31 31 32 -The following are published on the GitHub repository of the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] Standards Technical Working Group ([[__https:~~/~~/github.com/sdmx-twg__>>https://https:github.comsdmx-twg]]): 33 - 34 34 (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-rest2013RESTAPI" %) 35 35 **sdmx-twg/sdmx-rest – REST API** 36 36 37 -Technical specifications for the [[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]]RESTful web services application programming interfaces (API).33 +Technical specifications for the SDMX RESTful web services application programming interfaces (API). 38 38 39 39 (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-ml2013SDMX-ML" %) 40 -**sdmx-twg/sdmx-ml – [[SDMX-ML>>doc:xwiki:Glossary.SDMX-ML.WebHome]]**36 +**sdmx-twg/sdmx-ml – SDMX-ML** 41 41 42 -Technical specifications for the XML transmission format including XSD schemas, documentation and samples for data, structure and [[reference metadata>>doc:xwiki:Glossary.Referencemetadata.WebHome]] messages.38 +Technical specifications for the XML transmission format including XSD schemas, documentation and samples for data, structure and reference metadata messages. 43 43 44 44 (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-json2013SDMX-JSON" %) 45 -**sdmx-twg/sdmx-json – [[SDMX-JSON>>doc:xwiki:Glossary.SDMX-JSON.WebHome]]**41 +**sdmx-twg/sdmx-json – SDMX-JSON** 46 46 47 -Technical specifications for the JSON transmission format including documentation, schemas and samples for data, structure and [[reference metadata>>doc:xwiki:Glossary.Referencemetadata.WebHome]] messages.43 +Technical specifications for the JSON transmission format including documentation, schemas and samples for data, structure and reference metadata messages. 48 48 49 49 (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-csv2013SDMX-CSV" %) 50 -**sdmx-twg/sdmx-csv – [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]-CSV**46 +**sdmx-twg/sdmx-csv – SDMX-CSV** 51 51 52 -Technical specifications for the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]-CSV transmission format for ‘comma-separated values’ (CSV) data and[[reference metadata>>doc:xwiki:Glossary.Reference metadata.WebHome]].48 +Technical specifications for the SDMX-CSV transmission format for ‘comma-separated values’ (CSV) data and reference metadata. 53 53 54 54 The following sections are obsolete: 55 55 56 -Section 3 - [[SDMX-ML>>doc:xwiki:Glossary.SDMX-ML.WebHome]]- replaced by the[[sdmx>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]-twg/[[sdmx-ml>>doc:xwiki:Glossary.SDMX-ML.WebHome]]GitHub repository52 +Section 3 - SDMX-ML - replaced by the sdmx-twg/sdmx-ml GitHub repository 57 57 58 -Section 4 - [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]-EDI54 +Section 4 - SDMX-EDI 59 59 60 -Section 7 - API - replaced by the [[sdmx>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]-twg/[[sdmx>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]-rest GitHub repository[[VTL>>doc:xwiki:Glossary.Validation and transformation language.WebHome]]56 +Section 7 - API - replaced by the sdmx-twg/sdmx-rest GitHub repository VTL 61 61 62 -In July 2020 the [[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]]2.1 specifications were revised to add support for the[[Validation and Transformation Language>>doc:xwiki:Glossary.Validationand transformation language.WebHome]]([[VTL>>doc:xwiki:Glossary.Validation and transformation language.WebHome]]). For 3.0, the[[VTL>>doc:xwiki:Glossary.Validationand transformation language.WebHome]] specification has been updated to align with changes to the information model and other modifications to the Standard such as the introduction of Semantic Versioning for the versioning of[[structural metadata>>doc:xwiki:Glossary.Structuralmetadata.WebHome]] [[artefacts>>doc:xwiki:Glossary.Artefact.WebHome]].Section 2 (Information Model) sets out details of the ‘Transformation and Expressions’ package for defining and managing[[VTL>>doc:xwiki:Glossary.Validationand transformation language.WebHome]]2.0 programs and Section 6 (Technical Notes) provides detailed guidance on implementing and using[[VTL>>doc:xwiki:Glossary.Validationand transformation language.WebHome]]with[[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]].58 +In July 2020 the SDMX 2.1 specifications were revised to add support for the Validation and Transformation Language (VTL). For 3.0, the VTL specification has been updated to align with changes to the information model and other modifications to the Standard such as the introduction of Semantic Versioning for the versioning of structural metadata artefacts. Section 2 (Information Model) sets out details of the ‘Transformation and Expressions’ package for defining and managing VTL 2.0 programs and Section 6 (Technical Notes) provides detailed guidance on implementing and using VTL with SDMX. 63 63 64 64 = 2 Change History = 65 65 66 -The 2.0 (% style="color:#2ecc71" %)version(%%)of this standard represented a significant increase in scope, and also provided more complete support in those areas covered in the(% style="color:#2ecc71" %)version(%%)1.0 specification.(% style="color:#2ecc71" %)Version(%%)2.0 of this standard is backward-compatible with(% style="color:#2ecc71" %)version(%%)1.0, so that existing implementations can be easily migrated to conformance with(% style="color:#2ecc71" %)version(%%)2.0.62 +The 2.0 version of this standard represented a significant increase in scope, and also provided more complete support in those areas covered in the version 1.0 specification. Version 2.0 of this standard is backward-compatible with version 1.0, so that existing implementations can be easily migrated to conformance with version 2.0. 67 67 68 -The 2.1 (% style="color:#2ecc71" %)version(%%)of this standard represents a set of changes resulting from several years of implementation experience with the 2.0 standard. The changes do not represent a major increase in scope or functionality, but do correct some bugs, and add functionalities in some cases. Major changes in[[SDMX-ML>>doc:xwiki:Glossary.SDMX-ML.WebHome]]include a much stronger alignment of the XML Schemas with the Information Model, to emphasize inheritance and object-oriented features, and increased precision and flexibility in the attachment of metadata reports to specific objects in the[[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]]Information Model.64 +The 2.1 version of this standard represents a set of changes resulting from several years of implementation experience with the 2.0 standard. The changes do not represent a major increase in scope or functionality, but do correct some bugs, and add functionalities in some cases. Major changes in SDMX-ML include a much stronger alignment of the XML Schemas with the Information Model, to emphasize inheritance and object-oriented features, and increased precision and flexibility in the attachment of metadata reports to specific objects in the SDMX Information Model. 69 69 70 -The 3.0 (% style="color:#2ecc71" %)version(%%)incorporates new features, improvements and changes arising from the collective knowledge gained from a decade of operating experience with the 2.1 standard. In pursuit of modernisation and simplification, features considered obsolete have been deprecated – in particular the EDI transmission format, the lesser-used XML data messages and the SOAP web services API. Many areas remain backwardly compatible with 2.1, but there are some breaking changes where the information model has been redesigned to better support practical use case. Structure mapping and[[reference metadata>>doc:xwiki:Glossary.Referencemetadata.WebHome]] are examples. The opportunity has been taken to revise the RESTful web services API which is also not backwardly compatible, but benefits from a rationalisation and better organisations of resources, and a much richer data query URL syntax.66 +The 3.0 version incorporates new features, improvements and changes arising from the collective knowledge gained from a decade of operating experience with the 2.1 standard. In pursuit of modernisation and simplification, features considered obsolete have been deprecated – in particular the EDI transmission format, the lesser-used XML data messages and the SOAP web services API. Many areas remain backwardly compatible with 2.1, but there are some breaking changes where the information model has been redesigned to better support practical use case. Structure mapping and reference metadata are examples. The opportunity has been taken to revise the RESTful web services API which is also not backwardly compatible, but benefits from a rationalisation and better organisations of resources, and a much richer data query URL syntax. 71 71 72 72 == 2.1 Major Changes from 1.0 to 2.0 == 73 73 74 -* ** [[Reference Metadata>>doc:xwiki:Glossary.Reference metadata.WebHome]]**: In addition to describing and specifying data structures and formats (along with related[[structural metadata>>doc:xwiki:Glossary.Structural metadata.WebHome]]), the(% style="color:#2ecc71" %)version(%%)2.0 specification also provides for the exchange of metadata which is distinct from the[[structural metadata>>doc:xwiki:Glossary.Structuralmetadata.WebHome]]in the 1.0(% style="color:#2ecc71" %)version(%%). This[[category>>doc:xwiki:Glossary.Category.WebHome]]includes “reference” metadata (regarding data quality, methodology, and similar types – it can be configured by the user to include whatever(% style="color:#2ecc71" %)concepts(%%)require reporting); metadata related to data provisioning ([[release calendar>>doc:xwiki:Glossary.Releasepolicy - release calendar.WebHome]] information, description of the data and metadata provided, etc.); and metadata relevant to the exchange of categorization schemes.70 +* **Reference Metadata**: In addition to describing and specifying data structures and formats (along with related structural metadata), the version 2.0 specification also provides for the exchange of metadata which is distinct from the structural metadata in the 1.0 version. This category includes “reference” metadata (regarding data quality, methodology, and similar types – it can be configured by the user to include whatever concepts require reporting); metadata related to data provisioning (release calendar information, description of the data and metadata provided, etc.); and metadata relevant to the exchange of categorization schemes. 75 75 * **SDMX Registry**: Provision is made in the 2.0 standard for standard communication with registry services, to support a data-sharing model of statistical exchange. These services include registration of data and metadata, querying of registered data and metadata, and subscription. 76 -* ** [[Structural Metadata>>doc:xwiki:Glossary.Structural metadata.WebHome]]**: The support for exchange of statistical data and related[[structural metadata>>doc:xwiki:Glossary.Structuralmetadata.WebHome]]has been expanded. Some support is provided for qualitative data; data cube structures are described;[[hierarchical code lists>>doc:xwiki:Glossary.Hierarchicalcode list.WebHome]]are supported; relationships between data structures can be expressed, providing support for extensibility of data structures; 101 and the description of functional dependencies within cubes are supported.72 +* **Structural Metadata**: The support for exchange of statistical data and related structural metadata has been expanded. Some support is provided for qualitative data; data cube structures are described; hierarchical code lists are supported; relationships between data structures can be expressed, providing support for extensibility of data structures; 101 and the description of functional dependencies within cubes are supported. 77 77 78 78 == 2.2 Major Changes from 2.0 to 2.1 == 79 79