Skip to Content

Changes for page Schema and Documentation

Last modified by Helena K. on 2026/06/09 12:21
From version 13.1
edited by Helena K.
on 2026/06/04 22:21
Change comment: There is no comment for this version
To version 14.1
edited by Helena K.
on 2026/06/05 11:32
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -6,34 +6,34 @@
6 6  
7 7  == 1.1 History and Version 3.0 Developments ==
8 8  
9 -The [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Standards (% style="color:#e74c3c" %)Version(%%) 1.0 established an information model which described aggregated statistical [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] and the [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] needed to exchange them in a standard fashion. This drew on the earlier example of the GESMES/TS standard. Based on the [[SDMX information model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]], several formats were developed: XML formats for exchange of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]], [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]], and queries for these ([[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]]), and EDIFACT formats for the [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] and [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] ([[SDMX-EDI>>doc:sdmx:Glossary 2\.1.SDMX-EDI.WebHome]]). These standards supported a number of exchange patterns, characterized as "bilateral", "gateway", and "data-sharing" models, as described in the Framework document in the (% style="color:#e74c3c" %)Version(%%) 1.0 standards package.
9 +The [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Standards [[Version>>doc:OntologyElements.Version.WebHome]] 1.0 established an information model which described aggregated statistical [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] and the [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] needed to exchange them in a standard fashion. This drew on the earlier example of the GESMES/TS standard. Based on the [[SDMX information model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]], several formats were developed: XML formats for exchange of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]], [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]], and queries for these ([[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]]), and EDIFACT formats for the [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] and [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] ([[SDMX-EDI>>doc:sdmx:Glossary 2\.1.SDMX-EDI.WebHome]]). These standards supported a number of exchange patterns, characterized as "bilateral", "gateway", and "data-sharing" models, as described in the Framework document in the [[Version>>doc:OntologyElements.Version.WebHome]] 1.0 standards package.
10 10  
11 -(% style="color:#e74c3c" %)Versions(%%) 2.0 and 2.1 built on this foundation to provide a higher degree of support for all of these models, with an emphasis on data sharing in the form of a set of standard registry services interfaces. Support for new types of metadata exchange and reporting were added, with a focus on "[[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]]" concerned with quality, methodology, and other issues. Further, the ability to provide metadata about the relationships between [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] and structures was expanded, providing more support for data cubes. Overall, the scope of the (% style="color:#e74c3c" %)Version(%%) 2.1 [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Standards was much broader, and included a larger set of message types in the [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] formats.
11 +Versions 2.0 and 2.1 built on this foundation to provide a higher degree of support for all of these models, with an emphasis on data sharing in the form of a set of standard registry services interfaces. Support for new types of [[metadata>>doc:IMElements.metadata.WebHome]] exchange and reporting were added, with a focus on "[[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]]" concerned with quality, methodology, and other issues. Further, the ability to provide [[metadata>>doc:IMElements.metadata.WebHome]] about the relationships between [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] and structures was expanded, providing more support for data cubes. Overall, the scope of the [[Version>>doc:OntologyElements.Version.WebHome]] 2.1 [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Standards was much broader, and included a larger set of message types in the [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] formats.
12 12  
13 -For (% style="color:#e74c3c" %)Version(%%) 3.0, the [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] specification has been rationalised and tightened while maintaining the fundamentals and principles established in 2.1. The documents for describing [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] remain the same except where there have been changes to the information model either to enhance existing structures, add new ones, or remove those deprecated such as the [[Structure Set>>doc:sdmx:Glossary 2\.1.Structure set.WebHome]].
13 +For [[Version>>doc:OntologyElements.Version.WebHome]] 3.0, the [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] specification has been rationalised and tightened while maintaining the fundamentals and principles established in 2.1. The documents for describing [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] remain the same except where there have been changes to the information model either to enhance existing structures, add new ones, or remove those deprecated such as the [[Structure Set>>doc:sdmx:Glossary 2\.1.Structure set.WebHome]].
14 14  
15 -The deprecation of the SOAP web services specification in (% style="color:#e74c3c" %)Version(%%) 3.0 has resulted in the removal of all [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] Query documents. Standardisation on the REST API and HTTP GET for registry structure queries means separate 'query request' documents are no longer required.
15 +The deprecation of the SOAP web services specification in [[Version>>doc:OntologyElements.Version.WebHome]] 3.0 has resulted in the removal of all [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] Query documents. Standardisation on the REST API and HTTP GET for registry [[structure>>doc:IMElements.structure.WebHome]] queries means separate 'query request' documents are no longer required.
16 16  
17 -The opportunity has also been taken to rationalise the plethora of alternative data documents accumulated from (% style="color:#e74c3c" %)Versions(%%) 1.0, 2.0 and 2.1. All, including Generic, Utility, Compact and Cross-Sectional have been deprecated except for Structure Specific Data which becomes the sole standard XML format for data updates, revisions and [[bilateral exchanges>>doc:sdmx:Glossary 2\.1.Bilateral exchange.WebHome]] in (% style="color:#e74c3c" %)Version(%%) 3.0.
17 +The opportunity has also been taken to rationalise the plethora of alternative data documents accumulated from Versions 1.0, 2.0 and 2.1. [[All>>doc:OntologyElements.All.WebHome]], including Generic, Utility, Compact and Cross-Sectional have been deprecated except for [[Structure>>doc:IMElements.AnnotableArtefact.IdentifiableArtefact.NameableArtefact.VersionableArtefact.MaintainableArtefact.Structure.WebHome]] Specific Data which becomes the sole standard XML format for data updates, revisions and [[bilateral exchanges>>doc:sdmx:Glossary 2\.1.Bilateral exchange.WebHome]] in [[Version>>doc:OntologyElements.Version.WebHome]] 3.0.
18 18  
19 19  == 1.2 The XML Design ==
20 20  
21 -All of these document types will share a common "envelope" at the message (% style="color:#e74c3c" %)level(%%) ("SDMXMessage.xsd"), as well as a set of common low-(% style="color:#e74c3c" %)level(%%) [[components>>doc:sdmx:Glossary 2\.1.Component.WebHome]] ("SDMXCommon[subset].xsd") so that header information and basic structure of a message will always be the same.
21 +[[All>>doc:OntologyElements.All.WebHome]] of these document types will share a common "envelope" at the message level ("SDMXMessage.xsd"), as well as a set of common low-level [[components>>doc:IMElements.components.WebHome]] ("SDMXCommon[subset].xsd") so that header information and basic [[structure>>doc:IMElements.structure.WebHome]] of a message will always be the same.
22 22  
23 -* Schema and sub-modules for describing all types of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] - for [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] ([[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]), for [[metadata sets>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]] ([[metadata structure definitions>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]), for related groups of metadata and data structures, and for all types of structural objects involved in registry-based exchanges ("SDMXStructure[*subset*].xsd")
24 -* Structure specific data schema for for updates, revisions/[[bilateral exchange>>doc:sdmx:Glossary 2\.1.Bilateral exchange.WebHome]] ("SDMXDataStructureSpecific.xsd")
23 +* Schema and sub-modules for describing all types of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] - for [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] ([[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]), for [[metadata sets>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]] ([[metadata structure definitions>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]), for related groups of [[metadata>>doc:IMElements.metadata.WebHome]] and data structures, and for all types of structural objects involved in registry-based exchanges ("SDMXStructure[*subset*].xsd")
24 +* [[Structure>>doc:IMElements.AnnotableArtefact.IdentifiableArtefact.NameableArtefact.VersionableArtefact.MaintainableArtefact.Structure.WebHome]] specific data schema for for updates, revisions/[[bilateral exchange>>doc:sdmx:Glossary 2\.1.Bilateral exchange.WebHome]] ("SDMXDataStructureSpecific.xsd")
25 25  * Generic schema and sub-modules for registry interfaces ("SDMXRegistry [*subset*].xsd")
26 26  * Generic schema for [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] sets ("SDMXMetadataGeneric.xsd")
27 27  
28 28  == 1.3 Fostering the Use of a Standard SDMX-ML ==
29 29  
30 -In addition to these different formats, standard mappings and corresponding transformation tools have been developed for the creation of data structure-specific schemas from structure descriptions, to transform XML data instances from one XML [[data description>>doc:sdmx:Glossary 2\.1.Data presentation - detailed description.WebHome]] format to another, and from these formats into the corresponding [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] messages. This (% style="color:#e74c3c" %)level(%%) of free tools support will foster the early use of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] and permit the data to be easily used across all processes, which is otherwise a difficult requirement to meet. Ultimately, it is the fact that all formats share a common information model that enables this approach to meet the wide set of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] requirements.
30 +In addition to these different formats, standard mappings and corresponding transformation tools have been developed for the creation of data [[structure>>doc:IMElements.structure.WebHome]]-specific schemas from [[structure>>doc:IMElements.structure.WebHome]] descriptions, to transform XML data instances from one XML [[data description>>doc:sdmx:Glossary 2\.1.Data presentation - detailed description.WebHome]] format to another, and from these formats into the corresponding [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] messages. This level of free tools support will foster the early use of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] and permit the data to be easily used across all processes, which is otherwise a difficult requirement to meet. Ultimately, it is the fact that all formats share a common information model that enables this approach to meet the wide set of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] requirements.
31 31  
32 32  = 2 NORMATIVE REFERENCES =
33 33  
34 -W3C XML Schema Definition [[Language>>doc:sdmx:Glossary 2\.1.Language.WebHome]], (% style="color:#e74c3c" %)version(%%) 1.0 (URL: http://www.w3c.org/XML/Schema#dev), World Wide Web Consortium
34 +W3C XML Schema Definition [[Language>>doc:sdmx:Glossary 2\.1.Language.WebHome]], [[version>>doc:IMElements.version.WebHome]] 1.0 (URL: http://www.w3c.org/XML/Schema#dev), World Wide Web Consortium
35 35  
36 -W3C Extensible Markup [[Language>>doc:sdmx:Glossary 2\.1.Language.WebHome]], (% style="color:#e74c3c" %)version(%%) 1.0, Third Edition (URL: http://www.w3c.org/TR/2004/REC-xml-20040204/), World Wide Web Consortium
36 +W3C Extensible Markup [[Language>>doc:sdmx:Glossary 2\.1.Language.WebHome]], [[version>>doc:IMElements.version.WebHome]] 1.0, Third Edition (URL: http://www.w3c.org/TR/2004/REC-xml-20040204/), World Wide Web Consortium
37 37  
38 38  = 3 CONFORMANCE =
39 39  
© Semantic R&D Group, 2026