Changes for page SDMX 3.1 Standards. Section 1. Framework
Last modified by Helena K. on 2026/06/08 15:16
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Tags
-
... ... @@ -1,0 +1,1 @@ 1 +Adjustment|Artefact|Attribute|Bilateral exchange|Categorisation|Category|Category Scheme|Code|Codelist|Comment|Component|Concept|Concept Scheme|Constraint|Coverage|Cross-domain Concept|Currency|Data Consumer|Data Provider|Data Set|Data Source|Data Structure Definition|Data exchange|Dataflow|Dimension|Frequency of observation|Global Registry|Hierarchical Codelist|Hierarchy|Incremental update|Item Scheme|Language|Maintenance agency|Map|Measure|Metadata Set|Metadata Structure Definition|Metadata repository|Metadataflow|Notification|Provision Agreement|Reference metadata|Release policy - release calendar|Reporting Taxonomy|Representation|SDMX Information Model|SDMX Registry|SDMX Technical Specification|SDMX-CSV|SDMX-EDI|SDMX-JSON|SDMX-ML|Series|Statistical Data and Metadata eXchange|Statistical classification|Statistical subject-matter domain|Statistical unit|Structural metadata|Subscription|Timeliness|Validation and Transformation Language|Version - Content
-
... ... @@ -10,61 +10,61 @@ 10 10 11 11 = 1 Introduction = 12 12 13 -The [[Statistical Data and Metadata Exchange>>doc:sdmx:Glossary2\.1.Statistical data and metadata exchange.WebHome]]([[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]) initiative (https:~/~/www.sdmx.org) sets standards that can facilitate the exchange of statistical data and metadata using modern information technology.13 +The Statistical Data and Metadata Exchange (SDMX) initiative ([[https:~~/~~/www.sdmx.org>>https://https:www.sdmx.org||rel="noopener noreferrer" target="_blank"]]) sets standards that can facilitate the exchange of statistical data and metadata using modern information technology. 14 14 15 -The [[SDMX Technical Specifications>>doc:sdmx:Glossary2\.1.SDMX Technical Specification.WebHome]] are organised into several discrete sections.15 +The SDMX Technical Specifications are organised into several discrete sections. 16 16 17 -The following are published on the [[SDMX>>doc:sdmx:Glossary2\.1.Statistical data and metadata exchange.WebHome]]website ([[__https:~~/~~/www.sdmx.org__>>https://https:www.sdmx.org]]):17 +The following are published on the SDMX website ([[__https:~~/~~/www.sdmx.org__>>https://https:www.sdmx.org||rel="noopener noreferrer" target="_blank"]]): 18 18 19 19 **Section 1** **Framework for SDMX Technical Standards** – this document providing an introduction to the technical standards. 20 20 21 -**Section 2** **SDMX Information Model** - the [[SDMX information model>>doc:sdmx:Glossary2\.1.SDMX Information Model.WebHome]] is a standardised object model for modelling[[statistical domains>>doc:sdmx:Glossary2\.1.Statistical subject-matter domain.WebHome]] centring on the structure of their data and[[metadata sets>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]], the coding schemes used for[[classification>>doc:sdmx:Glossary 2\.1.Statistical Classification.WebHome]], and the rules for controlling the exchange of data and metadata between organisations. This document provides a UML specification with supporting narrative.21 +**Section 2** **SDMX Information Model** - the SDMX information model is a standardised object model for modelling statistical domains centring on the structure of their data and metadata sets, the coding schemes used for classification, and the rules for controlling the exchange of data and metadata between organisations. This document provides a UML specification with supporting narrative. 22 22 23 -**Section 5** **SDMX Registry Specification** – an [[SDMX>>doc:sdmx:Glossary2\.1.Statistical data and metadata exchange.WebHome]]‘registry’ acts as a repository for[[structural metadata>>doc:sdmx:Glossary2\.1.Structural metadata.WebHome]] and provisioning information, and a registry of data and metadata sources. This document sets out the specification.23 +**Section 5** **SDMX Registry Specification** – an SDMX ‘registry’ acts as a repository for structural metadata and provisioning information, and a registry of data and metadata sources. This document sets out the specification. 24 24 25 -**Section 6** **SDMX Technical Notes** – detailed technical guidance for implementors of the [[SDMX>>doc:sdmx:Glossary2\.1.Statistical data andmetadata exchange.WebHome]] standard.25 +**Section 6** **SDMX Technical Notes** – detailed technical guidance for implementors of the SDMX standard. 26 26 27 -The following are published on the GitHub repository of the [[SDMX>>doc:sdmx:Glossary2\.1.Statistical data andmetadata exchange.WebHome]] Standards Technical Working Group ([[__https:~~/~~/github.com/sdmx-twg__>>https://https:github.comsdmx-twg]]): sdmx-twg/sdmx-rest – REST API27 +The following are published on the GitHub repository of the SDMX Standards Technical Working Group ([[__https:~~/~~/github.com/sdmx-twg__>>https://https:github.comsdmx-twg||rel="noopener noreferrer" target="_blank"]]): sdmx-twg/sdmx-rest – REST API 28 28 29 -Technical specifications for the [[SDMX>>doc:sdmx:Glossary2\.1.Statistical data and metadata exchange.WebHome]]RESTful web services application programming interfaces (API).29 +Technical specifications for the SDMX RESTful web services application programming interfaces (API). 30 30 31 31 (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-ml2013SDMX-ML" %) 32 32 **sdmx-twg/sdmx-ml – SDMX-ML** 33 -Technical specifications for the XML transmission format including XSD schemas, documentation and samples for data, structure and [[reference metadata>>doc:sdmx:Glossary2\.1.Referencemetadata.WebHome]] messages.33 +Technical specifications for the XML transmission format including XSD schemas, documentation and samples for data, structure and reference metadata messages. 34 34 35 35 (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-json2013SDMX-JSON" %) 36 36 **sdmx-twg/sdmx-json – SDMX-JSON** 37 -Technical specifications for the JSON transmission format including documentation, schemas and samples for data, structure and [[reference metadata>>doc:sdmx:Glossary2\.1.Referencemetadata.WebHome]] messages.37 +Technical specifications for the JSON transmission format including documentation, schemas and samples for data, structure and reference metadata messages. 38 38 39 39 (% class="wikigeneratedid" id="Hsdmx-twg2Fsdmx-csv2013SDMX-CSV" %) 40 40 **sdmx-twg/sdmx-csv – SDMX-CSV** 41 -Technical specifications for the [[SDMX-CSV>>doc:sdmx:Glossary2\.1.SDMX-CSV.WebHome]]transmission format for ‘comma-separated values’ (CSV) data and[[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]].41 +Technical specifications for the SDMX-CSV transmission format for ‘comma-separated values’ (CSV) data and reference metadata. 42 42 43 43 The following sections are obsolete: 44 44 45 -Section 3 - [[SDMX-ML>>doc:sdmx:Glossary2\.1.SDMX-ML.WebHome]]-replaced by the sdmx-twg/sdmx-ml GitHub repository45 +Section 3 - SDMX-ML - replaced by the sdmx-twg/sdmx-ml GitHub repository 46 46 47 -Section 4 - [[SDMX-EDI>>doc:sdmx:Glossary 2\.1.SDMX-EDI.WebHome]]47 +Section 4 - SDMX-EDI 48 48 49 -Section 7 - API - replaced by the sdmx-twg/sdmx-rest GitHub repository [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]]49 +Section 7 - API - replaced by the sdmx-twg/sdmx-rest GitHub repository VTL 50 50 51 -In July 2020 the [[SDMX>>doc:sdmx:Glossary2\.1.Statisticaldata and metadata exchange.WebHome]] 2.1specifications were revised to add support for the[[Validation and Transformation Language>>doc:sdmx:Glossary2\.1.Validation and transformation language.WebHome]]([[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]]). For 3.0, the[[VTL>>doc:sdmx:Glossary2\.1.Validation and transformation language.WebHome]] specification has been updated to align with changes to the information model and other modifications to the Standard such as the introduction of Semantic Versioning for the versioning of[[structural metadata>>doc:sdmx:Glossary2\.1.Structural metadata.WebHome]] [[artefacts>>doc:sdmx:Glossary 2\.1.Artefact.WebHome]].Section 2 (Information Model) sets out details of the ‘Transformation and Expressions’ package for defining and managing[[VTL>>doc:sdmx:Glossary2\.1.Validation and transformation language.WebHome]] 2.0 programs and Section 6 (Technical Notes) provides detailed guidance on implementing and using[[VTL>>doc:sdmx:Glossary2\.1.Validation and transformation language.WebHome]]with[[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]].51 +In July 2020 the SDMX 2.1 specifications were revised to add support for the Validation and Transformation Language (VTL). For 3.0, the VTL specification has been updated to align with changes to the information model and other modifications to the Standard such as the introduction of Semantic Versioning for the versioning of structural metadata artefacts. Section 2 (Information Model) sets out details of the ‘Transformation and Expressions’ package for defining and managing VTL 2.0 programs and Section 6 (Technical Notes) provides detailed guidance on implementing and using VTL with SDMX. 52 52 53 53 = 2 Change History = 54 54 55 55 The 2.0 version of this standard represented a significant increase in scope, and also provided more complete support in those areas covered in the version 1.0 specification. Version 2.0 of this standard is backward-compatible with version 1.0, so that existing implementations can be easily migrated to conformance with version 2.0. 56 56 57 -The 2.1 version of this standard represents a set of changes resulting from several years of implementation experience with the 2.0 standard. The changes do not represent a major increase in scope or functionality, but do correct some bugs, and add functionalities in some cases. Major changes in [[SDMX-ML>>doc:sdmx:Glossary2\.1.SDMX-ML.WebHome]]include a much stronger alignment of the XML Schemas with the Information Model, to emphasize inheritance and object-oriented features, and increased precision and flexibility in the attachment of metadata reports to specific objects in the[[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]].57 +The 2.1 version of this standard represents a set of changes resulting from several years of implementation experience with the 2.0 standard. The changes do not represent a major increase in scope or functionality, but do correct some bugs, and add functionalities in some cases. Major changes in SDMX-ML include a much stronger alignment of the XML Schemas with the Information Model, to emphasize inheritance and object-oriented features, and increased precision and flexibility in the attachment of metadata reports to specific objects in the SDMX Information Model. 58 58 59 -The 3.0 version incorporates new features, improvements and changes arising from the collective knowledge gained from a decade of operating experience with the 2.1 standard. In pursuit of modernisation and simplification, features considered obsolete have been deprecated – in particular the EDI transmission format, the lesser-used XML data messages and the SOAP web services API. Many areas remain backwardly compatible with 2.1, but there are some breaking changes where the information model has been redesigned to better support practical use case. Structure mapping and [[reference metadata>>doc:sdmx:Glossary2\.1.Reference metadata.WebHome]] are examples. The opportunity has been taken to revise the RESTful web services API which is also not backwardly compatible, but benefits from a rationalisation and better organisations of resources, and a much richer data query URL syntax.59 +The 3.0 version incorporates new features, improvements and changes arising from the collective knowledge gained from a decade of operating experience with the 2.1 standard. In pursuit of modernisation and simplification, features considered obsolete have been deprecated – in particular the EDI transmission format, the lesser-used XML data messages and the SOAP web services API. Many areas remain backwardly compatible with 2.1, but there are some breaking changes where the information model has been redesigned to better support practical use case. Structure mapping and reference metadata are examples. The opportunity has been taken to revise the RESTful web services API which is also not backwardly compatible, but benefits from a rationalisation and better organisations of resources, and a much richer data query URL syntax. 60 60 61 61 The 3.1 version provides supports for data models to increase dimensionality over time without impacting existing data collections. The Data Constraint model was adjusted to separate concerns of data reporting and data dissemination. 62 62 63 63 == 2.1 Major Changes from 1.0 to 2.0 == 64 64 65 -* ** [[Reference Metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]]**: In addition to describing and specifying data structures and formats (along with related[[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]), the version 2.0 specification also provides for the exchange of metadata which is distinct from the[[structural metadata>>doc:sdmx:Glossary2\.1.Structural metadata.WebHome]]in the 1.0 version. This[[category>>doc:sdmx:Glossary2\.1.Category.WebHome]]includes “reference” metadata (regarding data quality, methodology, and similar types – it can be configured by the user to include whatever concepts require reporting); metadata related to data provisioning ([[release calendar>>doc:sdmx:Glossary2\.1.Release policy - release calendar.WebHome]] information, description of the data and metadata provided, etc.); and metadata relevant to the exchange of categorization schemes.66 -* ** [[SDMX Registry>>doc:sdmx:Glossary 2\.1.SDMX Registry.WebHome]]**: Provision is made in the 2.0 standard for standard communication with registry services, to support a data-sharing model of statistical exchange. These services include registration of data and metadata, querying of registered data and metadata, and[[subscription>>doc:sdmx:Glossary 2\.1.Subscription.WebHome]]/[[notification>>doc:sdmx:Glossary 2\.1.Notification.WebHome]].67 -* ** [[Structural Metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]**: The support for exchange of statistical data and related[[structural metadata>>doc:sdmx:Glossary2\.1.Structural metadata.WebHome]]has been expanded. Some support is provided for qualitative data; data cube structures are described;[[hierarchical code lists>>doc:sdmx:Glossary2\.1.Hierarchical codelist.WebHome]] are supported; relationships between data structures can be expressed, providing support for extensibility of data structures; and the description of functional dependencies within cubes are supported.65 +* **Reference Metadata**: In addition to describing and specifying data structures and formats (along with related structural metadata), the version 2.0 specification also provides for the exchange of metadata which is distinct from the structural metadata in the 1.0 version. This category includes “reference” metadata (regarding data quality, methodology, and similar types – it can be configured by the user to include whatever concepts require reporting); metadata related to data provisioning (release calendar information, description of the data and metadata provided, etc.); and metadata relevant to the exchange of categorization schemes. 66 +* **SDMX Registry**: Provision is made in the 2.0 standard for standard communication with registry services, to support a data-sharing model of statistical exchange. These services include registration of data and metadata, querying of registered data and metadata, and subscription/notification. 67 +* **Structural Metadata**: The support for exchange of statistical data and related structural metadata has been expanded. Some support is provided for qualitative data; data cube structures are described; hierarchical code lists are supported; relationships between data structures can be expressed, providing support for extensibility of data structures; and the description of functional dependencies within cubes are supported. 68 68 69 69 == 2.2 Major Changes from 2.0 to 2.1 == 70 70 ... ... @@ -98,7 +98,7 @@ 98 98 (% class="wikigeneratedid" id="HVersioningofStructuralMetadataArtefacts" %) 99 99 **Versioning of Structural Metadata Artefacts** 100 100 101 -Adoption of the three-number semantic versioning standard for [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] [[artefacts>>doc:sdmx:Glossary 2\.1.Artefact.WebHome]] ([[__https:~~/~~/semver.org__>>https://https:semver.org]]) 101 +Adoption of the three-number semantic versioning standard for [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] [[artefacts>>doc:sdmx:Glossary 2\.1.Artefact.WebHome]] ([[__https:~~/~~/semver.org__>>https://https:semver.org||rel="noopener noreferrer" target="_blank"]]) 102 102 103 103 (% class="wikigeneratedid" id="HRESTWebServicesApplicationProgrammingInterface28API29" %) 104 104 **REST Web Services Application Programming Interface (API)** ... ... @@ -137,14 +137,14 @@ 137 137 (% class="wikigeneratedid" id="HInformationModel-1" %) 138 138 **Information Model** 139 139 140 -* Addition of [[Dimension>>doc:sdmx:Glossary2\.1.Dimension.WebHome]] [[Constraint>>doc:sdmx:Glossary2\.1.Constraint.WebHome]]property to a [[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]140 +* Addition of Dimension Constraint property to a [[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] 141 141 * Addition of evolving structure property to a [[Data Structure Definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] 142 142 * Remove [[version>>doc:sdmx:Glossary 2\.1.Version.WebHome]] property on [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]] 143 -* Simplification of [[Constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]]143 +* Simplification of Constraints 144 144 ** Removal of Advanced [[Release Calendar>>doc:sdmx:Glossary 2\.1.Release policy - release calendar.WebHome]] 145 -** Removal of Role, Data [[Constraints>>doc:sdmx:Glossary2\.1.Constraint.WebHome]] only restrict data that can be reported145 +** Removal of Role, Data Constraints only restrict data that can be reported 146 146 ** Restrict [[constraint>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] targets to Identifiable structures (not URLs) 147 -** Addition of Availability [[Constraint>>doc:sdmx:Glossary2\.1.Constraint.WebHome]]todefine actual data147 +** Addition of Availability Constraint to define actual data 148 148 149 149 (% class="wikigeneratedid" id="HDocumentation" %) 150 150 **Documentation** ... ... @@ -224,7 +224,7 @@ 224 224 225 225 Inherent in any statistical exchange – and in many dissemination activities – is a concept of "service level agreement", even if this is not formalized or made explicit. [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] incorporates this idea in objects termed "[[provision agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]]". [[Data providers>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]] may provide data to many different [[data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]. [[Data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] may incorporate data coming from more than one [[data provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]]. [[Provision agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]] are the objects which tell you which [[data providers>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]] are supplying what data to which [[data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]. Similarly, metadata [[provision agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]] for [[metadata flows>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]]. 226 226 227 -[[Provision Agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]] allow for data collection restrictions to be applied at the level of the [[Data Provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]] in the context of the collection ([[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]), this set of information is termed a ‘Data [[Constraint>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]]’ in the [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]]. Additionally, in a dissemination environment, data can be queried at the level of the [[Provision Agreement>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]], this can be a complete [[dataset>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] as supplied by a specific [[Data Provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]] for the [[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]], a subset of data, or information about what data exists (Data Availability).227 +[[Provision Agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]] allow for data collection restrictions to be applied at the level of the [[Data Provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]] in the context of the collection ([[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]), this set of information is termed a ‘Data Constraint’ in the [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]]. Additionally, in a dissemination environment, data can be queried at the level of the [[Provision Agreement>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]], this can be a complete [[dataset>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] as supplied by a specific [[Data Provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]] for the [[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]], a subset of data, or information about what data exists (Data Availability). 228 228 229 229 A brief summary of the objects described in the information model includes: 230 230 ... ... @@ -237,20 +237,20 @@ 237 237 * //**[[Concept Scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]:**// A [[concept scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] is a maintained list of [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] that are used in [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and [[metadata structure definitions>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]. There can be many such [[concept schemes>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]. A “core” [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] of the [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] can be specified (e.g. a core [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]], or other [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] such as “date”). Note that this core [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] can be overridden in the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] or [[metadata structure definition>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]] that uses the [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]]. Indeed, organisations wishing to remain with version 1.0 key family schema specifications will continue to declare the [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] in the key family definition. 238 238 * //**[[Metadata Set>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]]:**// A [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] set is a set of information pertaining to an object within the formal [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] view of statistical exchange: they may describe the maintainers of data or structural definitions; they may describe the schedule on which data is released; they may describe the flow of a single type of data over time; they may describe the quality of data, etc. In [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]], the creators of [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] may take whatever [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] they are concerned with, or obliged to report, and provide a [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] set containing that information. 239 239 * //**[[Metadata Structure Definition>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]:**// A [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] set also has a set of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] which describes how it is organized. This [[metadata set>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]] identifies what [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] are being reported, how these [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] relate to each other (typically as [[hierarchies>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]]), what their presentational structure is, how they may be represented (as free text, as coded values, etc.), and with which formal [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] object types they are associated. 240 -* //**[[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] Definition:**// In [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]], [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] are reported or disseminated according to a [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition. The [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition identifies the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and may be associated with one or more subject matter domains via a [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]] (this facilitates the search for data according to organised [[category schemes>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]]). [[Constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]], in terms of reporting [[periodicity>>doc: sdmx:Glossary 2\.1.Frequency of observation.WebHome]] or sub set of possible keys that are allowed in a [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]], may be attached to the [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition.240 +* //**[[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] Definition:**// In [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]], [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] are reported or disseminated according to a [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition. The [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition identifies the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and may be associated with one or more subject matter domains via a [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]] (this facilitates the search for data according to organised [[category schemes>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]]). [[Constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]], in terms of reporting [[periodicity>>doc:Glossary 2\.1.Frequency of observation.WebHome]] or sub set of possible keys that are allowed in a [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]], may be attached to the [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition. 241 241 * //**[[Metadataflow>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]] Definition:**// A [[metadata flow>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]] definition is very similar to a [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition, but describes, categorises, and constrains [[metadata sets>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]]. 242 242 * //**[[Data Provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]]: **//An organization which produces data is termed a [[data provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]]. 243 243 * //**Metadata Provider: **//An organization which produces [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] is termed a metadata provider. 244 244 * //**[[Provision Agreement>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]] (Metadata [[Provision Agreement>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]]):**// The set of information which describes the way in which [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] and [[metadata sets>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]] are provided by a data/metadata provider. A [[provision agreement>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]] can be constrained in much the same way as a data or [[metadata flow>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]] definition. Thus, a [[data provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]] can express the fact that it provides a particular [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] covering a specific set of countries and topics, Importantly, the actual source of registered data or metadata is attached to the [[provision agreement>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]] (in terms of a URL). The term “agreement” is used because this information can be understood as the basis of a “service-level agreement”. In [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]], however, this is informational metadata to support the technical systems, as opposed to any sort of contractual information (which is outside the scope of a technical specification). In version 3.0, metadata [[provision agreement>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]] and data [[provision agreement>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]] are two separate [[artefacts>>doc:sdmx:Glossary 2\.1.Artefact.WebHome]]. 245 -* //**Data [[Constraint>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]]:**// Used to restrict content (such as enumerations) and are used by [[provision agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]], [[data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]], [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] in order to provide a set of reporting restrictions in the context of a collection246 -* //**Metadata [[Constraint>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]]:**// Used to restrict content (such as enumerations) and are used by metadata [[provision agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]], [[metadata flows>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]], [[metadata structure definitions>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]] in order to provide a set of reporting restrictions in the context of a collection247 -* //**Available Data [[Constraint>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]]:**// Used to report the set of [[Component>>doc:sdmx:Glossary 2\.1.Component.WebHome]] values that have data reported against them in the context of a Data Query. This structure allows a user to know what valid filters can be applied to a cube of data, such that the resulting cube will contain data.245 +* //**Data Constraint:**// Used to restrict content (such as enumerations) and are used by [[provision agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]], [[data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]], [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] in order to provide a set of reporting restrictions in the context of a collection 246 +* //**Metadata Constraint:**// Used to restrict content (such as enumerations) and are used by metadata [[provision agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]], [[metadata flows>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]], [[metadata structure definitions>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]] in order to provide a set of reporting restrictions in the context of a collection 247 +* //**Available Data Constraint:**// Used to report the set of [[Component>>doc:sdmx:Glossary 2\.1.Component.WebHome]] values that have data reported against them in the context of a Data Query. This structure allows a user to know what valid filters can be applied to a cube of data, such that the resulting cube will contain data. 248 248 * //**Structure Map: **//Structure maps describes a mapping between [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] or [[dataflows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] for the purpose of transforming a [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] into a different structure. The mapping rules are defined using one or more [[component>>doc:sdmx:Glossary 2\.1.Component.WebHome]] maps which each map in turn describes how one or more [[components>>doc:sdmx:Glossary 2\.1.Component.WebHome]] from the source [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] map to one or more [[components>>doc:sdmx:Glossary 2\.1.Component.WebHome]] in that of the target. Represent maps act as lookup tables and specific provision is made for mapping dates and times. 249 249 * //**[[Representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] Map:**// [[Representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] maps describe mappings between source value(s) and target value(s) where the values are restricted to those in a [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]], value list or be of a certain type such as integer or string. 250 250 * //**[[Item Scheme>>doc:sdmx:Glossary 2\.1.Item scheme.WebHome]] Map:**// An [[item scheme>>doc:sdmx:Glossary 2\.1.Item scheme.WebHome]] map describes mapping rules between any [[item scheme>>doc:sdmx:Glossary 2\.1.Item scheme.WebHome]] with the exception of [[code lists>>doc:sdmx:Glossary 2\.1.Code list.WebHome]] and value lists which use [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] maps. The version 3.0 information model provides four [[item scheme>>doc:sdmx:Glossary 2\.1.Item scheme.WebHome]] maps: organisation scheme map, [[concept scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] map, [[category scheme>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]] map and [[reporting taxonomy>>doc:sdmx:Glossary 2\.1.Reporting taxonomy.WebHome]] map. Organisation scheme map and reporting scheme map have been omitted from the information model schematic in Figure 1. 251 251 * //**[[Reporting Taxonomy>>doc:sdmx:Glossary 2\.1.Reporting taxonomy.WebHome]]: **//A [[reporting taxonomy>>doc:sdmx:Glossary 2\.1.Reporting taxonomy.WebHome]] allows an organisation to link (possibly in a hierarchical way) a number of cube or [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definitions which together form a complete “report” of data or metadata. This supports primary reporting which often comprises multiple cubes of heterogeneous data, but may also support other collection and reporting functions. It also supports the specification of publications such as a yearbook, in terms of the data or metadata contained in the publication. 252 252 * //**Process:**// The process class provides a way to model statistical processes as a set of interconnected //process steps.// Although not central to the exchange and dissemination of statistical data and metadata, having a shared description of processing allows for the interoperable exchange and dissemination of [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] sets which describe processes-related concepts. 253 -* //**[[Hierarchy>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]]**//: Describes complex [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] [[hierarchies>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]] principally for data discovery purposes. The [[codes>>doc:sdmx:Glossary 2\.1.Code.WebHome]] themselves are referenced from the [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] lists in which they are maintained.253 +* //**[[Hierarchy>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]]**//: Describes complex [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] [[hierarchies>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]] principally for data discovery purposes. The [[codes>>doc:sdmx:Glossary 2\.1.Code.WebHome]] themselves are referenced from the [[code lists>>doc:sdmx:Glossary 2\.1.Code list.WebHome]] in which they are maintained. 254 254 * //**[[Hierarchy>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]] Association**//: A [[hierarchy>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]] association links a [[hierarchy>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]] to something that needs it like a [[dimension>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]]. Furthermore, the linking can be specified in the context of another object such as a [[dimension>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]] in the context of a [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]. Thus, a [[dimension>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]] in a [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] could have different [[hierarchies>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]] depending on the [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]. 255 255 * //**Transformation Scheme:**// A transformation scheme is a set of [[Validation and Transformation Language>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] ([[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]]) transformations aimed at obtaining some meaningful results for the user (e.g., the validation of one or more [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]). The set of transformations is meant to be executed together (in the same run) and may contain 597 any number of transformations in order to produce any number of results. Thus, a transformation scheme can be considered as a [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] ‘program’. 256 256 ... ... @@ -264,7 +264,7 @@ 264 264 265 265 The registry services discussed here can be briefly summarized: 266 266 267 -* //**Maintenance of [[Structural Metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]**//**:** This registry service allows users with [[maintenance agency>>doc:sdmx:Glossary 2\.1.Maintenance agency.WebHome]] access privileges to submit and modify [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]. In this aspect the registry is acting as a [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] repository. However, it is permissible in an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] structure to submit just the “stub” of the structural object, such as a [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] list, and for this stub to reference the actual location from where the metadata can be retrieved, either from a file or a [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] resource, such as another registry.267 +* //**Maintenance of [[Structural Metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]**//**:** This registry service allows users with [[maintenance agency>>doc:sdmx:Glossary 2\.1.Maintenance agency.WebHome]] access privileges to submit and modify [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]. In this aspect the registry is acting as a [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] repository. However, it is permissible in an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] structure to submit just the “stub” of the structural object, such as a [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]], and for this stub to reference the actual location from where the metadata can be retrieved, either from a file or a [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] resource, such as another registry. 268 268 * //**Registration of [[Data Sources>>doc:sdmx:Glossary 2\.1.Data source.WebHome]]: **//This registry service allows users with [[maintenance agency>>doc:sdmx:Glossary 2\.1.Maintenance agency.WebHome]] access privileges to inform the registry of the existence and location (for retrieval) of [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] and [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] sets. The registry stores metadata about these objects, and links it to the [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] that give sufficient structural information for an application to process it, or for an application to discover its existence. Objects in the registry are organized and categorized according to one or more [[category schemes>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]]. 269 269 * //**Querying: **//The registry services have interfaces for querying the metadata contained in a registry, so that applications and users can discover the existence of [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] and [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] sets, [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]], the providers/agencies associated with those objects, and the provider agreements which describe how the data and metadata are made available, and how they are categorized. 270 270 * //**[[Subscription>>doc:sdmx:Glossary 2\.1.Subscription.WebHome]]/[[Notification>>doc:sdmx:Glossary 2\.1.Notification.WebHome]]:**// It is possible to “subscribe” to specific objects in a registry, so that a [[notification>>doc:sdmx:Glossary 2\.1.Notification.WebHome]] will be sent to all subscribers whenever the registry objects are updated. ... ... @@ -273,7 +273,7 @@ 273 273 274 274 Web services allow computer applications to exchange data directly over the Internet, essentially allowing modular or distributed computing in a more flexible fashion than ever before. In order to allow web services to function, however, many standards are required: for requesting and supplying data; for expressing the enveloping data which is used to package exchanged data; for describing web services to one another, to allow for easy integration into applications that use other web services as data resources. 275 275 276 -Version 3.1 has standardized on RESTful web services with a OpenAPI specification published on the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Working Group’s GitHub repository [[__https:~~/~~/github.com/sdmx-twg__>>https://https:github.comsdmx-twg]]. 276 +Version 3.1 has standardized on RESTful web services with a OpenAPI specification published on the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Working Group’s GitHub repository [[__https:~~/~~/github.com/sdmx-twg__>>https://https:github.comsdmx-twg||rel="noopener noreferrer" target="_blank"]]. 277 277 278 278 There are five ‘resources’: 279 279 ... ... @@ -284,15 +284,15 @@ 284 284 * metadata – retrieval of [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] 285 285 * registration – retrieval of data locations (URL) for specific [[provision agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]] 286 286 287 -The following conceptual example uses the ‘data’ resource to query a data repository for a [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] identified by the key ‘M.USD.EUR.SP00.A’ in the EXR (ECB exchange rates) [[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]: https:~/~/ws-entry-point/data/dataflow/ECB/EXR/1.0.0/M.USD.EUR.SP00.A 287 +The following conceptual example uses the ‘data’ resource to query a data repository for a [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] identified by the key ‘M.USD.EUR.SP00.A’ in the EXR (ECB exchange rates) [[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]: [[https:~~/~~/ws-entry-point/data/dataflow/ECB/EXR/1.0.0/M.USD.EUR.SP00.A>>https://https:ws-entry-pointdatadataflowECBEXR1.0.0M.USD.EUR.SP00.A]] 288 288 289 289 = 4 The SDMX Information Model = 290 290 291 291 [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] provides a way of modelling statistical data, and defines the set of metadata constructs used for this purpose. Because [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] specifies a number of transmission formats for expressing data and [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]], the model is used as a mechanism for guaranteeing that transformation between the different formats is lossless. In this sense, all of the formats are syntax-bound expressions of the common information model. 292 292 293 -[[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] recognizes that statistical data is structured; in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] this structure is termed a [[Data Structure Definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]. “[[Data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]” are made up of one or more lower-level “groups”, based on their degrees of similarity. Each group is in turn comprised of one or more “[[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]]” of data. Each [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] or section has a “key” - values for each of a cluster of concepts, also called "[[dimensions>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]]" - which identifies it, and one or more “observations”, which typically combine the time of the observation, and the value of the observation (e.g., measurement). Additionally, metadata may be attached at any level of this structure as descriptive “[[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]]”. [[Code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] lists(enumerations) and other patterns for [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] of data and metadata are also modelled.293 +[[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] recognizes that statistical data is structured; in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] this structure is termed a [[Data Structure Definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]. “[[Data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]” are made up of one or more lower-level “groups”, based on their degrees of similarity. Each group is in turn comprised of one or more “[[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]]” of data. Each [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] or section has a “key” - values for each of a cluster of concepts, also called "[[dimensions>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]]" - which identifies it, and one or more “observations”, which typically combine the time of the observation, and the value of the observation (e.g., measurement). Additionally, metadata may be attached at any level of this structure as descriptive “[[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]]”. [[Code lists>>doc:sdmx:Glossary 2\.1.Code list.WebHome]] (enumerations) and other patterns for [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] of data and metadata are also modelled. 294 294 295 -There is some similarity between “cube” structures commonly used to process statistical data, and the [[Data Structure Definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] idea in the [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]]. It is important to note that the data as structured according to the [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]] is optimized for exchange, potentially with partners who may have no ability to process a “cube” of data coming from complex statistical systems. [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[time series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] can be understood as “slices” of the cube. Such a slice is identified by its key. A "[[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]]" key consists of the values for all [[dimensions>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]] specified by the key family except time. Thus, it is possible to reconstruct and describe data cubes from [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]-structured data, and to exchange such databases using the interfaces and formats provided for that purpose in the standard. Additional objects such as [[hierarchical code>>doc:sdmx:Glossary 2\.1.Hierarchical code.WebHome]] lists, [[constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] and structure maps make it possible to more fully model the structure of cubes.295 +There is some similarity between “cube” structures commonly used to process statistical data, and the [[Data Structure Definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] idea in the [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]]. It is important to note that the data as structured according to the [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]] is optimized for exchange, potentially with partners who may have no ability to process a “cube” of data coming from complex statistical systems. [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[time series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] can be understood as “slices” of the cube. Such a slice is identified by its key. A "[[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]]" key consists of the values for all [[dimensions>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]] specified by the key family except time. Thus, it is possible to reconstruct and describe data cubes from [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]-structured data, and to exchange such databases using the interfaces and formats provided for that purpose in the standard. Additional objects such as [[hierarchical code lists>>doc:sdmx:Glossary 2\.1.Hierarchical code list.WebHome]], [[constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] and structure maps make it possible to more fully model the structure of cubes. 296 296 297 297 The information model also provides a view of [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]]: a mechanism for referencing the meaningful “objects” within the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] view of statistical exchange processes ([[data providers>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]], structures, [[provisioning agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]], [[dataflows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]], [[metadata flows>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]], etc.) to which metadata is attached; a mechanism for describing a set of meaningful concepts, of organizing them into a presentational structure, and of indicating how their values are represented. This is based on a simple, hierarchical view of [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] which is common to many metadata systems and [[classification>>doc:sdmx:Glossary 2\.1.Statistical Classification.WebHome]]/categorization schemes. [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] provides a model (and XML and JSON formats) for both describing [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] structures, and of reporting [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] according to those structures. 298 298 ... ... @@ -310,7 +310,7 @@ 310 310 311 311 There are four distinct types of message: 312 312 313 -1. //**Structure Definition**~:// For the exchange of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]. A [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] structure message can carry details of any number and combination of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] [[artefacts>>doc:sdmx:Glossary 2\.1.Artefact.WebHome]] like DSDs, [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] listsand [[constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]].313 +1. //**Structure Definition**~:// For the exchange of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]. A [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] structure message can carry details of any number and combination of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] [[artefacts>>doc:sdmx:Glossary 2\.1.Artefact.WebHome]] like DSDs, [[code lists>>doc:sdmx:Glossary 2\.1.Code list.WebHome]] and [[constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]]. 314 314 1. //**Structure-specific Data**~:// For the exchange of data. This format is specific to the [[Data Structure Definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] of the [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] (in other terms, it is [[DSD>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]-specific) and is created by following mappings between the metadata constructs defined in the Structure Definition message and the technical specification of the format. It supports the exchange of large [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] in XML format, provides strict validation of conformance with the [[DSD>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] using a generic XML parser, and supports the transmission of partial [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] ([[incremental updates>>doc:sdmx:Glossary 2\.1.Incremental update.WebHome]]) as well as whole [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]. 315 315 316 316 Many XML tools and technologies have expectations about the functions performed by an XML schema, one of which is a very direct relationship between the XML constructs described in the XML schema and the tagged data in the XML instance. Strong data typing is also considered normal, supporting full validation of the tagged data. These message types are designed to support validation and other expected XML schema functions. ... ... @@ -366,7 +366,7 @@ 366 366 367 367 == 6.1 Cross-Domain Concepts == 368 368 369 -The [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Cross-Domain Concepts>>doc:sdmx:Glossary 2\.1.Cross-domain concept.WebHome]] is a content guideline concerning [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] which are used across [[statistical domains>>doc:sdmx:Glossary 2\.1.Statistical subject-matter domain.WebHome]]. This list is expected to grow and to be subject to revision as [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] is used in a growing number of domains. The use of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Cross-Domain Concepts>>doc:sdmx:Glossary 2\.1.Cross-domain concept.WebHome]], where appropriate, provides a framework to further promote interoperability among organisations using the technical standards presented here. The harmonization of statistical [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] includes not only the definitions of the [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]], and their names, but also, where appropriate, their [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] with standard [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] lists, and the role they play within [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and [[metadata structure definitions>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]].369 +The [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Cross-Domain Concepts>>doc:sdmx:Glossary 2\.1.Cross-domain concept.WebHome]] is a content guideline concerning [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] which are used across [[statistical domains>>doc:sdmx:Glossary 2\.1.Statistical subject-matter domain.WebHome]]. This list is expected to grow and to be subject to revision as [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] is used in a growing number of domains. The use of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Cross-Domain Concepts>>doc:sdmx:Glossary 2\.1.Cross-domain concept.WebHome]], where appropriate, provides a framework to further promote interoperability among organisations using the technical standards presented here. The harmonization of statistical [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] includes not only the definitions of the [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]], and their names, but also, where appropriate, their [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] with standard [[code lists>>doc:sdmx:Glossary 2\.1.Code list.WebHome]], and the role they play within [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and [[metadata structure definitions>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]. 370 370 371 371 The intent of this guideline is two-fold: to provide a core set of [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] which can be used to structure statistical data and metadata, to promote interoperability between systems (“[[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]”, as described above); and to promote the exchange of metadata more widely, with a set of harmonized [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] names and definitions for other types of metadata (“[[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]]”, as defined above.) 372 372