Changes for page SDMX 3.1 Standards. Section 1. Framework
Last modified by Helena K. on 2026/06/08 15:16
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Tags
-
... ... @@ -1,0 +1,1 @@ 1 +Adjustment|Artefact|Attribute|Bilateral exchange|Categorisation|Category|Category Scheme|Code|Codelist|Comment|Component|Concept|Concept Scheme|Constraint|Coverage|Cross-domain Concept|Currency|Data Consumer|Data Provider|Data Set|Data Source|Data Structure Definition|Data exchange|Dataflow|Dimension|Frequency of observation|Global Registry|Hierarchical Codelist|Hierarchy|Incremental update|Item Scheme|Language|Maintenance agency|Map|Measure|Metadata Set|Metadata Structure Definition|Metadata repository|Metadataflow|Notification|Provision Agreement|Reference metadata|Release policy - release calendar|Reporting Taxonomy|Representation|SDMX Information Model|SDMX Registry|SDMX Technical Specification|SDMX-CSV|SDMX-EDI|SDMX-JSON|SDMX-ML|Series|Statistical Data and Metadata eXchange|Statistical classification|Statistical subject-matter domain|Statistical unit|Structural metadata|Subscription|Timeliness|Validation and Transformation Language|Version - Content
-
... ... @@ -10,13 +10,13 @@ 10 10 11 11 = 1 Introduction = 12 12 13 -The [[Statistical Data and Metadata Exchange>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] ([[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]) initiative ( [[https:~~/~~/www.sdmx.org>>https://https:www.sdmx.org||rel="noopener noreferrer" target="_blank"]]) sets standards that can facilitate the exchange of statistical data and metadata using modern information technology.13 +The [[Statistical Data and Metadata Exchange>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] ([[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]) initiative (https:~/~/www.sdmx.org) sets standards that can facilitate the exchange of statistical data and metadata using modern information technology. 14 14 15 15 The [[SDMX Technical Specifications>>doc:sdmx:Glossary 2\.1.SDMX Technical Specification.WebHome]] are organised into several discrete sections. 16 16 17 -The following are published on the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] website ([[__https:~~/~~/www.sdmx.org__>>https://https:www.sdmx.org ||rel="noopener noreferrer" target="_blank"]]):17 +The following are published on the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] website ([[__https:~~/~~/www.sdmx.org__>>https://https:www.sdmx.org]]): 18 18 19 -**Section 1** **Framework for [[SDMX>>doc:sdmx:Glossary2\.1.Statistical data and metadata exchange.WebHome]]Technical Standards** – this document providing an introduction to the technical standards.19 +**Section 1** **Framework for SDMX Technical Standards** – this document providing an introduction to the technical standards. 20 20 21 21 **Section 2** **SDMX Information Model** - the [[SDMX information model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]] is a standardised object model for modelling [[statistical domains>>doc:sdmx:Glossary 2\.1.Statistical subject-matter domain.WebHome]] centring on the structure of their data and [[metadata sets>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]], the coding schemes used for [[classification>>doc:sdmx:Glossary 2\.1.Statistical Classification.WebHome]], and the rules for controlling the exchange of data and metadata between organisations. This document provides a UML specification with supporting narrative. 22 22 ... ... @@ -24,7 +24,7 @@ 24 24 25 25 **Section 6** **SDMX Technical Notes** – detailed technical guidance for implementors of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] standard. 26 26 27 -The following are published on the GitHub repository of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Standards Technical Working Group ([[__https:~~/~~/github.com/sdmx-twg__>>https://https:github.comsdmx-twg ||rel="noopener noreferrer" target="_blank"]]): sdmx-twg/sdmx-rest – REST API27 +The following are published on the GitHub repository of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Standards Technical Working Group ([[__https:~~/~~/github.com/sdmx-twg__>>https://https:github.comsdmx-twg]]): sdmx-twg/sdmx-rest – REST API 28 28 29 29 Technical specifications for the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] RESTful web services application programming interfaces (API). 30 30 ... ... @@ -64,7 +64,7 @@ 64 64 65 65 * **[[Reference Metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]]**: In addition to describing and specifying data structures and formats (along with related [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]), the version 2.0 specification also provides for the exchange of metadata which is distinct from the [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] in the 1.0 version. This [[category>>doc:sdmx:Glossary 2\.1.Category.WebHome]] includes “reference” metadata (regarding data quality, methodology, and similar types – it can be configured by the user to include whatever concepts require reporting); metadata related to data provisioning ([[release calendar>>doc:sdmx:Glossary 2\.1.Release policy - release calendar.WebHome]] information, description of the data and metadata provided, etc.); and metadata relevant to the exchange of categorization schemes. 66 66 * **[[SDMX Registry>>doc:sdmx:Glossary 2\.1.SDMX Registry.WebHome]]**: Provision is made in the 2.0 standard for standard communication with registry services, to support a data-sharing model of statistical exchange. These services include registration of data and metadata, querying of registered data and metadata, and [[subscription>>doc:sdmx:Glossary 2\.1.Subscription.WebHome]]/[[notification>>doc:sdmx:Glossary 2\.1.Notification.WebHome]]. 67 -* ***[[Structural Metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]**: The support for exchange of statistical data and related [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] has been expanded. Some support is provided for qualitative data; data cube structures are described; [[hierarchical code lists>>doc:sdmx:Glossary 2\.1.Hierarchical code list.WebHome]] are supported; relationships between data structures can be expressed, providing support for extensibility of data structures; and the description of functional dependencies within cubes are supported.67 +* **[[Structural Metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]**: The support for exchange of statistical data and related [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] has been expanded. Some support is provided for qualitative data; data cube structures are described; [[hierarchical code lists>>doc:sdmx:Glossary 2\.1.Hierarchical code list.WebHome]] are supported; relationships between data structures can be expressed, providing support for extensibility of data structures; and the description of functional dependencies within cubes are supported. 68 68 69 69 == 2.2 Major Changes from 2.0 to 2.1 == 70 70 ... ... @@ -75,7 +75,7 @@ 75 75 * **Optimization for XML Technologies:** Implementation has shown that it is possible to better organize the XML schemas for use within common technology development tools which work with XML. These changes are primarily focused on leveraging the objectoriented features of W3C XML Schema to allow for easier processing of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] data and metadata. 76 76 * **Consistency between the [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] and the [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]]: **Certain aspects of the XML schemas and UML model have been more closely aligned, to allow for easier comprehension of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] model. 77 77 * **Technical Bugs:** Some minor technical bugs have been identified in the registry interfaces and elsewhere. These bugs have been addressed. 78 -* **Support for Non-Time-Series Data in the Generic Format: **One area which has been extended is the ability to express non-time-[[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] data as part of the generic data message. 78 +* **Support for Non-Time-[[Series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] Data in the Generic Format: **One area which has been extended is the ability to express non-time-[[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] data as part of the generic data message. 79 79 * **Simplification of the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] - specific message types: **Both [[time series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] (version 2.0 Compact) and non-[[time series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] (version 2.0 Cross Sectional) use the same underlying structure for a structure-specific formatted message, which is specific to the [[Data Structure Definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] of the [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]. 80 80 * **Simplification and better support for the metadata structure: **New use cases have been reported and these are now supported by a re-modelled [[metadata structure definition>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]. 81 81 * **Support for partial [[item schemes>>doc:sdmx:Glossary 2\.1.Item scheme.WebHome]] such as a [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]]: **The concept of a partial (subset) [[item scheme>>doc:sdmx:Glossary 2\.1.Item scheme.WebHome]] such as a partial [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]] for use in exchange scenarios has been introduced**.** ... ... @@ -98,7 +98,7 @@ 98 98 (% class="wikigeneratedid" id="HVersioningofStructuralMetadataArtefacts" %) 99 99 **Versioning of Structural Metadata Artefacts** 100 100 101 -Adoption of the three-number semantic versioning standard for [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] [[artefacts>>doc:sdmx:Glossary 2\.1.Artefact.WebHome]] ([[__https:~~/~~/semver.org__>>https://https:semver.org ||rel="noopener noreferrer" target="_blank"]])101 +Adoption of the three-number semantic versioning standard for [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] [[artefacts>>doc:sdmx:Glossary 2\.1.Artefact.WebHome]] ([[__https:~~/~~/semver.org__>>https://https:semver.org]]) 102 102 103 103 (% class="wikigeneratedid" id="HRESTWebServicesApplicationProgrammingInterface28API29" %) 104 104 **REST Web Services Application Programming Interface (API)** ... ... @@ -137,11 +137,11 @@ 137 137 (% class="wikigeneratedid" id="HInformationModel-1" %) 138 138 **Information Model** 139 139 140 -* Addition of Dimension Constraint property to a Dataflow 141 -* Addition of evolving structure property to a Data Structure Definition 142 -* Remove [[version>>doc:sdmx:Glossary 2\.1.Version.WebHome]] property on Categorisation 140 +* Addition of Dimension Constraint property to a [[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] 141 +* Addition of evolving structure property to a [[Data Structure Definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] 142 +* Remove [[version>>doc:sdmx:Glossary 2\.1.Version.WebHome]] property on [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]] 143 143 * Simplification of Constraints 144 -** Removal of Advanced Release Calendar 144 +** Removal of Advanced [[Release Calendar>>doc:sdmx:Glossary 2\.1.Release policy - release calendar.WebHome]] 145 145 ** Removal of Role, Data Constraints only restrict data that can be reported 146 146 ** Restrict [[constraint>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] targets to Identifiable structures (not URLs) 147 147 ** Addition of Availability Constraint to define actual data ... ... @@ -159,7 +159,7 @@ 159 159 160 160 [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] identifies three basic process patterns regarding the exchange of statistical data and metadata. These can be described as follows: 161 161 162 -1. //**Bilateral exchange**~:// All aspects of the exchange process are agreed between counterparties, including the mechanism for exchange of data and metadata, the formats, the frequency or schedule, and the mode used for communications regarding the exchange. This is perhaps the most common process pattern. 162 +1. //**[[Bilateral exchange>>doc:sdmx:Glossary 2\.1.Bilateral exchange.WebHome]]**~:// All aspects of the exchange process are agreed between counterparties, including the mechanism for exchange of data and metadata, the formats, the frequency or schedule, and the mode used for communications regarding the exchange. This is perhaps the most common process pattern. 163 163 1. //**Gateway exchange**~:// Gateway exchanges are an organized set of [[bilateral exchanges>>doc:sdmx:Glossary 2\.1.Bilateral exchange.WebHome]], in which several data and metadata collecting organizations or individuals agree to exchange the collected information with each other in a single, known format, and according to a single, known process. This pattern has the effect of reducing the burden of managing multiple [[bilateral exchanges>>doc:sdmx:Glossary 2\.1.Bilateral exchange.WebHome]] (in data and metadata collection) across the sharing organizations/individuals. This is also a very common process pattern in the statistical area, where communities of institutions agree on ways to gain efficiencies within the scope of their collective responsibilities. 164 164 1. //**Data-sharing exchange**~:// Open, freely available data formats and process patterns are known and standard. Thus, any organization or individual can use any counterparty’s data and metadata (assuming they are permitted access to it). This model requires no bilateral agreement, but only requires that data and metadata providers and consumers adhere to the standards. 165 165 ... ... @@ -237,7 +237,7 @@ 237 237 * //**[[Concept Scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]:**// A [[concept scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] is a maintained list of [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] that are used in [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and [[metadata structure definitions>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]. There can be many such [[concept schemes>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]. A “core” [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] of the [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] can be specified (e.g. a core [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]], or other [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] such as “date”). Note that this core [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] can be overridden in the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] or [[metadata structure definition>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]] that uses the [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]]. Indeed, organisations wishing to remain with version 1.0 key family schema specifications will continue to declare the [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] in the key family definition. 238 238 * //**[[Metadata Set>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]]:**// A [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] set is a set of information pertaining to an object within the formal [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] view of statistical exchange: they may describe the maintainers of data or structural definitions; they may describe the schedule on which data is released; they may describe the flow of a single type of data over time; they may describe the quality of data, etc. In [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]], the creators of [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] may take whatever [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] they are concerned with, or obliged to report, and provide a [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] set containing that information. 239 239 * //**[[Metadata Structure Definition>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]:**// A [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] set also has a set of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] which describes how it is organized. This [[metadata set>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]] identifies what [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] are being reported, how these [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] relate to each other (typically as [[hierarchies>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]]), what their presentational structure is, how they may be represented (as free text, as coded values, etc.), and with which formal [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] object types they are associated. 240 -* //**[[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] Definition:**// In [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]], [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] are reported or disseminated according to a [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition. The [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition identifies the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and may be associated with one or more subject matter domains via a [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]] (this facilitates the search for data according to organised [[category schemes>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]]). [[Constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]], in terms of reporting [[periodicity>>doc: sdmx:Glossary 2\.1.Frequency of observation.WebHome]] or sub set of possible keys that are allowed in a [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]], may be attached to the [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition.240 +* //**[[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] Definition:**// In [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]], [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] are reported or disseminated according to a [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition. The [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition identifies the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and may be associated with one or more subject matter domains via a [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]] (this facilitates the search for data according to organised [[category schemes>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]]). [[Constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]], in terms of reporting [[periodicity>>doc:Glossary 2\.1.Frequency of observation.WebHome]] or sub set of possible keys that are allowed in a [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]], may be attached to the [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition. 241 241 * //**[[Metadataflow>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]] Definition:**// A [[metadata flow>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]] definition is very similar to a [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition, but describes, categorises, and constrains [[metadata sets>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]]. 242 242 * //**[[Data Provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]]: **//An organization which produces data is termed a [[data provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]]. 243 243 * //**Metadata Provider: **//An organization which produces [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] is termed a metadata provider. ... ... @@ -273,7 +273,7 @@ 273 273 274 274 Web services allow computer applications to exchange data directly over the Internet, essentially allowing modular or distributed computing in a more flexible fashion than ever before. In order to allow web services to function, however, many standards are required: for requesting and supplying data; for expressing the enveloping data which is used to package exchanged data; for describing web services to one another, to allow for easy integration into applications that use other web services as data resources. 275 275 276 -Version 3.1 has standardized on RESTful web services with a OpenAPI specification published on the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Working Group’s GitHub repository [[__https:~~/~~/github.com/sdmx-twg__>>https://https:github.comsdmx-twg ||rel="noopener noreferrer" target="_blank"]].276 +Version 3.1 has standardized on RESTful web services with a OpenAPI specification published on the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Working Group’s GitHub repository [[__https:~~/~~/github.com/sdmx-twg__>>https://https:github.comsdmx-twg]]. 277 277 278 278 There are five ‘resources’: 279 279 ... ... @@ -284,7 +284,7 @@ 284 284 * metadata – retrieval of [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] 285 285 * registration – retrieval of data locations (URL) for specific [[provision agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]] 286 286 287 -The following conceptual example uses the ‘data’ resource to query a data repository for a [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] identified by the key ‘M.USD.EUR.SP00.A’ in the EXR (ECB exchange rates) [[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]: [[https:~~/~~/ws-entry-point/data/dataflow/ECB/EXR/1.0.0/M.USD.EUR.SP00.A>>https://https:ws-entry-pointdatadataflowECBEXR1.0.0M.USD.EUR.SP00.A]]287 +The following conceptual example uses the ‘data’ resource to query a data repository for a [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] identified by the key ‘M.USD.EUR.SP00.A’ in the EXR (ECB exchange rates) [[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]: https:~/~/ws-entry-point/data/dataflow/ECB/EXR/1.0.0/M.USD.EUR.SP00.A 288 288 289 289 = 4 The SDMX Information Model = 290 290 ... ... @@ -374,7 +374,7 @@ 374 374 375 375 The Metadata Common Vocabulary is an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] guideline which provides definition of terms to be used for the comparison and mapping of terminology found in [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and in other aspects of statistical metadata management. Essentially, it provides ISOcompliant definitions for a wide range of statistical terms, which may be used directly, or against which other terminology systems may be mapped. This set of terms is inclusive of the terminology used within the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Standards. 376 376 377 -The MCV provides definitions for terms on which the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Cross-Domain Metadata (% style="color:#e74c3c"%)Concepts(%%)work is built.377 +The MCV provides definitions for terms on which the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Cross-Domain Metadata [[Concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] work is built. 378 378 379 379 == 6.3 Statistical Subject-Matter Domains == 380 380 ... ... @@ -384,13 +384,13 @@ 384 384 385 385 == 6.4 SDMX Concept Roles == 386 386 387 -These guidelines define the standard set of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] Roles and their use. This set of standard [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] are implemented as a [[cross-domain Concept>>doc:sdmx:Glossary 2\.1.Cross-domain concept.WebHome]] Scheme that defines the set of [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] roles and gives examples on [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] role implementation in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 2.0, 2.1 and 3.0. A [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] role gives a particular context to a [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] for easy and systematic interpretation by machine processing and visualization tools. For example, the [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] REPORTING_AREA and COUNTERPART_AREA are different [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] but they are both geographical characteristics, therefore they can be associated with the same [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] role ID: "GEO". This allows visualization systems to interpret these [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] as geographical data in order to generate maps. The implementation of [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] roles is different in versions 2.0 and 2.1/3.0 of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] technical standard. Specifically for [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0, this set of roles is considered a normative list that must be interpreted in the same way by all organisations. Additional roles may be provided via the standard roles’ mechanism in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0, i.e., via [[Concept Schemes>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]; the semantics of these roles have to be agreed bilateraly in [[data exchanges>>doc:sdmx:Glossary 2\.1.Data exchange.WebHome]]. The [[Concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] Roles are available as an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Concept Scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] on the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Global Registry>>doc:sdmx:Glossary 2\.1.Global registry.WebHome]]. 387 +These guidelines define the standard set of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] Roles and their use. This set of standard [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] are implemented as a [[cross-domain Concept>>doc:sdmx:Glossary 2\.1.Cross-domain concept.WebHome]] Scheme that defines the set of [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] roles and gives examples on [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] role implementation in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 2.0, 2.1 and 3.0. A [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] role gives a particular context to a [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] for easy and systematic interpretation by machine processing and visualization tools. For example, the [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] REPORTING_AREA and COUNTERPART_AREA are different [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] but they are both geographical characteristics, therefore they can be associated with the same [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] role ID: "GEO". This allows visualization systems to interpret these [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] as geographical data in order to generate [[maps>>doc:sdmx:Glossary 2\.1.Map.WebHome]]. The implementation of [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] roles is different in [[versions>>doc:sdmx:Glossary 2\.1.Version.WebHome]] 2.0 and 2.1/3.0 of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] technical standard. Specifically for [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0, this set of roles is considered a normative list that must be interpreted in the same way by all organisations. Additional roles may be provided via the standard roles’ mechanism in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0, i.e., via [[Concept Schemes>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]; the semantics of these roles have to be agreed bilateraly in [[data exchanges>>doc:sdmx:Glossary 2\.1.Data exchange.WebHome]]. The [[Concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] Roles are available as an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Concept Scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] on the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Global Registry>>doc:sdmx:Glossary 2\.1.Global registry.WebHome]]. 388 388 389 389 = 7 Validation and Transformation Language = 390 390 391 391 For many years the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] initiative has been fostering and supporting the development of a standard calculation [[language>>doc:sdmx:Glossary 2\.1.Language.WebHome]], called [[Validation and Transformation Language>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] ([[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]]). A blueprint for defining calculations was already described in the original [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 2.1 specifications (package 13 of the Information Model - “Transformations and Expressions”). It was just a basic framework that required further developments to became operational in order to achieve a calculation [[language>>doc:sdmx:Glossary 2\.1.Language.WebHome]] able to manipulate [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[artefacts>>doc:sdmx:Glossary 2\.1.Artefact.WebHome]]. 392 392 393 -These developments started in late 2012 and were put in charge of the [[Validation and Transformation Language>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] Task Force ([[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] TF), which included members of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Working Group (TWG) and Statistical Working Group (SWG), besides experts coming from the DDI and GSIM communities. The intent was to define a standard [[language>>doc:sdmx:Glossary 2\.1.Language.WebHome]] to be implemented in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] and applicable also to GSIM and DDI. This brought to the publication of the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 1.0 in 2015. Then new requirements came from a number of proofs of (% style="color:#e74c3c" %)concepts(%%)and tests of [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 1.0 made by several organisations and triggered a large improvement of the [[language>>doc:sdmx:Glossary 2\.1.Language.WebHome]]. A new provisional(% style="color:#e74c3c" %)version(%%), the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 1.1, was released in public consultation in 2017. The high number of [[comments>>doc:sdmx:Glossary 2\.1.Comment.WebHome]] received triggered another phase of intensive work, with the main goal of achieving a more robust and forward compatible(% style="color:#e74c3c" %)version(%%). Finally, the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 2.0 was published between April and July 2018 (see the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] website).393 +These developments started in late 2012 and were put in charge of the [[Validation and Transformation Language>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] Task Force ([[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] TF), which included members of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] Technical Working Group (TWG) and Statistical Working Group (SWG), besides experts coming from the DDI and GSIM communities. The intent was to define a standard [[language>>doc:sdmx:Glossary 2\.1.Language.WebHome]] to be implemented in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] and applicable also to GSIM and DDI. This brought to the publication of the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 1.0 in 2015. Then new requirements came from a number of proofs of concepts and tests of [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 1.0 made by several organisations and triggered a large improvement of the [[language>>doc:sdmx:Glossary 2\.1.Language.WebHome]]. A new provisional version, the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 1.1, was released in public consultation in 2017. The high number of [[comments>>doc:sdmx:Glossary 2\.1.Comment.WebHome]] received triggered another phase of intensive work, with the main goal of achieving a more robust and forward compatible version. Finally, the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 2.0 was published between April and July 2018 (see the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] website). 394 394 395 395 The implementation of the [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 2.0 in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] started in late 2018 and was published as an incremental revision to the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 2.1 standards in July 2020. It allows users to write [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] 2.0 programs for validating and transforming [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] data, to store these programs in a [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] metadata registry and to exchange them through [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] messages, also together the definition of the data structures of the involved data. 396 396