Changes for page SDMX 3.1 Standards. Section 1. Framework

Last modified by Helena K. on 2026/06/08 15:16

From 25.7 to 25.8 From 25.16 to 25.17

From version 25.8

edited by Helena K.
on 2026/06/03 13:21

Change comment: There is no comment for this version

To version 25.16

edited by Helena K.
on 2026/06/03 13:39

Change comment: There is no comment for this version

Raw
Rendered

Summary

Page properties (1 modified, 0 added, 0 removed)

Details

Page properties

Content

@@ -95,7 +95,7 @@
  * Support for [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] list extension and discriminated union of [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] lists
  * Improvements to structure mapping
  * Improvements to [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] [[hierarchies>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]] for data discovery
--* Improvements to constraints
++* Improvements to [[constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]]
  (% class="wikigeneratedid" id="HVersioningofStructuralMetadataArtefacts" %)
  **Versioning of Structural Metadata Artefacts**
@@ -141,12 +141,12 @@
  * Addition of [[Dimension>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]] Constraint property to a [[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]
  * Addition of evolving structure property to a [[Data Structure Definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]
--* Remove version property on [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]]
--* Simplification of Constraints
++* Remove [[version>>doc:sdmx:Glossary 2\.1.Version.WebHome]] property on [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]]
++* Simplification of [[Constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]]
  ** Removal of Advanced [[Release Calendar>>doc:sdmx:Glossary 2\.1.Release policy - release calendar.WebHome]]
--** Removal of Role, Data Constraints only restrict data that can be reported
--** Restrict constraint targets to Identifiable structures (not URLs)
--** Addition of Availability Constraint to define actual data
++** Removal of Role, Data [[Constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] only restrict data that can be reported
++** Restrict [[constraint>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] targets to Identifiable structures (not URLs)
++** Addition of Availability [[Constraint>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] to define actual data
  (% class="wikigeneratedid" id="HDocumentation" %)
  **Documentation**
@@ -159,7 +159,6 @@
  == 3.1 Process Patterns ==
--
  [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] identifies three basic process patterns regarding the exchange of statistical data and metadata. These can be described as follows:
 . //**[[Bilateral exchange>>doc:sdmx:Glossary 2\.1.Bilateral exchange.WebHome]]**~:// All aspects of the exchange process are agreed between counterparties, including the mechanism for exchange of data and metadata, the formats, the frequency or schedule, and the mode used for communications regarding the exchange. This is perhaps the most common process pattern.
@@ -179,11 +179,11 @@
  == 3.3 Statistical Data and Metadata ==
--To avoid confusion about which "data" and "metadata" are the intended content of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] formats specified here, a statement of scope is offered. Statistical "data" are sets of often numeric observations which typically have time associated with them. They are associated with a set of metadata values, representing specific (% style="color:#e74c3c" %)concepts(%%), which act as identifiers and descriptors of the data. These metadata values and (% style="color:#e74c3c" %)concepts(%%) can be understood as the named [[dimensions>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]] of a multi-dimensional co-ordinate system, describing what is often called a "cube" of data.
++To avoid confusion about which "data" and "metadata" are the intended content of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] formats specified here, a statement of scope is offered. Statistical "data" are sets of often numeric observations which typically have time associated with them. They are associated with a set of metadata values, representing specific concepts, which act as identifiers and descriptors of the data. These metadata values and concepts can be understood as the named [[dimensions>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]] of a multi-dimensional co-ordinate system, describing what is often called a "cube" of data.
  [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] identifies a standard technique for modelling, expressing, and understanding the structure of this multi-dimensional "cube", allowing automated processing of data from a variety of sources. This approach is widely applicable across types of data and attempts to provide the simplest and most easily comprehensible technique that will support the exchange of this broad set of data and related metadata.
--The term "metadata" is very broad indeed. A distinction can be made between “structural” metadata – those (% style="color:#e74c3c" %)concepts(%%) used in the description and identification of statistical data and metadata – and “reference” metadata – the larger set of (% style="color:#e74c3c" %)concepts(%%) that describe and qualify statistical [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] and processing more generally, and which are often associated not with specific observations or [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] of data, but with entire collections of data or even the institutions which provide that data.
++The term "metadata" is very broad indeed. A distinction can be made between “structural” metadata – those concepts used in the description and identification of statistical data and metadata – and “reference” metadata – the larger set of concepts that describe and qualify statistical [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] and processing more generally, and which are often associated not with specific observations or [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] of data, but with entire collections of data or even the institutions which provide that data.
  The [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]] provides for the structuring not only of data, but also of “reference” metadata. While these [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] structures exist independent of the data and its [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]], they are often linked. The [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]] provides for the attachment of [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] to any part of the data or [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]], as well as for the reporting and exchange of the [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] and its structural descriptions. This function of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] standards supports many aspects of data quality initiatives, allowing as it does for the exchange of metadata in its broadest sense, of which quality-related metadata is a major part.
@@ -197,7 +197,7 @@
  This document specifies the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] standards designed to facilitate exchanges based on any of these process patterns, and shows how [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] offers advantages in all cases. It is possible to agree bilaterally to use a standard format (such as [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] or [[SDMX-JSON>>doc:sdmx:Glossary 2\.1.SDMX-JSON.WebHome]]); it is possible for data senders in a gateway process to use a standard format for [[data exchange>>doc:sdmx:Glossary 2\.1.Data exchange.WebHome]] with each other, or with any [[data providers>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]] who agree to do so; it is possible to agree to use the full set of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] standards to support a common data-sharing process of exchange, whether based on an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]-conformant registry or some other architecture.
--The standards specified here specifically support a data-sharing process based on the use of central registry services. Registry services provide visibility into the data and metadata existing within the community, and support the access and use of this data and metadata by providing a set of triggers for automated processing. The data or metadata itself is not stored in a central registry – these services merely provide a useful set of metadata about the data (and additional metadata) in a known location, so that users/applications can easily locate and obtain whatever data and/or metadata is registered. The use of standards for all data, metadata, and the registry services themselves is ubiquitous, permitting a high (% style="color:#e74c3c" %)level(%%) of automation within a data-sharing community.
++The standards specified here specifically support a data-sharing process based on the use of central registry services. Registry services provide visibility into the data and metadata existing within the community, and support the access and use of this data and metadata by providing a set of triggers for automated processing. The data or metadata itself is not stored in a central registry – these services merely provide a useful set of metadata about the data (and additional metadata) in a known location, so that users/applications can easily locate and obtain whatever data and/or metadata is registered. The use of standards for all data, metadata, and the registry services themselves is ubiquitous, permitting a high level of automation within a data-sharing community.
  It should be pointed out that these different process models are not mutually exclusive – a single system capable of expressing data and metadata in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]-conformant formats could support all three scenarios. Different standards may be applicable to different processes (for example, many registry services interfaces are used only in a data-sharing scenario) but all have a common basis in a shared information model.
@@ -221,9 +221,9 @@
  [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] allows for the publication of statistical data (and the related [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]) but also provided for the standard, systematic [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] of [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]]. In (% style="color:#e74c3c" %)version(%%) 2.1, [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] were reported independent of the statistical data.
--However, in 3.0 [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] associated directly with data such as footnotes are reported as [[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] of the [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]. For other [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]], principally that linked to structures like “(% style="color:#e74c3c" %)concepts(%%)”, [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] provides reference "[[metadata sets>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]]", "[[metadata structure definitions>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]", and "[[metadata flows>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]]". These objects are very similar to [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]], [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]], and [[data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]], but concern [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] rather than statistical observations. In the same way that [[data providers>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]] may publish statistical data, they may also publish [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]]. Metadata structural definitions are maintained by agencies in a fashion similar to the way that agencies maintain [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]], the structural definitions of [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]].
++However, in 3.0 [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] associated directly with data such as footnotes are reported as [[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] of the [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]. For other [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]], principally that linked to structures like “[[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]]”, [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] provides reference "[[metadata sets>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]]", "[[metadata structure definitions>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]", and "[[metadata flows>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]]". These objects are very similar to [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]], [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]], and [[data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]], but concern [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] rather than statistical observations. In the same way that [[data providers>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]] may publish statistical data, they may also publish [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]]. Metadata structural definitions are maintained by agencies in a fashion similar to the way that agencies maintain [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]], the structural definitions of [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]].
--The structural definitions of both data and [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] associate specific statistical (% style="color:#e74c3c" %)concepts(%%) with their [[representations>>doc:sdmx:Glossary 2\.1.Representation.WebHome]], whether textual, coded, etc. These (% style="color:#e74c3c" %)concepts(%%) are taken from a "[[concept scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]" which is maintained by a specific agency. [[Concept schemes>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] group a set of (% style="color:#e74c3c" %)concepts(%%), provide their definitions and names, and allow for semantic relationships to be expressed, when some (% style="color:#e74c3c" %)concepts(%%) are specializations of others. It is possible for a single [[concept scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] to be used both for data structures - key families - and for [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] structures.
++The structural definitions of both data and [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] associate specific statistical [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] with their [[representations>>doc:sdmx:Glossary 2\.1.Representation.WebHome]], whether textual, coded, etc. These [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] are taken from a "[[concept scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]" which is maintained by a specific agency. [[Concept schemes>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] group a set of [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]], provide their definitions and names, and allow for semantic relationships to be expressed, when some [[concepts>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] are specializations of others. It is possible for a single [[concept scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] to be used both for data structures - key families - and for [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] structures.
  Inherent in any statistical exchange – and in many dissemination activities – is a (% style="color:#e74c3c" %)concept(%%) of "service (% style="color:#e74c3c" %)level(%%) agreement", even if this is not formalized or made explicit. [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] incorporates this idea in objects termed "[[provision agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]]". [[Data providers>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]] may provide data to many different [[data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]. [[Data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] may incorporate data coming from more than one [[data provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]]. [[Provision agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]] are the objects which tell you which [[data providers>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]] are supplying what data to which [[data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]. Similarly, metadata [[provision agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]] for [[metadata flows>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]].
@@ -238,10 +238,9 @@
  * //**Organisation Scheme:**// Organisations and organisation structure can be defined in an Organisation Scheme. Specific Organisation Schemes exist for [[Maintenance Agency>>doc:sdmx:Glossary 2\.1.Maintenance agency.WebHome]], [[Data Provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]], Metadata Provider, [[Data Consumer>>doc:sdmx:Glossary 2\.1.Data consumer.WebHome]], and Organisation [[Unit>>doc:sdmx:Glossary 2\.1.Statistical unit.WebHome]].
  * //**[[Category Scheme>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]] and [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]]:**// [[Category schemes>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]] are made up of a [[hierarchy>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]] of [[categories>>doc:sdmx:Glossary 2\.1.Category.WebHome]], which in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] may include any type of useful [[classification>>doc:sdmx:Glossary 2\.1.Statistical Classification.WebHome]] for the organization of data and metadata. A [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]] links a [[category>>doc:sdmx:Glossary 2\.1.Category.WebHome]] to an identifiable object. In this way sets of objects can be categorised. A statistical subjectmatter domain scheme is implemented in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] as a [[Category Scheme>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]].
  * //**[[Concept Scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]:**// A [[concept scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] is a maintained list of (% style="color:#e74c3c" %)concepts(%%) that are used in [[data structure definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and [[metadata structure definitions>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]. There can be many such [[concept schemes>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]. A “core” [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] of the (% style="color:#e74c3c" %)concept(%%) can be specified (e.g. a core [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] list, or other [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] such as “date”). Note that this core [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] can be overridden in the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] or [[metadata structure definition>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]] that uses the (% style="color:#e74c3c" %)concept(%%). Indeed, organisations wishing to remain with (% style="color:#e74c3c" %)version(%%) 1.0 key family schema specifications will continue to declare the [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] in the key family definition.
--*
  * //**[[Metadata Set>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]]:**// A [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] set is a set of information pertaining to an object within the formal [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] view of statistical exchange: they may describe the maintainers of data or structural definitions; they may describe the schedule on which data is released; they may describe the flow of a single type of data over time; they may describe the quality of data, etc. In [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]], the creators of [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] may take whatever (% style="color:#e74c3c" %)concepts(%%) they are concerned with, or obliged to report, and provide a [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] set containing that information.
  * //**[[Metadata Structure Definition>>doc:sdmx:Glossary 2\.1.Metadata structure definition.WebHome]]:**// A [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] set also has a set of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] which describes how it is organized. This [[metadata set>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]] identifies what [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] (% style="color:#e74c3c" %)concepts(%%) are being reported, how these (% style="color:#e74c3c" %)concepts(%%) relate to each other (typically as [[hierarchies>>doc:sdmx:Glossary 2\.1.Hierarchy.WebHome]]), what their presentational structure is, how they may be represented (as free text, as coded values, etc.), and with which formal [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] object types they are associated.
--* //**[[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] Definition:**// In [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]], [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] are reported or disseminated according to a [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition. The [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition identifies the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and may be associated with one or more subject matter domains via a [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]] (this facilitates the search for data according to organised [[category schemes>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]]). (% style="color:#e74c3c" %)Constraints(%%), in terms of reporting [[periodicity>>doc:sdmx:Glossary 2\.1.Frequency of observation.WebHome]] or sub set of possible keys that are allowed in a [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]], may be attached to the [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition.
++* //**[[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] Definition:**// In [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]], [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] are reported or disseminated according to a [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition. The [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition identifies the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and may be associated with one or more subject matter domains via a [[Categorisation>>doc:sdmx:Glossary 2\.1.Categorisation.WebHome]] (this facilitates the search for data according to organised [[category schemes>>doc:sdmx:Glossary 2\.1.Category scheme.WebHome]]). [[Constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]], in terms of reporting [[periodicity>>doc:sdmx:Glossary 2\.1.Frequency of observation.WebHome]] or sub set of possible keys that are allowed in a [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]], may be attached to the [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition.
  * //**[[Metadataflow>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]] Definition:**// A [[metadata flow>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]] definition is very similar to a [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] definition, but describes, categorises, and constrains [[metadata sets>>doc:sdmx:Glossary 2\.1.Metadata set.WebHome]].
  * //**[[Data Provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]]: **//An organization which produces data is termed a [[data provider>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]].
  * //**Metadata Provider: **//An organization which produces [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] is termed a metadata provider.
@@ -297,7 +297,7 @@
  [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] recognizes that statistical data is structured; in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] this structure is termed a [[Data Structure Definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]. “[[Data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]” are made up of one or more lower-(% style="color:#e74c3c" %)level(%%) “groups”, based on their degrees of similarity. Each group is in turn comprised of one or more “[[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]]” of data. Each [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] or section has a “key” - values for each of a cluster of (% style="color:#e74c3c" %)concepts(%%), also called "[[dimensions>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]]" - which identifies it, and one or more “observations”, which typically combine the time of the observation, and the value of the observation (e.g., measurement). Additionally, metadata may be attached at any (% style="color:#e74c3c" %)level(%%) of this structure as descriptive “[[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]]”. [[Code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] lists (enumerations) and other patterns for [[representation>>doc:sdmx:Glossary 2\.1.Representation.WebHome]] of data and metadata are also modelled.
--There is some similarity between “cube” structures commonly used to process statistical data, and the [[Data Structure Definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] idea in the [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]]. It is important to note that the data as structured according to the [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]] is optimized for exchange, potentially with partners who may have no ability to process a “cube” of data coming from complex statistical systems. [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[time series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] can be understood as “slices” of the cube. Such a slice is identified by its key. A "[[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]]" key consists of the values for all [[dimensions>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]] specified by the key family except time. Thus, it is possible to reconstruct and describe data cubes from [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]-structured data, and to exchange such databases using the interfaces and formats provided for that purpose in the standard. Additional objects such as [[hierarchical code>>doc:sdmx:Glossary 2\.1.Hierarchical code.WebHome]] lists, (% style="color:#e74c3c" %)constraints(%%) and structure (% style="color:#e74c3c" %)maps(%%) make it possible to more fully model the structure of cubes.
++There is some similarity between “cube” structures commonly used to process statistical data, and the [[Data Structure Definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] idea in the [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]]. It is important to note that the data as structured according to the [[SDMX Information Model>>doc:sdmx:Glossary 2\.1.SDMX Information Model.WebHome]] is optimized for exchange, potentially with partners who may have no ability to process a “cube” of data coming from complex statistical systems. [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[time series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] can be understood as “slices” of the cube. Such a slice is identified by its key. A "[[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]]" key consists of the values for all [[dimensions>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]] specified by the key family except time. Thus, it is possible to reconstruct and describe data cubes from [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]-structured data, and to exchange such databases using the interfaces and formats provided for that purpose in the standard. Additional objects such as [[hierarchical code>>doc:sdmx:Glossary 2\.1.Hierarchical code.WebHome]] lists, [[constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] and structure (% style="color:#e74c3c" %)maps(%%) make it possible to more fully model the structure of cubes.
  The information model also provides a view of [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]]: a mechanism for referencing the meaningful “objects” within the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] view of statistical exchange processes ([[data providers>>doc:sdmx:Glossary 2\.1.Data provider.WebHome]], structures, [[provisioning agreements>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]], [[dataflows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]], [[metadata flows>>doc:sdmx:Glossary 2\.1.Metadataflow.WebHome]], etc.) to which metadata is attached; a mechanism for describing a set of meaningful (% style="color:#e74c3c" %)concepts(%%), of organizing them into a presentational structure, and of indicating how their values are represented. This is based on a simple, hierarchical view of [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] which is common to many metadata systems and [[classification>>doc:sdmx:Glossary 2\.1.Statistical Classification.WebHome]]/categorization schemes. [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] provides a model (and XML and JSON formats) for both describing [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] structures, and of reporting [[reference metadata>>doc:sdmx:Glossary 2\.1.Reference metadata.WebHome]] according to those structures.
@@ -316,7 +316,7 @@
  There are four distinct types of message:
--1. //**Structure Definition**~:// For the exchange of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]. A [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] structure message can carry details of any number and combination of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] [[artefacts>>doc:sdmx:Glossary 2\.1.Artefact.WebHome]] like DSDs, [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] lists and (% style="color:#e74c3c" %)constraints(%%).
++1. //**Structure Definition**~:// For the exchange of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]. A [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] structure message can carry details of any number and combination of [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]] [[artefacts>>doc:sdmx:Glossary 2\.1.Artefact.WebHome]] like DSDs, [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] lists and [[constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]].
 . //**Structure-specific Data**~:// For the exchange of data. This format is specific to the [[Data Structure Definitions>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] of the [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] (in other terms, it is [[DSD>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]-specific) and is created by following mappings between the metadata constructs defined in the Structure Definition message and the technical specification of the format. It supports the exchange of large [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] in XML format, provides strict validation of conformance with the [[DSD>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] using a generic XML parser, and supports the transmission of partial [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] ([[incremental updates>>doc:sdmx:Glossary 2\.1.Incremental update.WebHome]]) as well as whole [[data sets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]].
  Many XML tools and technologies have expectations about the functions performed by an XML schema, one of which is a very direct relationship between the XML constructs described in the XML schema and the tagged data in the XML instance. Strong data typing is also considered normal, supporting full validation of the tagged data. These message types are designed to support validation and other expected XML schema functions.
@@ -392,7 +392,7 @@
  == 6.4 SDMX Concept Roles ==
--These guidelines define the standard set of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] (% style="color:#e74c3c" %)Concept(%%) Roles and their use. This set of standard [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] (% style="color:#e74c3c" %)Concepts(%%) are implemented as a [[cross-domain Concept>>doc:sdmx:Glossary 2\.1.Cross-domain concept.WebHome]] Scheme that defines the set of (% style="color:#e74c3c" %)concept(%%) roles and gives examples on (% style="color:#e74c3c" %)concept(%%) role implementation in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 2.0, 2.1 and 3.0. A (% style="color:#e74c3c" %)concept(%%) role gives a particular context to a (% style="color:#e74c3c" %)concept(%%) for easy and systematic interpretation by machine processing and visualization tools. For example, the (% style="color:#e74c3c" %)concepts(%%) REPORTING_AREA and COUNTERPART_AREA are different (% style="color:#e74c3c" %)concepts(%%) but they are both geographical characteristics, therefore they can be associated with the same (% style="color:#e74c3c" %)concept(%%) role ID: "GEO". This allows visualization systems to interpret these (% style="color:#e74c3c" %)concepts(%%) as geographical data in order to generate (% style="color:#e74c3c" %)maps(%%). The implementation of (% style="color:#e74c3c" %)concept(%%) roles is different in (% style="color:#e74c3c" %)versions(%%) 2.0 and 2.1/3.0 of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] technical standard. Specifically for [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0, this set of roles is considered a normative list that must be interpreted in the same way by all organisations. Additional roles may be provided via the standard roles’ mechanism in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0, i.e., via [[Concept Schemes>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]; the semantics of these roles have to be agreed bilateraly in [[data exchanges>>doc:sdmx:Glossary 2\.1.Data exchange.WebHome]]. The (% style="color:#e74c3c" %)Concept(%%) Roles are available as an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Concept Scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] on the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Global Registry>>doc:sdmx:Glossary 2\.1.Global registry.WebHome]].
++These guidelines define the standard set of [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] (% style="color:#e74c3c" %)Concept(%%) Roles and their use. This set of standard [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] (% style="color:#e74c3c" %)Concepts(%%) are implemented as a [[cross-domain Concept>>doc:sdmx:Glossary 2\.1.Cross-domain concept.WebHome]] Scheme that defines the set of (% style="color:#e74c3c" %)concept(%%) roles and gives examples on (% style="color:#e74c3c" %)concept(%%) role implementation in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 2.0, 2.1 and 3.0. A (% style="color:#e74c3c" %)concept(%%) role gives a particular context to a (% style="color:#e74c3c" %)concept(%%) for easy and systematic interpretation by machine processing and visualization tools. For example, the (% style="color:#e74c3c" %)concepts(%%) REPORTING_AREA and COUNTERPART_AREA are different (% style="color:#e74c3c" %)concepts(%%) but they are both geographical characteristics, therefore they can be associated with the same (% style="color:#e74c3c" %)concept(%%) role ID: "GEO". This allows visualization systems to interpret these (% style="color:#e74c3c" %)concepts(%%) as geographical data in order to generate (% style="color:#e74c3c" %)maps(%%). The implementation of (% style="color:#e74c3c" %)concept(%%) roles is different in [[versions>>doc:sdmx:Glossary 2\.1.Version.WebHome]] 2.0 and 2.1/3.0 of the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] technical standard. Specifically for [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0, this set of roles is considered a normative list that must be interpreted in the same way by all organisations. Additional roles may be provided via the standard roles’ mechanism in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0, i.e., via [[Concept Schemes>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]]; the semantics of these roles have to be agreed bilateraly in [[data exchanges>>doc:sdmx:Glossary 2\.1.Data exchange.WebHome]]. The (% style="color:#e74c3c" %)Concept(%%) Roles are available as an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Concept Scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] on the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Global Registry>>doc:sdmx:Glossary 2\.1.Global registry.WebHome]].
  = 7 Validation and Transformation Language =