Last modified by Artur K. on 2025/08/19 10:43

From version 11.13
edited by Helena K.
on 2025/05/21 23:54
Change comment: There is no comment for this version
To version 2.1
edited by Helena K.
on 2025/05/21 17:13
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -1,9 +1,5 @@
1 -{{box title="**Contents**"}}
2 -{{toc/}}
3 -{{/box}}
1 +Revision History
4 4  
5 -**Revision History**
6 -
7 7  |**Revision**|**Date**|**Contents**
8 8  | |April 2011|Initial release
9 9  |1.0|April 2013|Added section 9 - Transforming between versions of SDMX
... ... @@ -13,8 +13,10 @@
13 13  
14 14  == 1.1 Purpose ==
15 15  
16 -The intention of this document is to document certain aspects of SDMX that are important to understand and will aid implementation decisions. The explanations here supplement the information documented in the SDMX XML schema and the Information Model.
12 +The intention of this document is to document certain aspects of SDMX that are important to understand and will aid implementation decisions. The explanations here supplement the information documented in the SDMX XML schema and the
17 17  
14 +Information Model.
15 +
18 18  == 1.2 Structure ==
19 19  
20 20  This document is organized into the following major parts:
... ... @@ -39,7 +39,7 @@
39 39  
40 40  == 3.2 SDMX Information Model for Format Implementers ==
41 41  
42 -=== 3.2.1 Introduction ===
40 +=== 3.2.1 Introduction ===
43 43  
44 44  The purpose of this sub-section is to provide an introduction to the SDMX-IM relating to Data Structure Definitions and Data Sets for those whose primary interest is in the use of the XML or EDI formats.  For those wishing to have a deeper understanding of the Information Model, the full SDMX-IM document, and other sections in this guide provide a more in-depth view, along with UML diagrams and supporting explanation. For those who are unfamiliar with DSDs, an appendix to the SDMX-IM provides a tutorial which may serve as a useful introduction.
45 45  
... ... @@ -47,12 +47,16 @@
47 47  
48 48  The Data Structure Definition and Data Set parts of the information model are consistent with the GESMES/TS version 3.0 Data Model (called SDMX-EDI in the SDMX standard), with these exceptions:
49 49  
50 -* the “sibling group” construct has been generalized to permit any dimension or dimensions to be wildcarded, and not just frequency, as in GESMES/TS. It has been renamed a “group” to distinguish it from the “sibling group” where only frequency is wildcarded. The set of allowable partial “group” keys must be declared in the DSD, and attributes may be attached to any of these group keys;
51 -* furthermore, whilst the “group” has been retained for compatibility with version 2.0 and with SDMX-EDI, it has, at version 2.1, been replaced by the “Attribute Relationship” definition which is explained later
52 -* the section on data representation is now a convention, to support interoperability with EDIFACT-syntax implementations ( see section 3.3.2);
48 +the “sibling group” construct has been generalized to permit any dimension or dimensions to be wildcarded, and not just frequency, as in GESMES/TS. It has been renamed a “group” to distinguish it from the “sibling group” where only frequency is wildcarded. The set of allowable partial “group” keys must be declared in the DSD, and attributes may be attached to any of these group keys;
53 53  
54 -DSD-specific data formats are derived from the model, and some supporting features for declaring multiple measures have been added to the structural metadata descriptions Clearly, this is not a coincidence. The GESMES/TS Data Model provides the foundation for the EDIFACT messages in SDMX-EDI, and also is the starting point for the development of SDMX-ML.
50 +furthermore, whilst the group has been retained for compatibility with version 2.0 and with SDMX-EDI, it has, at version 2.1, been replaced by the “Attribute Relationship” definition which is explained later
55 55  
52 +the section on data representation is now a convention, to support interoperability with EDIFACT-syntax implementations ( see section 3.3.2);
53 +
54 +DSD-specific data formats are derived from the model, and some supporting features for declaring multiple measures have been added to the structural metadata descriptions
55 +
56 +Clearly, this is not a coincidence. The GESMES/TS Data Model provides the foundation for the EDIFACT messages in SDMX-EDI, and also is the starting point for the development of SDMX-ML.
57 +
56 56  Note that in the descriptions below, text in courier and italicised are the names used in the information model (e.g. //DataSet//).
57 57  
58 58  == 3.3 SDMX-ML and SDMX-EDI: Comparison of Expressive Capabilities and Function ==
... ... @@ -59,43 +59,55 @@
59 59  
60 60  SDMX offers several equivalent formats for describing data and structural metadata, optimized for use in different applications. Although all of these formats are derived directly from the SDM-IM, and are thus equivalent, the syntaxes used to express the model place some restrictions on their use. Also, different optimizations provide different capabilities. This section describes these differences, and provides some rules for applications which may need to support more than one SDMX format or syntax. This section is constrained to the Data Structure Definitionand the Date Set.
61 61  
62 -=== 3.3.1 Format Optimizations and Differences ===
64 +=== 3.3.1 Format Optimizations and Differences ===
63 63  
64 64  The following section provides a brief overview of the differences between the various SDMX formats.
65 65  
66 -Version 2.0 was characterised by 4 data messages, each with a distinct format: Generic, Compact, Cross-Sectional and Utility. Because of the design, data in some formats could not always be related to another format. In version 2.1, this issue has been addressed by merging some formats and eliminating others. As a result, in SDMX 2.1 there are just two types of data formats: //GenericData// and //StructureSpecificData// (i.e. specific to one Data Structure Definition).
68 +Version 2.0 was characterised by 4 data messages, each with a distinct format: Generic, Compact, Cross-Sectional and Utility. Because of the design, data in some formats could not always be related to another format. In version 2.1, this issue has been addressed by merging some formats and eliminating others. As a result, in
67 67  
70 +SDMX 2.1 there are just two types of data formats: //GenericData// and
71 +
72 +//StructureSpecificData// (i.e. specific to one Data Structure Definition).
73 +
68 68  Both of these formats are now flexible enough to allow for data to be oriented in series with any dimension used to disambiguate the observations (as opposed to only time or a cross sectional measure in version 2.0). The formats have also been expanded to allow for ungrouped observations.
69 69  
70 -To allow for applications which only understand time series data, variations of these formats have been introduced in the form of two data messages; //GenericTimeSeriesData// and //StructureSpecificTimeSeriesData//. It is important to note that these variations are built on the same root structure and can be processed in the same manner as the base format so that they do NOT introduce additional processing requirements.
76 +To allow for applications which only understand time series data, variations of these formats have been introduced in the form of two data messages;
71 71  
72 -**//Structure Definition//**
78 +//GenericTimeSeriesData// and //StructureSpecificTimeSeriesData//. It is important to note that these variations are built on the same root structure and can be processed in the same manner as the base format so that they do NOT introduce additional processing requirements.
73 73  
80 +=== //Structure Definition// ===
81 +
74 74  The SDMX-ML Structure Message supports the use of annotations to the structure, which is not supported by the SDMX-EDI syntax.
75 75  
76 76  The SDMX-ML Structure Message allows for the structures on which a Data Structure Definition depends – that is, codelists and concepts – to be either included in the message or to be referenced by the message containing the data structure definition. XML syntax is designed to leverage URIs and other Internet-based referencing mechanisms, and these are used in the SDMX-ML message. This option is not available to those using the SDMX-EDI structure message.
77 77  
78 -**//Validation//**
86 +=== //Validation// ===
79 79  
80 -SDMX-EDI – as is typical of EDIFACT syntax messages – leaves validation to dedicated applications (“validation” being the checking of syntax, data typing, and adherence of the data message to the structure as described in the structural definition.)
88 +SDMX-EDI – as is typical of EDIFACT syntax messages – leaves validation to dedicated applications (“validation” being the checking of syntax, data typing, and adherence of the data message to the structure as described in the structural
81 81  
90 +definition.)
91 +
82 82  The SDMX-ML Generic Data Message also leaves validation above the XML syntax level to the application.
83 83  
84 84  The SDMX-ML DSD-specific messages will allow validation of XML syntax and datatyping to be performed with a generic XML parser, and enforce agreement between the structural definition and the data to a moderate degree with the same tool.
85 85  
86 -//Update and Delete Messages and Documentation Messages//
96 +=== //Update and Delete Messages and Documentation Messages// ===
87 87  
88 88  All SDMX data messages allow for both delete messages and messages consisting of only data or only documentation.
89 89  
90 -**//Character Encodings//**
100 +=== //Character Encodings// ===
91 91  
92 -All SDMX-ML messages use the UTF-8 encoding, while SDMX-EDI uses the ISO 8879-1 character encoding. There is a greater capacity with UTF-8 to express some character sets (see the “APPENDIX: MAP OF ISO 8859-1 (UNOC) CHARACTER SET (LATIN 1 OR “WESTERN”) in the document “SYNTAX AND DOCUMENTATION VERSION 2.0”.) Many transformation tools are available which allow XML instances with UTF-8 encodings to be expressed as ISO 8879-1-encoded characters, and to transform UTF-8 into ISO 8879-1. Such tools should be used when transforming SDMX-ML messages into SDMX-EDI messages and vice-versa.
102 +All SDMX-ML messages use the UTF-8 encoding, while SDMX-EDI uses the ISO 8879-1 character encoding. There is a greater capacity with UTF-8 to express some character sets (see the “APPENDIX: MAP OF ISO 8859-1 (UNOC) CHARACTER
93 93  
94 -**//Data Typing//**
104 +SET (LATIN 1 OR “WESTERN”) in the document “SYNTAX AND
95 95  
106 +DOCUMENTATION VERSION 2.0”.) Many transformation tools are available which allow XML instances with UTF-8 encodings to be expressed as ISO 8879-1-encoded characters, and to transform UTF-8 into ISO 8879-1. Such tools should be used when transforming SDMX-ML messages into SDMX-EDI messages and vice-versa.
107 +
108 +=== //Data Typing// ===
109 +
96 96  The XML syntax and EDIFACT syntax have different data-typing mechanisms. The section below provides a set of conventions to be observed when support for messages in both syntaxes is required. For more information on the SDMX-ML representations of data, see below.
97 97  
98 -=== 3.3.2 Data Types ===
112 +==== 3.3.2 Data Types ====
99 99  
100 100  The XML syntax has a very different mechanism for data-typing than the EDIFACT syntax, and this difference may create some difficulties for applications which support both EDIFACT-based and XML-based SDMX data formats. This section provides a set of conventions for the expression in data in all formats, to allow for clean interoperability between them.
101 101  
... ... @@ -111,8 +111,7 @@
111 111  1*. Maximum 70 characters.
112 112  1*. From ISO 8859-1 character set (including accented characters)
113 113  1. **Descriptions **are:
114 -1*. Maximum 350 characters;
115 -1*. From ISO 8859-1 character set.
128 +1*. Maximum 350 characters;  From ISO 8859-1 character set.
116 116  1. **Code values** are:
117 117  1*. Maximum 18 characters;
118 118  1*. Any of A..Z (upper case alphabetic), 0..9 (numeric), _ (underscore), / (solidus, slash), = (equal sign), - (hyphen);
... ... @@ -121,43 +121,37 @@
121 121  
122 122  A..Z (upper case alphabetic), 0..9 (numeric), _ (underscore)
123 123  
124 -**5. Observation values** are:
137 +1. **Observation values** are:
138 +1*. Decimal numerics (signed only if they are negative);
139 +1*. The maximum number of significant figures is:
140 +1*. 15 for a positive number
141 +1*. 14 for a positive decimal or a negative integer
142 +1*. 13 for a negative decimal
143 +1*. Scientific notation may be used.
144 +1. **Uncoded statistical concept** text values are:
145 +1*.
146 +1**. Maximum 1050 characters;
147 +1**. From ISO 8859-1 character set.
148 +1. **Time series keys**:
125 125  
126 -* Decimal numerics (signed only if they are negative);
127 -* The maximum number of significant figures is:
128 -* 15 for a positive number
129 -* 14 for a positive decimal or a negative integer
130 -* 13 for a negative decimal
131 -* Scientific notation may be used.
150 +In principle, the maximum permissible length of time series keys used in a data exchange does not need to be restricted. However, for working purposes, an effort is made to limit the maximum length to 35 characters; in this length, also (for SDMXEDI) one (separator) position is included between all successive dimension values; this means that the maximum length allowed for a pure series key (concatenation of dimension values) can be less than 35 characters.  The separator character is a colon (“:”) by conventional usage.
132 132  
133 -**6. Uncoded statistical concept** text values are:
134 -
135 -* Maximum 1050 characters;
136 -* From ISO 8859-1 character set.
137 -
138 -**7. Time series keys**:
139 -
140 -In principle, the maximum permissible length of time series keys used in a data exchange does not need to be restricted. However, for working purposes, an effort is made to limit the maximum length to 35 characters; in this length, also (for SDMXEDI) one (separator) position is included between all successive dimension values; this means that the maximum length allowed for a pure series key (concatenation of dimension values) can be less than 35 characters. The separator character is a colon (“:”) by conventional usage.
141 -
142 142  == 3.4 SDMX-ML and SDMX-EDI Best Practices ==
143 143  
144 -=== 3.4.1 Reporting and Dissemination Guidelines ===
154 +=== 3.4.1 Reporting and Dissemination Guidelines ===
145 145  
146 -==== 3.4.1.1 Central Institutions and Their Role in Statistical Data Exchanges ====
156 +**3.4.1.1 Central Institutions and Their Role in Statistical Data Exchanges **Central institutions are the organisations to which other partner institutions "report" statistics. These statistics are used by central institutions either to compile aggregates and/or they are put together and made available in a uniform manner (e.g. on-line or on a CD-ROM or through file transfers). Therefore, central institutions receive data from other institutions and, usually, they also "disseminate" data to individual and/or institutions for end-use.  Within a country, a NSI or a national central bank (NCB) plays, of course, a central institution role as it collects data from other entities and it disseminates statistical information to end users. In SDMX the role of central institution is very important: every statistical message is based on underlying structural definitions (statistical concepts, code lists, DSDs) which have been devised by a particular agency, usually a central institution. Such an institution plays the role of the reference "structural definitions maintenance agency" for the corresponding messages which are exchanged. Of course, two institutions could exchange data using/referring to structural information devised by a third institution.
147 147  
148 -Central institutions are the organisations to which other partner institutions "report" statistics. These statistics are used by central institutions either to compile aggregates and/or they are put together and made available in a uniform manner (e.g. on-line or on a CD-ROM or through file transfers). Therefore, central institutions receive data from other institutions and, usually, they also "disseminate" data to individual and/or institutions for end-use.  Within a country, a NSI or a national central bank (NCB) plays, of course, a central institution role as it collects data from other entities and it disseminates statistical information to end users. In SDMX the role of central institution is very important: every statistical message is based on underlying structural definitions (statistical concepts, code lists, DSDs) which have been devised by a particular agency, usually a central institution. Such an institution plays the role of the reference "structural definitions maintenance agency" for the corresponding messages which are exchanged. Of course, two institutions could exchange data using/referring to structural information devised by a third institution.
149 -
150 150  Central institutions can play a double role:
151 151  
152 152  * collecting and further disseminating statistics;
153 153  * devising structural definitions for use in data exchanges.
154 154  
155 -==== 3.4.1.2 Defining Data Structure Definitions (DSDs) ====
163 +**3.4.1.2 Defining Data Structure Definitions (DSDs)**
156 156  
157 157  The following guidelines are suggested for building a DSD. However, it is expected that these guidelines will be considered by central institutions when devising new DSDs.
158 158  
159 -(% class="wikigeneratedid" id="HDimensions2CAttributesandCodeLists" %)
160 -__Dimensions, Attributes and Code Lists__
167 +=== Dimensions, Attributes and Code Lists ===
161 161  
162 162  **//Avoid dimensions that are not appropriate for all the series in the data structure definition.//**  If some dimensions are not applicable (this is evident from the need to have a code in a code list which is marked as “not applicable”, “not relevant” or “total”) for some series then consider moving these series to a new data structure definition in which these dimensions are dropped from the key structure. This is a judgement call as it is sometimes difficult to achieve this without increasing considerably the number of DSDs.
163 163  
... ... @@ -187,7 +187,7 @@
187 187  
188 188  The same code list can be used for several statistical concepts, within a data structure definition or across DSDs. Note that SDMX has recognised that these classifications are often quite large and the usage of codes in any one DSD is only a small extract of the full code list. In this version of the standard it is possible to exchange and disseminate a **partial code list** which is extracted from the full code list and which supports the dimension values valid for a particular DSD.
189 189  
190 -__Data Structure Definition Structure__
197 +=== Data Structure Definition Structure  ===
191 191  
192 192  The following items have to be specified by a structural definitions maintenance agency when defining a new data structure definition:
193 193  
... ... @@ -217,7 +217,7 @@
217 217  * code list name
218 218  * code values and descriptions
219 219  
220 -Definition of data flow definitions. Two (or more) partners performing data exchanges in a certain context need to agree on:
227 +Definition of data flow definitions.  Two (or more) partners performing data exchanges in a certain context need to agree on:
221 221  
222 222  * the list of data set identifiers they will be using;
223 223  * for each data flow:
... ... @@ -224,12 +224,10 @@
224 224  * its content and description
225 225  * the relevant DSD that defines the structure of the data reported or disseminated according the the dataflow definition
226 226  
227 -==== 3.4.1.3 Exchanging Attributes ====
234 +**3.4.1.3 Exchanging Attributes**
228 228  
229 -===== //3.4.1.3.1 Attributes on series, sibling and data set level // =====
236 +**//3.4.1.3.1 Attributes on series, sibling and data set level //**//Static properties//.
230 230  
231 -//Static properties//.
232 -
233 233  * Upon creation of a series the sender has to provide to the receiver values for all mandatory attributes. In case they are available, values for conditional attributes  should also be provided. Whereas initially this information may be provided by means other than SDMX-ML or SDMX-EDI messages (e.g. paper, telephone) it is expected that partner institutions will be in a position to provide this information in SDMX-ML or SDMX-EDI format over time.
234 234  * A centre may agree with its data exchange partners special procedures for authorising the setting of attributes' initial values.
235 235  * Attribute values at a data set level are set and maintained exclusively by the centre administrating the exchanged data set.
... ... @@ -246,21 +246,21 @@
246 246  * If the “observation status” changes and the observation remains unchanged, both components would have to be reported.
247 247  * For Data Structure Definitions having also the observation level attributes “observation confidentiality” and "observation pre-break" defined, this rule applies to these attribute as well: if an institution receives from another institution an observation with an observation status attribute only attached, this means that the associated observation confidentiality and prebreak observation attributes either never existed or from now they do not have a value for this observation.
248 248  
249 -=== 3.4.2 Best Practices for Batch Data Exchange ===
254 +==== 3.4.2 Best Practices for Batch Data Exchange ====
250 250  
251 -==== 3.4.2.1 Introduction ====
256 +**3.4.2.1 Introduction**
252 252  
253 253  Batch data exchange is the exchange and maintenance of entire databases between counterparties. It is an activity that often employs SDMX-EDI formats, and might also use the SDMX-ML DSD-specific data set. The following points apply equally to both formats.
254 254  
255 -==== 3.4.2.2 Positioning of the Dimension "Frequency" ====
260 +**3.4.2.2 Positioning of the Dimension "Frequency"**
256 256  
257 257  The position of the “frequency” dimension is unambiguously identified in the data structure definition. Moreover, most central institutions devising structural definitions have decided to assign to this dimension the first position in the key structure. This facilitates the easy identification of this dimension, something that it is necessary to frequency's crucial role in several database systems and in attaching attributes at the “sibling” group level.
258 258  
259 -==== 3.4.2.3 Identification of Data Structure Definitions (DSDs) ====
264 +**3.4.2.3 Identification of Data Structure Definitions (DSDs)**
260 260  
261 261  In order to facilitate the easy and immediate recognition of the structural definition maintenance agency that defined a data structure definition, most central institutions devising structural definitions use the first characters of the data structure definition identifiers to identify their institution: e.g. BIS_EER, EUROSTAT_BOP_01, ECB_BOP1, etc.
262 262  
263 -==== 3.4.2.4 Identification of the Data Flows ====
268 +**3.4.2.4 Identification of the Data Flows**
264 264  
265 265  In order to facilitate the easy and immediate recognition of the institution administrating a data flow definitions, many central institutions prefer to use the first characters of the data flow definition identifiers to identify their institution: e.g. BIS_EER, ECB_BOP1, ECB_BOP1, etc. Note that in GESMES/TS the Data Set plays the role of the data flow definition (see //DataSet //in the SDMX-IM//)//.
266 266  
... ... @@ -268,7 +268,7 @@
268 268  
269 269  Note that the role of the Data Flow (called //DataflowDefintion// in the model) and Data Set is very specific in the model, and the terminology used may not be the same as used in all organisations, and specifically the term Data Set is used differently in SDMX than in GESMES/TS. Essentially the GESMES/TS term "Data Set" is, in SDMX, the "Dataflow Definition" whist the term "Data Set" in SDMX is used to describe the "container" for an instance of the data.
270 270  
271 -==== 3.4.2.5 Special Issues ====
276 +**3.4.2.5 Special Issues**
272 272  
273 273  ===== 3.4.2.5.1 "Frequency" related issues =====
274 274  
... ... @@ -279,6 +279,7 @@
279 279  
280 280  **//Tick data.//** The issue of data collected at irregular intervals at a higher than daily frequency (e.g. tick-by-tick data) is not discussed here either. However, for data exchange purposes, such series can already be exchanged in the SDMX-EDI format by using the option to send observations with the associated time stamp.
281 281  
287 +
282 282  = 4 General Notes for Implementers =
283 283  
284 284  This section discusses a number of topics other than the exchange of data sets in SDMX-ML and SDMX-EDI. Supported only in SDMX-ML, these topics include the use of the reference metadata mechanism in SDMX, the use of Structure Sets and Reporting Taxonomies, the use of Processes, a discussion of time and data-typing, and some of the conventional mechanisms within the SDMX-ML Structure message regarding versioning and external referencing.
... ... @@ -289,31 +289,39 @@
289 289  
290 290  There are several different representations in SDMX-ML, taken from XML Schemas and common programming languages. The table below describes the various representations which are found in SDMX-ML, and their equivalents.
291 291  
292 -(% style="width:912.294px" %)
293 -|(% style="width:172px" %)**SDMX-ML Data Type**|(% style="width:204px" %)**XML Schema Data Type**|(% style="width:189px" %)**.NET Framework Type**|(% style="width:342px" %)(((
294 -**Java Data Type **
298 +|**SDMX-ML Data Type**|**XML Schema Data Type**|**.NET Framework Type**|(((
299 +**Java Data Type**
300 +
301 +**~ **
295 295  )))
296 -|(% style="width:172px" %)String|(% style="width:204px" %)xsd:string|(% style="width:189px" %)System.String|(% style="width:342px" %)java.lang.String
297 -|(% style="width:172px" %)Big Integer|(% style="width:204px" %)xsd:integer|(% style="width:189px" %)System.Decimal|(% style="width:342px" %)java.math.BigInteg er
298 -|(% style="width:172px" %)Integer|(% style="width:204px" %)xsd:int|(% style="width:189px" %)System.Int32|(% style="width:342px" %)int
299 -|(% style="width:172px" %)Long|(% style="width:204px" %)xsd.long|(% style="width:189px" %)System.Int64|(% style="width:342px" %)long
300 -|(% style="width:172px" %)Short|(% style="width:204px" %)xsd:short|(% style="width:189px" %)System.Int16|(% style="width:342px" %)short
301 -|(% style="width:172px" %)Decimal|(% style="width:204px" %)xsd:decimal|(% style="width:189px" %)System.Decimal|(% style="width:342px" %)java.math.BigDecim al
302 -|(% style="width:172px" %)Float|(% style="width:204px" %)xsd:float|(% style="width:189px" %)System.Single|(% style="width:342px" %)float
303 -|(% style="width:172px" %)Double|(% style="width:204px" %)xsd:double|(% style="width:189px" %)System.Double|(% style="width:342px" %)double
304 -|(% style="width:172px" %)Boolean|(% style="width:204px" %)xsd:boolean|(% style="width:189px" %)System.Boolean|(% style="width:342px" %)boolean
305 -|(% style="width:172px" %)URI|(% style="width:204px" %)xsd:anyURI|(% style="width:189px" %)System.Uri|(% style="width:342px" %)Java.net.URI or java.lang.String
306 -|(% style="width:172px" %)DateTime|(% style="width:204px" %)xsd:dateTime|(% style="width:189px" %)System.DateTime|(% style="width:342px" %)javax.xml.datatype .XMLGregorianCalen dar
307 -|(% style="width:172px" %)Time|(% style="width:204px" %)xsd:time|(% style="width:189px" %)System.DateTime|(% style="width:342px" %)javax.xml.datatype .XMLGregorianCalen dar
308 -|(% style="width:172px" %)GregorianYear|(% style="width:204px" %)xsd:gYear|(% style="width:189px" %)System.DateTime|(% style="width:342px" %)javax.xml.datatype .XMLGregorianCalen dar
309 -|(% style="width:172px" %)GregorianMonth|(% style="width:204px" %)xsd:gYearMonth|(% style="width:189px" %)System.DateTime|(% style="width:342px" %)javax.xml.datatype .XMLGregorianCalen dar
310 -|(% style="width:172px" %)GregorianDay|(% style="width:204px" %)xsd:date|(% style="width:189px" %)System.DateTime|(% style="width:342px" %)javax.xml.datatype .XMLGregorianCalen dar
311 -|(% style="width:172px" %)(((
312 -Day, MonthDay, Month
313 -)))|(% style="width:204px" %)xsd:g*|(% style="width:189px" %)System.DateTime|(% style="width:342px" %)javax.xml.datatype .XMLGregorianCalen dar
314 -|(% style="width:172px" %)Duration|(% style="width:204px" %)xsd:duration |(% style="width:189px" %)System.TimeSpa|(% style="width:342px" %)javax.xml.datatype
315 -|(% style="width:172px" %) |(% style="width:204px" %) |(% style="width:189px" %)n|(% style="width:342px" %).Duration
303 +|String|xsd:string|System.String|java.lang.String
304 +|Big Integer|xsd:integer|System.Decimal|java.math.BigInteg er
305 +|Integer|xsd:int|System.Int32|int
306 +|Long|xsd.long|System.Int64|long
307 +|Short|xsd:short|System.Int16|short
308 +|Decimal|xsd:decimal|System.Decimal|java.math.BigDecim al
309 +|Float|xsd:float|System.Single|float
310 +|Double|xsd:double|System.Double|double
311 +|Boolean|xsd:boolean|System.Boolean|boolean
312 +|URI|xsd:anyURI|System.Uri|Java.net.URI or java.lang.String
313 +|DateTime|xsd:dateTime|System.DateTim e|javax.xml.datatype .XMLGregorianCalen dar
314 +|Time|xsd:time|System.DateTim e|javax.xml.datatype .XMLGregorianCalen dar
315 +|GregorianYear|xsd:gYear|System.DateTim e|javax.xml.datatype .XMLGregorianCalen dar
316 +|GregorianMont h|xsd:gYearMont h|System.DateTim e|javax.xml.datatype .XMLGregorianCalen dar
317 +|GregorianDay|xsd:date|System.DateTim e|javax.xml.datatype .XMLGregorianCalen dar
318 +|(((
319 +Day,
316 316  
321 +MonthDay, Month
322 +)))|xsd:g*|System.DateTim e|javax.xml.datatype .XMLGregorianCalen dar
323 +|Duration|xsd:duration |System.TimeSpa|javax.xml.datatype
324 +|**SDMX-ML Data Type**|**XML Schema Data Type**|**.NET Framework Type**|(((
325 +**Java Data Type**
326 +
327 +**~ **
328 +)))
329 +| | |n|.Duration
330 +
317 317  There are also a number of SDMX-ML data types which do not have these direct correspondences, often because they are composite representations or restrictions of a broader data type. For most of these, there are simple types which can be referenced from the SDMX schemas, for others a derived simple type will be necessary:
318 318  
319 319  * AlphaNumeric (common:AlphaNumericType, string which only allows A-z and 0-9)
... ... @@ -339,8 +339,10 @@
339 339  * KeyValues (common:DataKeyType)
340 340  * IdentifiableReference (types for each identifiable object)
341 341  * DataSetReference (common:DataSetReferenceType)
342 -* AttachmentConstraintReference (common:AttachmentConstraintReferenceType)
356 +* AttachmentConstraintReference
343 343  
358 +(common:AttachmentConstraintReferenceType)
359 +
344 344  Data types also have a set of facets:
345 345  
346 346  * isSequence = true | false (indicates a sequentially increasing value)
... ... @@ -362,7 +362,7 @@
362 362  
363 363  == 4.2 Time and Time Format ==
364 364  
365 -=== 4.2.1 Introduction ===
381 +==== 4.2.1 Introduction ====
366 366  
367 367  First, it is important to recognize that most observation times are a period. SDMX specifies precisely how Time is handled.
368 368  
... ... @@ -370,47 +370,50 @@
370 370  
371 371  The hierarchy of time formats is as follows (**bold** indicates a category which is made up of multiple formats, //italic// indicates a distinct format):
372 372  
373 -* **Observational Time Period**
374 -** **Standard Time Period**
375 -*** **Basic Time Period**
376 -**** **Gregorian Time Period**
377 -**** //Date Time//
378 -*** **Reporting Time Period**
379 -** //Time Range//
389 +* **Observational Time Period **o **Standard Time Period**
380 380  
391 + § **Basic Time Period**
392 +
393 +* **Gregorian Time Period**
394 +* //Date Time//
395 +
396 +§ **Reporting Time Period **o //Time Range//
397 +
381 381  The details of these time period categories and of the distinct formats which make them up are detailed in the sections to follow.
382 382  
383 -=== 4.2.2 Observational Time Period ===
400 +==== 4.2.2 Observational Time Period ====
384 384  
385 385  This is the superset of all time representations in SDMX. This allows for time to be expressed as any of the allowable formats.
386 386  
387 -=== 4.2.3 Standard Time Period ===
404 +==== 4.2.3 Standard Time Period ====
388 388  
389 389  This is the superset of any predefined time period or a distinct point in time. A time period consists of a distinct start and end point. If the start and end of a period are expressed as date instead of a complete date time, then it is implied that the start of the period is the beginning of the start day (i.e. 00:00:00) and the end of the period is the end of the end day (i.e. 23:59:59).
390 390  
391 -=== 4.2.4 Gregorian Time Period ===
408 +==== 4.2.4 Gregorian Time Period ====
392 392  
393 393  A Gregorian time period is always represented by a Gregorian year, year-month, or day. These are all based on ISO 8601 dates. The representation in SDMX-ML messages and the period covered by each of the Gregorian time periods are as follows:
394 394  
395 -**Gregorian Year:**
412 +**Gregorian Year:**
413 +
396 396  Representation: xs:gYear (YYYY)
397 -Period: the start of January 1 to the end of December 31
398 398  
399 -**Gregorian Year Month**:
416 +Period: the start of January 1 to the end of December 31 **Gregorian Year Month**:
417 +
400 400  Representation: xs:gYearMonth (YYYY-MM)
401 -Period: the start of the first day of the month to end of the last day of the month
402 402  
403 -**Gregorian Day**:
420 +Period: the start of the first day of the month to end of the last day of the month **Gregorian Day**:
421 +
404 404  Representation: xs:date (YYYY-MM-DD)
423 +
405 405  Period: the start of the day (00:00:00) to the end of the day (23:59:59)
406 406  
407 -=== 4.2.5 Date Time ===
426 +==== 4.2.5 Date Time ====
408 408  
409 409  This is used to unambiguously state that a date-time represents an observation at a single point in time. Therefore, if one wants to use SDMX for data which is measured at a distinct point in time rather than being reported over a period, the date-time representation can be used.
410 410  
411 -Representation: xs:dateTime (YYYY-MM-DDThh:mm:ss)[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[1~]^^>>path:#_ftn1]]
430 +Representation: xs:dateTime (YYYY-MM-DDThh:mm:ss)[[^^~[1~]^^>>path:#_ftn1]]
412 412  
413 -=== 4.2.6 Standard Reporting Period ===
432 +==== 4.2.6 Standard Reporting Period ====
414 414  
415 415  Standard reporting periods are periods of time in relation to a reporting year. Each of these standard reporting periods has a duration (based on the ISO 8601 definition) associated with it. The general format of a reporting period is as follows:
416 416  
... ... @@ -417,52 +417,75 @@
417 417  [REPORTING_YEAR]-[PERIOD_INDICATOR][PERIOD_VALUE]
418 418  
419 419  Where:
439 +
420 420  REPORTING_YEAR represents the reporting year as four digits (YYYY) PERIOD_INDICATOR identifies the type of period which determines the duration of the period
441 +
421 421  PERIOD_VALUE indicates the actual period within the year
422 422  
423 423  The following section details each of the standard reporting periods defined in SDMX:
424 424  
425 -**Reporting Year**:
426 -Period Indicator: A
446 +**Reporting Year**:
447 +
448 + Period Indicator: A
449 +
427 427  Period Duration: P1Y (one year)
451 +
428 428  Limit per year: 1
429 -Representation: common:ReportingYearType (YYYY-A1, e.g. 2000-A1)
430 430  
431 -**Reporting Semester:**
432 -Period Indicator: S
454 +Representation: common:ReportingYearType (YYYY-A1, e.g. 2000-A1) **Reporting Semester:**
455 +
456 + Period Indicator: S
457 +
433 433  Period Duration: P6M (six months)
459 +
434 434  Limit per year: 2
435 -Representation: common:ReportingSemesterType (YYYY-Ss, e.g. 2000-S2)
436 436  
437 -**Reporting Trimester:**
438 -Period Indicator: T
462 +Representation: common:ReportingSemesterType (YYYY-Ss, e.g. 2000-S2) **Reporting Trimester:**
463 +
464 + Period Indicator: T
465 +
439 439  Period Duration: P4M (four months)
467 +
440 440  Limit per year: 3
441 -Representation: common:ReportingTrimesterType (YYYY-Tt, e.g. 2000-T3)
442 442  
443 -**Reporting Quarter:**
444 -Period Indicator: Q
470 +Representation: common:ReportingTrimesterType (YYYY-Tt, e.g. 2000-T3) **Reporting Quarter:**
471 +
472 + Period Indicator: Q
473 +
445 445  Period Duration: P3M (three months)
475 +
446 446  Limit per year: 4
447 -Representation: common:ReportingQuarterType (YYYY-Qq, e.g. 2000-Q4)
448 448  
449 -**Reporting Month**:
478 +Representation: common:ReportingQuarterType (YYYY-Qq, e.g. 2000-Q4) **Reporting Month**:
479 +
450 450  Period Indicator: M
481 +
451 451  Period Duration: P1M (one month)
483 +
452 452  Limit per year: 1
485 +
453 453  Representation: common:ReportingMonthType (YYYY-Mmm, e.g. 2000-M12) Notes: The reporting month is always represented as two digits, therefore 1-9 are 0 padded (e.g. 01). This allows the values to be sorted chronologically using textual sorting methods.
454 454  
455 455  **Reporting Week**:
489 +
456 456  Period Indicator: W
491 +
457 457  Period Duration: P7D (seven days)
493 +
458 458  Limit per year: 53
495 +
459 459  Representation: common:ReportingWeekType (YYYY-Www, e.g. 2000-W53)
460 -Notes: There are either 52 or 53 weeks in a reporting year. This is based on the ISO 8601 definition of a week (Monday - Saturday), where the first week of a reporting year is defined as the week with the first Thursday on or after the reporting year start day.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[2~]^^>>path:#_ftn2]](%%) The reporting week is always represented as two digits, therefore 1-9 are 0 padded (e.g. 01). This allows the values to be sorted chronologically using textual sorting methods.
461 461  
498 +Notes: There are either 52 or 53 weeks in a reporting year. This is based on the ISO 8601 definition of a week (Monday - Saturday), where the first week of a reporting year is defined as the week with the first Thursday on or after the reporting year start day.[[^^~[2~]^^>>path:#_ftn2]] The reporting week is always represented as two digits, therefore 1-9 are 0 padded (e.g. 01). This allows the values to be sorted chronologically using textual sorting methods.
499 +
462 462  **Reporting Day**:
501 +
463 463  Period Indicator: D
503 +
464 464  Period Duration: P1D (one day)
505 +
465 465  Limit per year: 366
507 +
466 466  Representation: common:ReportingDayType (YYYY-Dddd, e.g. 2000-D366) Notes: There are either 365 or 366 days in a reporting year, depending on whether the reporting year includes leap day (February 29). The reporting day is always represented as three digits, therefore 1-99 are 0 padded (e.g. 001).
467 467  
468 468  This allows the values to be sorted chronologically using textual sorting methods.
... ... @@ -473,109 +473,143 @@
473 473  
474 474  Since the duration and the reporting year start day are known for any reporting period, it is possible to relate any reporting period to a distinct calendar period. The actual Gregorian calendar period covered by the reporting period can be computed as follows (based on the standard format of [REPROTING_YEAR][PERIOD_INDICATOR][PERIOD_VALUE] and the reporting year start day as [REPORTING_YEAR_START_DAY]):
475 475  
476 -**~1. Determine [REPORTING_YEAR_BASE]:**
518 +1. **Determine [REPORTING_YEAR_BASE]:**
519 +
477 477  Combine [REPORTING_YEAR] of the reporting period value (YYYY) with [REPORTING_YEAR_START_DAY] (MM-DD) to get a date (YYYY-MM-DD).
521 +
478 478  This is the [REPORTING_YEAR_START_DATE]
479 -**a) If the [PERIOD_INDICATOR] is W:
480 -~1. If [REPORTING_YEAR_START_DATE] is a Friday, Saturday, or Sunday:**
523 +
524 +**a) If the [PERIOD_INDICATOR] is W:**
525 +
526 +1.
527 +11.
528 +111.
529 +1111. **If [REPORTING_YEAR_START_DATE] is a Friday, Saturday, or Sunday:**
530 +
481 481  Add^^3^^ (P3D, P2D, or P1D respectively) to the [REPORTING_YEAR_START_DATE]. The result is the [REPORTING_YEAR_BASE].
482 482  
483 -2. **If [REPORTING_YEAR_START_DATE] is a Monday, Tuesday, Wednesday, or Thursday:**
533 +1.
534 +11.
535 +111.
536 +1111. **If [REPORTING_YEAR_START_DATE] is a Monday, Tuesday, Wednesday, or Thursday:**
537 +
484 484  Add^^3^^ (P0D, -P1D, -P2D, or -P3D respectively) to the [REPORTING_YEAR_START_DATE]. The result is the [REPORTING_YEAR_BASE].
485 -b) **Else:** 
486 -The [REPORTING_YEAR_START_DATE] is the [REPORTING_YEAR_BASE]
487 487  
488 -**2. Determine [PERIOD_DURATION]:**
540 +b) **Else:**
489 489  
490 -a) If the [PERIOD_INDICATOR] is A, the [PERIOD_DURATION] is P1Y.
491 -b) If the [PERIOD_INDICATOR] is S, the [PERIOD_DURATION] is P6M.
492 -c) If the [PERIOD_INDICATOR] is T, the [PERIOD_DURATION] is P4M.
493 -d) If the [PERIOD_INDICATOR] is Q, the [PERIOD_DURATION] is P3M.
494 -e) If the [PERIOD_INDICATOR] is M, the [PERIOD_DURATION] is P1M.
495 -f) If the [PERIOD_INDICATOR] is W, the [PERIOD_DURATION] is P7D.
496 -g) If the [PERIOD_INDICATOR] is D, the [PERIOD_DURATION] is P1D.
542 +The [REPORTING_YEAR_START_DATE] is the [REPORTING_YEAR_BASE].
497 497  
498 -**3. Determine [PERIOD_START]:**
499 -Subtract one from the [PERIOD_VALUE] and multiply this by the [PERIOD_DURATION]. Add[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[3~]^^>>path:#_ftn3]](%%) this to the [REPORTING_YEAR_BASE]. The result is the [PERIOD_START].
544 +1. **Determine [PERIOD_DURATION]:**
545 +11.
546 +111. If the [PERIOD_INDICATOR] is A, the [PERIOD_DURATION] is P1Y.
547 +111. If the [PERIOD_INDICATOR] is S, the [PERIOD_DURATION] is P6M.
548 +111. If the [PERIOD_INDICATOR] is T, the [PERIOD_DURATION] is P4M.
549 +111. If the [PERIOD_INDICATOR] is Q, the [PERIOD_DURATION] is P3M.
550 +111. If the [PERIOD_INDICATOR] is M, the [PERIOD_DURATION] is P1M.
551 +111. If the [PERIOD_INDICATOR] is W, the [PERIOD_DURATION] is P7D.
552 +111. If the [PERIOD_INDICATOR] is D, the [PERIOD_DURATION] is P1D.
553 +1. **Determine [PERIOD_START]:**
500 500  
501 -**4. Determine the [PERIOD_END]:**
555 +Subtract one from the [PERIOD_VALUE] and multiply this by the [PERIOD_DURATION]. Add[[^^~[3~]^^>>path:#_ftn3]] this to the [REPORTING_YEAR_BASE]. The result is the [PERIOD_START].
556 +
557 +1. **Determine the [PERIOD_END]:**
558 +
502 502  Multiply the [PERIOD_VALUE] by the [PERIOD_DURATION]. Add^^3^^ this to the [REPORTING_YEAR_BASE] add^^3^^ -P1D. The result is the [PERIOD_END].
503 503  
504 504  For all of these ranges, the bounds include the beginning of the [PERIOD_START] (i.e. 00:00:00) and the end of the [PERIOD_END] (i.e. 23:59:59).
505 505  
506 -**Examples:**
563 +**Examples: **
507 507  
508 508  **2010-Q2, REPORTING_YEAR_START_DAY = ~-~-07-01 (July 1)**
566 +
509 509  ~1. [REPORTING_YEAR_START_DATE] = 2010-07-01
568 +
510 510  b) [REPORTING_YEAR_BASE] = 2010-07-01
511 -[PERIOD_DURATION] = P3M
512 -(2-1) * P3M = P3M
570 +
571 +1. [PERIOD_DURATION] = P3M
572 +1. (2-1) * P3M = P3M
573 +
513 513  2010-07-01 + P3M = 2010-10-01
575 +
514 514  [PERIOD_START] = 2010-10-01
577 +
515 515  4. 2 * P3M = P6M
579 +
516 516  2010-07-01 + P6M = 2010-13-01 = 2011-01-01
581 +
517 517  2011-01-01 + -P1D = 2010-12-31
583 +
518 518  [PERIOD_END] = 2011-12-31
519 519  
520 520  The actual calendar range covered by 2010-Q2 (assuming the reporting year begins July 1) is 2010-10-01T00:00:00/2010-12-31T23:59:59
521 521  
522 522  **2011-W36, REPORTING_YEAR_START_DAY = ~-~-07-01 (July 1)**
589 +
523 523  ~1. [REPORTING_YEAR_START_DATE] = 2010-07-01
591 +
524 524  a) 2011-07-01 = Friday
593 +
525 525  2011-07-01 + P3D = 2011-07-04
595 +
526 526  [REPORTING_YEAR_BASE] = 2011-07-04
527 -2. [PERIOD_DURATION] = P7D
528 -3. (36-1) * P7D = P245D
597 +
598 +1. [PERIOD_DURATION] = P7D
599 +1. (36-1) * P7D = P245D
600 +
529 529  2011-07-04 + P245D = 2012-03-05
602 +
530 530  [PERIOD_START] = 2012-03-05
604 +
531 531  4. 36 * P7D = P252D
606 +
532 532  2011-07-04 + P252D =2012-03-12
608 +
533 533  2012-03-12 + -P1D = 2012-03-11
610 +
534 534  [PERIOD_END] = 2012-03-11
535 535  
536 536  The actual calendar range covered by 2011-W36 (assuming the reporting year begins July 1) is 2012-03-05T00:00:00/2012-03-11T23:59:59
537 537  
538 -=== 4.2.7 Distinct Range ===
615 +==== 4.2.7 Distinct Range ====
539 539  
540 540  In the case that the reporting period does not fit into one of the prescribe periods above, a distinct time range can be used. The value of these ranges is based on the ISO 8601 time interval format of start/duration. Start can be expressed as either an ISO 8601 date or a date-time, and duration is expressed as an ISO 8601 duration. However, the duration can only be postive.
541 541  
542 -=== 4.2.8 Time Format ===
619 +==== 4.2.8 Time Format ====
543 543  
544 544  In version 2.0 of SDMX there is a recommendation to use the time format attribute to gives additional information on the way time is represented in the message. Following an appraisal of its usefulness this is no longer required. However, it is still possible, if required , to include the time format attribute in SDMX-ML. 
545 545  
546 -(% style="width:716.835px" %)
547 -|(% style="width:197px" %)**Code**|(% style="width:517px" %)**Format**
548 -|(% style="width:197px" %)**OTP**|(% style="width:517px" %)Observational Time Period: Superset of all SDMX time formats (Gregorian Time Period, Reporting Time Period, and Time Range)
549 -|(% style="width:197px" %)**STP**|(% style="width:517px" %)Standard Time Period: Superset of Gregorian and Reporting Time Periods
550 -|(% style="width:197px" %)**GTP**|(% style="width:517px" %)Superset of all Gregorian Time Periods and date-time
551 -|(% style="width:197px" %)**RTP**|(% style="width:517px" %)Superset of all Reporting Time Periods
552 -|(% style="width:197px" %)**TR**|(% style="width:517px" %)Time Range: Start time and duration (YYYY-MMDD(Thh:mm:ss)?/<duration>)
553 -|(% style="width:197px" %)**GY**|(% style="width:517px" %)Gregorian Year (YYYY)
554 -|(% style="width:197px" %)**GTM**|(% style="width:517px" %)Gregorian Year Month (YYYY-MM)
555 -|(% style="width:197px" %)**GD**|(% style="width:517px" %)Gregorian Day (YYYY-MM-DD)
556 -|(% style="width:197px" %)**DT**|(% style="width:517px" %)Distinct Point: date-time (YYYY-MM-DDThh:mm:ss)
557 -|(% style="width:197px" %)**RY**|(% style="width:517px" %)Reporting Year (YYYY-A1)
558 -|(% style="width:197px" %)**RS**|(% style="width:517px" %)Reporting Semester (YYYY-Ss)
559 -|(% style="width:197px" %)**RT**|(% style="width:517px" %)Reporting Trimester (YYYY-Tt)
560 -|(% style="width:197px" %)**RQ**|(% style="width:517px" %)Reporting Quarter (YYYY-Qq)
561 -|(% style="width:197px" %)**RM**|(% style="width:517px" %)Reporting Month (YYYY-Mmm)
562 -|(% style="width:197px" %)**Code**|(% style="width:517px" %)**Format**
563 -|(% style="width:197px" %)**RW**|(% style="width:517px" %)Reporting Week (YYYY-Www)
564 -|(% style="width:197px" %)**RD**|(% style="width:517px" %)Reporting Day (YYYY-Dddd)
623 +|**Code**|**Format**
624 +|**OTP**|Observational Time Period: Superset of all SDMX time formats (Gregorian Time Period, Reporting Time Period, and Time Range)
625 +|**STP**|Standard Time Period: Superset of Gregorian and Reporting Time Periods
626 +|**GTP**|Superset of all Gregorian Time Periods and date-time
627 +|**RTP**|Superset of all Reporting Time Periods
628 +|**TR**|Time Range: Start time and duration (YYYY-MMDD(Thh:mm:ss)?/<duration>)
629 +|**GY**|Gregorian Year (YYYY)
630 +|**GTM**|Gregorian Year Month (YYYY-MM)
631 +|**GD**|Gregorian Day (YYYY-MM-DD)
632 +|**DT**|Distinct Point: date-time (YYYY-MM-DDThh:mm:ss)
633 +|**RY**|Reporting Year (YYYY-A1)
634 +|**RS**|Reporting Semester (YYYY-Ss)
635 +|**RT**|Reporting Trimester (YYYY-Tt)
636 +|**RQ**|Reporting Quarter (YYYY-Qq)
637 +|**RM**|Reporting Month (YYYY-Mmm)
638 +|**Code**|**Format**
639 +|**RW**|Reporting Week (YYYY-Www)
640 +|**RD**|Reporting Day (YYYY-Dddd)
565 565  
566 -**Table 1: SDMX-ML Time Format Codes**
642 + **Table 1: SDMX-ML Time Format Codes**
567 567  
568 -=== 4.2.9 Transformation between SDMX-ML and SDMX-EDI ===
644 +==== 4.2.9 Transformation between SDMX-ML and SDMX-EDI ====
569 569  
570 570  When converting SDMX-ML data structure definitions to SDMX-EDI data structure definitions, only the identifier of the time format attribute will be retained. The representation of the attribute will be converted from the SDMX-ML format to the fixed SDMX-EDI code list. If the SDMX-ML data structure definition does not define a time format attribute, then one will be automatically created with the identifier "TIME_FORMAT".
571 571  
572 -When converting SDMX-ML data to SDMX-EDI, the source time format attribute will be irrelevant. Since the SDMX-ML time representation types are not ambiguous, the target time format can be determined from the source time value directly. For example, if the SDMX-ML time is 2000-Q2 the SDMX-EDI format will always be 608/708 (depending on whether the target series contains one observation or a range of observations).
648 +When converting SDMX-ML data to SDMX-EDI, the source time format attribute will be irrelevant. Since the SDMX-ML time representation types are not ambiguous, the target time format can be determined from the source time value directly. For example, if the SDMX-ML time is 2000-Q2 the SDMX-EDI format will always be 608/708 (depending on whether the target series contains one observation or a range of observations)
573 573  
574 574  When converting a data structure definition originating in SDMX-EDI, the time format attribute should be ignored, as it serves no purpose in SDMX-ML.
575 575  
576 576  When converting data from SDMX-EDI to SDMX-ML, the source time format is only necessary to determine the format of the target time value. For example, a source time format of will result in a target time in the format YYYY-Ss whereas a source format of will result in a target time value in the format YYYY-Qq.
577 577  
578 -=== 4.2.10 Time Zones ===
654 +==== 4.2.10 Time Zones ====
579 579  
580 580  In alignment with ISO 8601, SDMX allows the specification of a time zone on all time periods and on the reporting year start day. If a time zone is provided on a reporting year start day, then the same time zone (or none) should be reported for each reporting time period. If the reporting year start day and the reporting period time zone differ, the time zone of the reporting period will take precedence. Examples of each format with time zones are as follows (time zone indicated in bold):
581 581  
... ... @@ -596,39 +596,40 @@
596 596  
597 597  According to ISO 8601, a date without a time-zone is considered "local time". SDMX assumes that local time is that of the sender of the message. In this version of SDMX, an optional field is added to the sender definition in the header for specifying a time zone. This field has a default value of 'Z' (UTC). This determination of local time applies for all dates in a message.
598 598  
599 -=== 4.2.11 Representing Time Spans Elsewhere ===
675 +==== 4.2.11 Representing Time Spans Elsewhere ====
600 600  
601 601  It has been possible since SDMX 2.0 for a Component to specify a representation of a time span. Depending on the format of the data message, this resulted in either an element with 2 XML attributes for holding the start time and the duration or two separate XML attributes based on the underlying Component identifier. For example if REF_PERIOD were given a representation of time span, then in the Compact data format, it would be represented by two XML attributes; REF_PERIODStartTime (holding the start) and REF_PERIOD (holding the duration). If a new simple type is introduced in the SDMX schemas that can hold ISO 8601 time intervals, then this will no longer be necessary. What was represented as this:
602 602  
603 -<Series REF_PERIODStartTime="2000-01-01T00:00:00" REF_PERIOD="P2M"/>
679 + <Series REF_PERIODStartTime="2000-01-01T00:00:00" REF_PERIOD="P2M"/>
604 604  
605 605  can now be represented with this:
606 606  
607 607  <Series REF_PERIOD="2000-01-01T00:00:00/P2M"/>
608 608  
609 -=== 4.2.12 Notes on Formats ===
685 +==== 4.2.12 Notes on Formats ====
610 610  
611 611  There is no ambiguity in these formats so that for any given value of time, the category of the period (and thus the intended time period range) is always clear. It should also be noted that by utilizing the ISO 8601 format, and a format loosely based on it for the report periods, the values of time can easily be sorted chronologically without additional parsing.
612 612  
613 -=== 4.2.13 Effect on Time Ranges ===
689 +==== 4.2.13 Effect on Time Ranges ====
614 614  
615 615  All SDMX-ML data messages are capable of functioning in a manner similar to SDMX-EDI if the Dimension at the observation level is time: the time period for the first observation can be stated and the rest of the observations can omit the time value as it can be derived from the start time and the frequency. Since the frequency can be determined based on the actual format of the time value for everything but distinct points in time and time ranges, this makes is even simpler to process as the interval between time ranges is known directly from the time value.
616 616  
617 -=== 4.2.14 Time in Query Messages ===
693 +==== 4.2.14 Time in Query Messages ====
618 618  
619 619  When querying for time values, the value of a time parameter can be provided as any of the Observational Time Period formats and must be paired with an operator. In addition, an explicit value for the reporting year start day can be provided, or this can be set to "Any". This section will detail how systems processing query messages should interpret these parameters.
620 620  
621 621  Fundamental to processing a time value parameter in a query message is understanding that all time periods should be handled as a distinct range of time. Since the time parameter in the query is paired with an operator, this is also effectively represents a distinct range of time. Therefore, a system processing the query must simply match the data where the time period for requested parameter is encompassed by the time period resulting from value of the query parameter. The following table details how the operators should be interpreted for any time period provided as a parameter.
622 622  
623 -(% style="width:1024.29px" %)
624 -|(% style="width:238px" %)**Operator**|(% style="width:782px" %)**Rule**
625 -|(% style="width:238px" %)Greater Than|(% style="width:782px" %)Any data after the last moment of the period
626 -|(% style="width:238px" %)Less Than|(% style="width:782px" %)Any data before the first moment of the period
627 -|(% style="width:238px" %)Greater Than or Equal To|(% style="width:782px" %)(((
628 -Any data on or after the first moment of the period
699 +|**Operator**|**Rule**
700 +|Greater Than|Any data after the last moment of the period
701 +|Less Than|Any data before the first moment of the period
702 +|Greater Than or Equal To|(((
703 +Any data on or after the first moment of
704 +
705 +the period
629 629  )))
630 -|(% style="width:238px" %)Less Than or Equal To|(% style="width:782px" %)Any data on or before the last moment of the period
631 -|(% style="width:238px" %)Equal To|(% style="width:782px" %)Any data which falls on or after the first moment of the period and before or on the last moment of the period
707 +|Less Than or Equal To|Any data on or before the last moment of the period
708 +|Equal To|Any data which falls on or after the first moment of the period and before or on the last moment of the period
632 632  
633 633  Reporting Time Periods as query parameters are handled based on whether the value of the reportingYearStartDay XML attribute is an explicit month and day or "Any":
634 634  
... ... @@ -641,7 +641,9 @@
641 641  **Examples:**
642 642  
643 643  **Gregorian Period**
721 +
644 644  Query Parameter: Greater than 2010
723 +
645 645  Literal Interpretation: Any data where the start period occurs after 2010-1231T23:59:59.
646 646  
647 647  Example Matches:
... ... @@ -659,11 +659,15 @@
659 659  * 2010-D185 or later (reporting year start day ~-~-07-01 or later)
660 660  
661 661  **Reporting Period with explicit start day**
741 +
662 662  Query Parameter: Greater than or equal to 2009-Q3, reporting year start day = "-07-01"
743 +
663 663  Literal Interpretation: Any data where the start period occurs on after 2010-0101T00:00:00 (Note that in this case 2009-Q3 is converted to the explicit date range of 2010-01-01/2010-03-31 because of the reporting year start day value). Example Matches: Same as previous example
664 664  
665 665  **Reporting Period with "Any" start day**
747 +
666 666  Query Parameter: Greater than or equal to 2010-Q3, reporting year start day = "Any"
749 +
667 667  Literal Interpretation: Any data with a reporting period where the start period is on or after the start period of 2010-Q3 for the same reporting year start day, or and data where the start period is on or after 2010-07-01. Example Matches:
668 668  
669 669  * 2011 or later
... ... @@ -675,12 +675,15 @@
675 675  * 2010-T3 (any reporting year start day)
676 676  * 2010-Q3 or later (any reporting year start day)
677 677  * 2010-M07 or later (any reporting year start day)
678 -* 2010-W27 or later (reporting year start day ~-~-01-01){{footnote}}2010-Q3 (with a reporting year start day of --01-01) starts on 2010-07-01. This is day 4 of week 26, therefore the first week matched is week 27.{{/footnote}}  2010-D182 or later (reporting year start day ~-~-01-01)
679 -* 2010-W28 or later (reporting year start day ~-~-07-01){{footnote}}2010-Q3 (with a reporting year start day of --07-01) starts on 2011-01-01. This is day 6 of week 27, therefore the first week matched is week 28.{{/footnote}}
680 -* 2010-D185 or later (reporting year start day ~-~-07-01)
761 +* 2010-W27 or later (reporting year start day ~-~-01-01)^^4^^  2010-D182 or later (reporting year start day ~-~-01-01)
762 +* 2010-W28 or later (reporting year start day ~-~-07-01)^^5^^
681 681  
682 -== 4.3 Structural Metadata Querying Best Practices ==
764 +^^4^^ 2010-Q3 (with a reporting year start day of ~-~-01-01) starts on 2010-07-01. This is day 4 of week 26, therefore the first week matched is week 27.
683 683  
766 + 2010-D185 or later (reporting year start day ~-~-07-01)
767 +
768 +== 4.3 Structural Metadata Querying Best Practices ==
769 +
684 684  When querying for structural metadata, the ability to state how references should be resolved is quite powerful. However, this mechanism is not always necessary and can create an undue burden on the systems processing the queries if it is not used properly.
685 685  
686 686  Any structural metadata object which contains a reference to an object can be queried based on that reference. For example, a categorisation references both a category and the object is it categorising. As this is the case, one can query for categorisations which categorise a particular object or which categorise against a particular category or category scheme. This mechanism should be used when the referenced object is known.
... ... @@ -687,7 +687,7 @@
687 687  
688 688  When the referenced object is not known, then the reference resolution mechanism could be used. For example, suppose one wanted to find all category schemes and the related categorisations for a given maintenance agency. In this case, one could query for the category scheme by the maintenance agency and specify that parent and sibling references should be resolved. This would result in the categorisations which reference the categories in the matched schemes to be returned, as well as the object which they categorise.
689 689  
690 -== 4.4 Versioning and External Referencing ==
776 +== 4.4 Versioning and External Referencing ==
691 691  
692 692  Within the SDMX-ML Structure Message, there is a pattern for versioning and external referencing which should be pointed out. The identifiers are qualified by their version numbers – that is, an object with an Agency of “A”, and ID of “X” and a version of “1.0” is a different object than one with an Agency of “A’, an ID of “X”, and a version of “1.1”.
693 693  
... ... @@ -695,6 +695,8 @@
695 695  
696 696  This mechanism is an “early binding” one – everything with a versioned identity is a known quantity, and will not change. It is worth pointing out that in some cases relationships are essentially one-way references: an illustrative case is that of Categories. While a Category may be referenced by many dataflows and metadata flows, the addition of more references from flow objects does not version the Category. This is because the flows are not properties of the Categories – they merely make references to it. If the name of a Category changed, or its subCategories changed, then versioning would be necessary.
697 697  
784 +^^5^^ 2010-Q3 (with a reporting year start day of ~-~-07-01) starts on 2011-01-01. This is day 6 of week 27, therefore the first week matched is week 28.
785 +
698 698  Versioning operates at the level of versionable and maintainable objects in the SDMX information model. If any of the children of objects at these levels change, then the objects themselves are versioned.
699 699  
700 700  One area which is much impacted by this versioning scheme is the ability to reference external objects. With the many dependencies within the various structural objects in SDMX, it is useful to have a scheme for external referencing. This is done at the level of maintainable objects (DSDs, code lists, concept schemes, etc.) In an SDMX-ML Structure Message, whenever an “isExternalReference” attribute is set to true, then the application must resolve the address provided in the associated “uri” attribute and use the SDMX-ML Structure Message stored at that location for the full definition of the object in question. Alternately, if a registry “urn” attribute has been provided, the registry can be used to supply the full details of the object.
... ... @@ -717,13 +717,13 @@
717 717  
718 718  [[image:1747836776649-282.jpeg]]
719 719  
720 -**Figure 1: Schematic of the Metadata Structure Definition**
808 +1. **1: Schematic of the Metadata Structure Definition**
721 721  
722 722  The MSD comprises the specification of the object types to which metadata can be reported in a Metadata Set (Metadata Target(s)), and the Report Structure(s) comprising the Metadata Attributes that identify the Concept for which metadata may be reported in the Metadata Set. Importantly, one Report Structure references the Metadata Target for which it is relevant. One Report Structure can reference many Metadata Target i.e. the same Report Structure can be used for different target objects.
723 723  
724 724  [[image:1747836776655-364.jpeg]]
725 725  
726 -**Figure 2: Example MSD showing Metadata Targets**
814 +1. **2: Example MSD showing Metadata Targets**
727 727  
728 728  Note that the SDMX-ML schemas have explicit XML elements for each identifiable object type because identifying, for instance, a Maintainable Object has different properties from an Identifiable Object which must also include the agencyId, version, and id of the Maintainable Object in which it resides.
729 729  
... ... @@ -733,10 +733,8 @@
733 733  
734 734  [[image:1747836776658-510.jpeg]]
735 735  
736 -**Figure 3: Example MSD showing specification of three Metadata Attributes**
824 +**Figure 3: Example MSD showing specification of three Metadata Attributes **This example shows the following hierarchy of Metadata Attributes:
737 737  
738 -This example shows the following hierarchy of Metadata Attributes:
739 -
740 740  Source – this is presentational and no metadata is expected to be reported at this level
741 741  
742 742  * Source Type
... ... @@ -750,7 +750,10 @@
750 750  
751 751   **Figure 4: Example Metadata Set **This example shows:
752 752  
753 -1. The reference to the MSD, Metadata Report, and Metadata Target (MetadataTargetValue)
839 +1. The reference to the MSD, Metadata Report, and Metadata Target
840 +
841 +(MetadataTargetValue)
842 +
754 754  1. The reported metadata attributes (AttributeValueSet)
755 755  
756 756  = 6 Maintenance Agencies =
... ... @@ -771,7 +771,7 @@
771 771  
772 772  [[image:1747836776680-229.jpeg]]
773 773  
774 -**Figure 5: Example of Hierarchic Structure of Agencies**
863 + **Figure 5: Example of Hierarchic Structure of Agencies**
775 775  
776 776  Each agency is identified by its full hierarchy excluding SDMX.
777 777  
... ... @@ -807,9 +807,8 @@
807 807  
808 808  The Information Model for this is shown below:
809 809  
810 -[[image:1747855024745-946.png]]
811 811  
812 -**Figure 8: Information Model Extract for Concept Role**
900 + **Figure 8: Information Model Extract for Concept Role**
813 813  
814 814  It is possible to specify zero or more concept roles for a Dimension, Measure Dimension and Data Attribute (but not the ReportingYearStartDay). The Time Dimension, Primary Measure, and the  Attribute ReportingYearStartDay have explicitly defined roles and cannot be further specified with additional concept roles.
815 815  
... ... @@ -829,14 +829,15 @@
829 829  
830 830  The Cross-Domain Concept Scheme maintained by SDMX contains concept role concepts (FREQ chosen as an example).
831 831  
832 -[[image:1747855054559-410.png]]
920 +[[image:1747836776691-440.jpeg]]
833 833  
834 834  Whether this is a role or not depends upon the application understanding that FREQ in the Cross-Domain Concept Scheme is a role of Frequency.
835 835  
836 836  Using a Concept Scheme that is not the Cross-Domain Concept Scheme where it is required to assign a role using the Cross-Domain Concept Scheme. Again FREQ is chosen as the example.
837 837  
838 -[[image:1747855075263-887.png]]
926 +[[image:1747836776693-898.jpeg]]
839 839  
928 +
840 840  This explicitly states that this Dimension is playing a role identified by the FREQ concept in the Cross-Domain Concept Scheme. Again the application needs to understand what FREQ in the Cross-Domain Concept Scheme implies in terms of a role.
841 841  
842 842  This is all that is required for interoperability within a community. The important point is that a community must recognise a specific Agency as having the authority to define concept roles and to maintain these “role” concepts in a concept scheme together with documentation on the meaning of the role and any relevant processing implications. This will then ensure there is interoperability between systems that understand the use of these concepts.
... ... @@ -884,7 +884,7 @@
884 884  
885 885  == 8.3 Rules for a Content Constraint ==
886 886  
887 -=== 8.3.1 Scope of a Content Constraint ===
976 +=== 8.3.1 Scope of a Content Constraint ===
888 888  
889 889  A Content Constraint is used specify the content of a data or metadata source in terms of the component values or the keys.
890 890  
... ... @@ -923,54 +923,54 @@
923 923  
924 924  In view of the flexibility of constraints attachment, clear rules on their usage are required. These are elaborated below.
925 925  
926 -=== 8.3.2 Multiple Content Constraints ===
1015 +=== 8.3.2 Multiple Content Constraints ===
927 927  
928 928  There can be many Content Constraints for any Constrainable Artefact (e.g. DSD), subject to the following restrictions:
929 929  
930 -==== 8.3.2.1 Cube Region ====
1019 +**8.3.2.1 Cube Region**
931 931  
932 932  1. The constraint can contain multiple Member Selections (e.g. Dimension) but:
933 933  1. A specific  Member Selection (e.g. Dimension FREQ)  can only be contained in one Content Constraint for any one attached object (e.g. a specific DSD or specific Dataflow)
934 934  
935 -==== 8.3.2.2 Key Set ====
1024 +**8.3.2.2 Key Set**
936 936  
937 937  Key Sets will be processed in the order they appear in the Constraint and wildcards can be used (e.g. any key position not reference explicitly is deemed to be “all values”). As the Key Sets can be “included” or “excluded” it is recommended that Key Sets with wildcards are declared before KeySets with specific series keys. This will minimize the risk that keys are inadvertently included or excluded.  
938 938  
939 -=== 8.3.3 Inheritance of a Content Constraint ===
1028 +=== 8.3.3 Inheritance of a Content Constraint ===
940 940  
941 -==== 8.3.3.1 Attachment levels of a Content Constraint ====
1030 +**8.3.3.1 Attachment levels of a Content Constraint**
942 942  
943 943  There are three levels of constraint attachment for which these inheritance rules apply:
944 944  
945 -* DSD/MSD – top level
946 -** Dataflow/Metadataflow – second level
947 -*** Provision Agreement – third level
1034 + DSD/MSD – top level o Dataflow/Metadataflow – second level
948 948  
1036 +§ Provision Agreement – third level
1037 +
949 949  Note that these rules do not apply to the Simple Datasoucre or Queryable Datasource: the Content Constraint(s) attached to these artefacts are resolved for this artefact only and do not take into account Constraints attached to other artefacts (e.g. Provision Agreement. Dataflow, DSD).
950 950  
951 951  It is not necessary for a Content Constraint to be attached to higher level artifact. e.g. it is valid to have a Content Constraint for a Provision Agreement where there are no constraints attached the relevant dataflow or DSD.
952 952  
953 -==== 8.3.3.2 Cascade rules for processing Constraints ====
1042 +**8.3.3.2 Cascade rules for processing Constraints**
954 954  
955 955  The processing of the constraints on either Dataflow/Metadataflow or Provision Agreement must take into account the constraints declared at higher levels. The rules for the lower level constraints (attached to Dataflow/ Metadataflow and Provision Agreement) are detailed below.
956 956  
957 957  Note that there can be a situation where a constraint is specified at a lower level before a constraint is specified at a higher level. Therefore, it is possible that a higher level constraint makes a lower level constraint invalid. SDMX makes no rules on how such a conflict should be handled when processing the constraint for attachment. However, the cascade rules on evaluating constraints for usage are clear - the higher level constraint takes precedence in any conflicts that result in a less restrictive specification at the lower level.
958 958  
959 -==== 8.3.3.3 Cube Region ====
1048 +**8.3.3.3 Cube Region**
960 960  
961 961  1. It is not necessary to have a constraint on the higher level artifact (e.g. DSD referenced by the Dataflow) but if there is such a constraint at the higher level(s) then:
962 -a. The lower level constraint cannot be less restrictive than the constraint specified for the same Member Selection (e.g. Dimension) at the next higher level which constraints that Member Selection (e.g. if the Dimension FREQ is constrained to A, Q in a DSD then the constraint at the Dataflow or Provision Agreement cannot be A, Q, M or even just M – it can only further constrain A,Q).
963 -b. The constraint at the lower level for any one Member Selection further constrains the content for the same Member Selection at the higher level(s).
1051 +11. The lower level constraint cannot be less restrictive than the constraint specified for the same Member Selection (e.g. Dimension) at the next higher level which constraints that Member Selection (e.g. if the Dimension FREQ is constrained to A, Q in a DSD then the constraint at the Dataflow or Provision Agreement cannot be A, Q, M or even just M – it can only further constrain A,Q).
1052 +11. The constraint at the lower level for any one Member Selection further constrains the content for the same Member Selection at the higher level(s).
964 964  1. Any Member Selection which is not referenced in a Content Constraint is deemed to be constrained according to the Content Constraint specified at the next higher level which constraints that Member Selection.
965 965  1. If there is a conflict when resolving the constraint in terms of a lower-level constraint being less restrictive than a higher-level constraint then the constraint at the higher-level is used.
966 966  
967 967  Note that it is possible for a Content Constraint at a higher level to constrain, say, four Dimensions in a single constraint, and a Content Constraint at a lower level to constrain the same four in two, three, or four Content Constraints.
968 968  
969 -==== 8.3.3.4 Key Set ====
1058 +**8.3.3.4 Key Set**
970 970  
971 971  1. It is not necessary to have a constraint on the higher level artefact (e.g. DSD referenced by the Dataflow) but if there is such a constraint at the higher level(s) then:
972 -a. The lower level constraint cannot be less restrictive than the constraint specified at the higher level.
973 -b. The constraint at the lower level for any one Member Selection further constrains the keys specified at the higher level(s).
1061 +11. The lower level constraint cannot be less restrictive than the constraint specified at the higher level.
1062 +11. The constraint at the lower level for any one Member Selection further constrains the keys specified at the higher level(s).
974 974  1. Any Member Selection which is not referenced in a Content Constraint is deemed to be constrained according to the Content Constraint specified at the next higher level which constraints that Member Selection.
975 975  1. If there is a conflict when resolving the keys in the constraint at two levels, in terms of a lower-level constraint being less restrictive than a higher-level constraint, then the offending keys specified at the lower level are not deemed part of the constraint.
976 976  
... ... @@ -984,11 +984,11 @@
984 984  1. At the lower level inherit all keys that match with the higher level constraint.
985 985  1. If there are keys in the lower level constraint that are not inherited then the key is invalid (i.e. it is less restrictive).
986 986  
987 -=== 8.3.4 Constraints Examples ===
1076 +**8.3.4 Constraints Examples**
988 988  
989 989  The following scenario is used.
990 990  
991 -__DSD__
1080 +=== DSD ===
992 992  
993 993  This contains the following Dimensions:
994 994  
... ... @@ -997,45 +997,114 @@
997 997  * AGE – Age
998 998  * CAS – Current Activity Status
999 999  
1000 -In the DSD common code lists are used and the requirement is to restrict these at various levels to specify the actual code that are valid for the object to which the Content Constraint is attached.
1089 +In the DSD common code lists are used and the requirement is to restrict these at various levels to specify the actual code that are valid for the object to which the Content Constraint is attached.
1001 1001  
1002 -[[image:1747855493531-357.png]]
1003 1003  
1004 -**Figure 10: Example Scenario for Constraints**
1092 +|(((
1093 +
1094 +)))
1005 1005  
1096 +|(((
1097 +
1098 +)))
1099 +
1100 +|(((
1101 +
1102 +)))
1103 +
1104 +|(((
1105 +**Figure**
1106 +)))
1107 +
1108 +|(((
1109 +**10**
1110 +)))
1111 +
1112 +|(((
1113 +**:**
1114 +)))
1115 +
1116 +|(((
1117 +**~ Example Sce**
1118 +)))
1119 +
1120 +|(((
1121 +**nario for Constraints**
1122 +)))
1123 +
1124 +|(((
1125 +**~ **
1126 +)))
1127 +
1128 +
1129 +
1006 1006  Constraints are declared as follows:
1007 1007  
1008 -[[image:1747855462293-368.png]]
1009 1009  
1010 -**Figure 11: Example Content Constraints**
1133 +|(((
1134 +
1135 +)))
1011 1011  
1137 +|(((
1138 +
1139 +)))
1140 +
1141 +|(((
1142 +
1143 +)))
1144 +
1145 +|(((
1146 +**Figure**
1147 +)))
1148 +
1149 +|(((
1150 +**11**
1151 +)))
1152 +
1153 +|(((
1154 +**:**
1155 +)))
1156 +
1157 +|(((
1158 +**~ Example Content Constraints**
1159 +)))
1160 +
1161 +|(((
1162 +**~ **
1163 +)))
1164 +
1165 +
1166 +
1012 1012  **Notes:**
1013 1013  
1014 -1. AGE is constrained for the DSD and is further restricted for the Dataflow CENSUS_CUBE1.
1169 +1. AGE is constrained for the DSD and is further restricted for the Dataflow
1170 +
1171 +CENSUS_CUBE1.
1172 +
1015 1015  1. The same Constraint applies to both Provision Agreements.
1016 1016  
1017 1017  The cascade rules elaborated above result as follows:
1018 1018  
1019 -__DSD__
1177 +DSD
1020 1020  
1021 1021  ~1. Constrained by eliminating code 001 from the code list for the AGE Dimension.
1022 1022  
1023 -__Dataflow CENSUS_CUBE1__
1181 +=== Dataflow CENSUS_CUBE1 ===
1024 1024  
1025 1025  1. Constrained by restricting the code list for the AGE Dimension to codes 002 and 003(note that this is a more restrictive constraint than that declared for the DSD which specifies all codes except code 001).
1026 1026  1. Restricts the CAS codes to 003 and 004.
1027 1027  
1028 -__Dataflow CENSUS_CUBE2__
1186 +=== Dataflow CENSUS_CUBE2 ===
1029 1029  
1030 1030  1. Restricts the code list for the CAS Dimension to codes TOT and NAP.
1031 1031  1. Inherits the AGE constraint applied at the level of the DSD.
1032 1032  
1033 -__Provision Agreements CENSUS_CUBE1_IT__
1191 +=== Provision Agreements CENSUS_CUBE1_IT ===
1034 1034  
1035 1035  1. Restricts the codes for the GEO Dimension to IT and its children.
1036 1036  1. Inherits the constraints from Dataflow CENSUS_CUBE1  for the AGE and CAS Dimensions.
1037 1037  
1038 -__Provision Agreements CENSUS_CUBE2_IT__
1196 +=== Provision Agreements CENSUS_CUBE2_IT ===
1039 1039  
1040 1040  1. Restricts the codes for the GEO Dimension to IT and its children.
1041 1041  1. Inherits the constraints from Dataflow CENSUS_CUBE2 for the CAS Dimension.
... ... @@ -1043,17 +1043,17 @@
1043 1043  
1044 1044  The constraints are defined as follows:
1045 1045  
1046 -__DSD Constraint__
1204 +=== DSD Constraint ===
1047 1047  
1048 1048  [[image:1747836776698-720.jpeg]]
1049 1049  
1050 -__Dataflow Constraints__
1208 +=== Dataflow Constraints ===
1051 1051  
1052 1052  [[image:1747836776701-360.jpeg]]
1053 1053  
1054 1054  === [[image:1747836776707-834.jpeg]] ===
1055 1055  
1056 -__Provision Agreement Constraint__
1214 +=== Provision Agreement Constraint ===
1057 1057  
1058 1058  [[image:1747836776710-262.jpeg]]
1059 1059  
... ... @@ -1065,7 +1065,7 @@
1065 1065  
1066 1066  == 9.2 Groups and Dimension Groups ==
1067 1067  
1068 -=== 9.2.1 Issue ===
1226 +=== 9.2.1 Issue ===
1069 1069  
1070 1070  Version 2.1 introduces a more granular mechanism for specifying the relationship between a Data Attribute and the Dimensions to which the attribute applies. The technical construct for this is the Dimension Group. This Dimension Group has no direct equivalent in versions 2.0 and 1.0 and so the application transforming data from a version 2.1 data set to a version 2.0 or version 1.0 data set must decide to which construct the attribute value, whose Attribute is declared in a Dimension Group, should be attached. The closest construct is the “Series” attachment level and in many cases this is the correct construct to use.
1071 1071  
... ... @@ -1078,7 +1078,7 @@
1078 1078  
1079 1079  If the conditions defined in 9.2.1are true then on conversion to a version 2.0 or 1.0 DSD (Key Family) the Component/Attribute.attachmentLevel must be set to “Group” and the Component/Attribute/AttachmentGroup” is used to identify the Group. Note that under rule(1) in 1.2.1 this group will have been defined in the V 2.1 DSD and so will be present in the V 2.0 transformation.
1080 1080  
1081 -=== 9.2.3 Data ===
1239 +=== 9.2.3 Data ===
1082 1082  
1083 1083  If the conditions defined in 9.2.1are true then, on conversion from a 2.1 data set to a 2.0 or 1.0 dataset the attribute value will be placed in the relevant <Group>. If these conditions are not true then the attribute value will be placed in the <Series>.
1084 1084  
... ... @@ -1090,7 +1090,7 @@
1090 1090  
1091 1091  == 10.1 Introduction ==
1092 1092  
1093 -The Validation and Transformation Language (VTL) supports the definition of Transformations, which are algorithms to calculate new data starting from already existing ones[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[4~]^^>>path:#_ftn4]](%%). The purpose of the VTL in the SDMX context is to enable the:
1251 +The Validation and Transformation Language (VTL) supports the definition of Transformations, which are algorithms to calculate new data starting from already existing ones[[^^~[4~]^^>>path:#_ftn4]]. The purpose of the VTL in the SDMX context is to enable the:
1094 1094  
1095 1095  * definition of validation and transformation algorithms, in order to specify how to calculate new data  from existing ones;
1096 1096  * exchange of the definition of VTL algorithms, also together the definition of the data structures of the involved data (for example, exchange the data structures of a reporting framework together with the validation rules to be applied, exchange the input and output data structures of a calculation task together with the VTL Transformations describing the calculation algorithms);
... ... @@ -1104,7 +1104,7 @@
1104 1104  
1105 1105  This section does not explain the VTL language or any of the content published in the VTL guides. Rather, this is a description of how the VTL can be used in the SDMX context and applied to SDMX artefacts.
1106 1106  
1107 -== 10.2 References to SDMX artefacts from VTL statements ==
1265 +== 10.2 References to SDMX artefacts from VTL statements ==
1108 1108  
1109 1109  === 10.2.1 Introduction ===
1110 1110  
... ... @@ -1112,8 +1112,10 @@
1112 1112  
1113 1113  The alias of a SDMX artefact can be its URN (Universal Resource Name), an abbreviation of its URN or another user-defined name.
1114 1114  
1115 -In any case, the aliases used in the VTL transformations have to be mapped to the SDMX artefacts through the VtlMappingScheme and VtlMapping classes (see the section of the SDMX IM relevant to the VTL). A VtlMapping allows specifying the aliases to be used in the VTL transformations, rulesets[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[5~]^^>>path:#_ftn5]](%%) or user defined operators[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[6~]^^>>path:#_ftn6]](%%)  to reference SDMX artefacts. A VtlMappingScheme is a container for zero or more VtlMapping. 
1273 +In any case, the aliases used in the VTL transformations have to be mapped to the
1116 1116  
1275 +SDMX artefacts through the VtlMappingScheme and VtlMapping classes (see the section of the SDMX IM relevant to the VTL). A VtlMapping allows specifying the aliases to be used in the VTL transformations, rulesets[[^^~[5~]^^>>path:#_ftn5]] or user defined operators[[^^~[6~]^^>>path:#_ftn6]]  to reference SDMX artefacts. A VtlMappingScheme is a container for zero or more VtlMapping. 
1276 +
1117 1117  The correspondence between an alias and a SDMX artefact must be one-to-one, meaning that a generic alias  identifies one and just one SDMX artefact while a SDMX artefact is identified by one and just one alias. In other words, within a VtlMappingScheme an artefact can have just one alias and different artefacts cannot have the same alias.
1118 1118  
1119 1119  The references through the URN and the abbreviated URN are described in the following paragraphs.
... ... @@ -1122,15 +1122,15 @@
1122 1122  
1123 1123  This approach has the advantage that in the VTL code the URN of the referenced artefacts is directly intelligible by a human reader but has the drawback that the references are verbose.
1124 1124  
1125 -The SDMX URN[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[7~]^^>>path:#_ftn7]](%%) is the concatenation of the following parts, separated by special symbols like dot, equal, asterisk, comma, and parenthesis:^^ ^^
1285 +The SDMX URN[[^^~[7~]^^>>path:#_ftn7]] is the concatenation of the following parts, separated by special symbols like dot, equal, asterisk, comma, and parenthesis:^^ ^^
1126 1126  
1127 -* SDMXprefix                                                                                   
1128 -* SDMX-IM-package-name             
1129 -* class-name                                                                        
1130 -* agency-id                                                                          
1287 +* SDMXprefix
1288 +* SDMX-IM-package-name 
1289 +* class-name
1290 +* agency-id 
1131 1131  * maintainedobject-id
1132 1132  * maintainedobject-version
1133 -* container-object-id [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[8~]^^>>path:#_ftn8]]
1293 +* container-object-id [[^^~[8~]^^>>path:#_ftn8]]
1134 1134  * object-id
1135 1135  
1136 1136  The generic structure of the URN is the following:
... ... @@ -1149,13 +1149,13 @@
1149 1149  
1150 1150  The **agency-id** is the acronym of the agency that owns the definition of the artefact, for example for the Eurostat artefacts the agency-id is “ESTAT”). The agency-id can be composite (for example AgencyA.Dept1.Unit2).
1151 1151  
1152 -The **maintainedobject-id** is the name of the maintained object which the artefact belongs to, and in case the artefact itself is maintainable[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[9~]^^>>path:#_ftn9]](%%), coincides with the name of the artefact. Therefore the maintainedobject-id depends on the class of the artefact:
1312 +The **maintainedobject-id** is the name of the maintained object which the artefact belongs to, and in case the artefact itself is maintainable[[^^~[9~]^^>>path:#_ftn9]], coincides with the name of the artefact. Therefore the maintainedobject-id depends on the class of the artefact:
1153 1153  
1154 -* if the artefact is a Dataflow, which is a maintainable class,  the maintainedobject-id is the Dataflow name (dataflow-id);
1155 -* if the artefact is a Dimension, MeasureDimension, TimeDimension, PrimaryMeasure or DataAttribute, which are not maintainable and belong to the DataStructure maintainable class, the maintainedobject-id is the name of the DataStructure (dataStructure-id) which the artefact belongs to;
1156 -* if the artefact is a Concept, which is not maintainable and belongs to the ConceptScheme maintainable class, ,, ,,the maintainedobject-id is the name of the ConceptScheme (conceptScheme-id) which the artefact belongs to;
1157 -* if the artefact is a ConceptScheme, which is a maintainable class, ,, ,,the maintainedobject-id is the name of the ConceptScheme (conceptScheme-id);
1158 -* if the artefact is a Codelist, which is a maintainable class,  the maintainedobject-id is the Codelist name (codelist-id).
1314 +* if the artefact is a ,,Dataflow,,, which is a maintainable class,  the maintainedobject-id is the Dataflow name (dataflow-id);
1315 +* if the artefact is a Dimension, MeasureDimension, TimeDimension, PrimaryMeasure or DataAttribute, which are not maintainable and belong to the ,,DataStructure,, maintainable class, the maintainedobject-id is the name of the DataStructure (dataStructure-id) which the artefact belongs to;
1316 +* if the artefact is a ,,Concept,,, which is not maintainable and belongs to the ConceptScheme maintainable class, ,, ,,the maintainedobject-id is the name of the ConceptScheme (conceptScheme-id) which the artefact belongs to;
1317 +* if the artefact is a ,,ConceptScheme,,, which is a maintainable class, ,, ,,the maintainedobject-id is the name of the ConceptScheme (conceptScheme-id);
1318 +* if the artefact is a ,,Codelist, ,,which is a maintainable class,  the maintainedobject-id is the Codelist name (codelist-id).
1159 1159  
1160 1160  The **maintainedobject-version** is the version of the maintained object which the artefact belongs to (for example, possible versions are 1.0, 2.1, 3.1.2).
1161 1161  
... ... @@ -1163,13 +1163,18 @@
1163 1163  
1164 1164  The **object-id** is the name of the non-maintainable artefact (when the artefact is maintainable its name is already specified as the maintainedobject-id, see above), in particular it has to be specified:
1165 1165  
1166 -* if the artefact is a Dimension, MeasureDimension, TimeDimension, PrimaryMeasure or DataAttribute  (the object-id is the name of one of the artefacts above, which are data structure components)
1167 -* if the artefact is a Concept (the object-id is the name of the Concept)
1326 +* if the artefact is a Dimension, MeasureDimension, TimeDimension, PrimaryMeasure or DataAttribute  (the object-id is the name of one of
1168 1168  
1169 -For example, by using the URN, the VTL transformation that sums two SDMX dataflows DF1 and DF2 and assigns the result to a third persistent dataflow DFR, assuming that DF1, DF2  and  DFR are the maintainedobject-id of the three dataflows, that their version is 1.0 and their Agency is AG, would be written as[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[10~]^^>>path:#_ftn10]](%%):
1328 +the artefacts above, which are data structure components)
1170 1170  
1330 +* if the artefact is a ,,Concept ,,(the object-id is the name of the ,,Concept,,)
1331 +
1332 +For example, by using the URN, the VTL transformation that sums two SDMX dataflows DF1 and DF2 and assigns the result to a third persistent dataflow DFR, assuming that DF1, DF2  and  DFR are the maintainedobject-id of the three dataflows, that their version is 1.0 and their Agency is AG, would be written as[[^^~[10~]^^>>path:#_ftn10]]:
1333 +
1171 1171  ‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DFR(1.0)’  <-
1335 +
1172 1172  ‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DF1(1.0)’   +
1337 +
1173 1173  ‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DF2(1.0)’
1174 1174  
1175 1175  === 10.2.3 Abbreviation of the URN ===
... ... @@ -1180,51 +1180,51 @@
1180 1180  
1181 1181  * The **SDMXPrefix** can be omitted for all the SDMX objects, because it is a prefixed string (urn:sdmx:org), always the same for SDMX objects.
1182 1182  * The **SDMX-IM-package-name **can be omitted as well because it can be deduced from the class-name that follows it (the table of the SDMX-IM packages and classes that allows this deduction is in the SDMX 2.1 Standards - Section 5 -  Registry Specifications, paragraph 6.2.3). In particular, considering the object classes of the artefacts that VTL can reference, the package is: 
1183 -** “datastructure” for the classes Dataflow, Dimension, MeasureDimension, TimeDimension, PrimaryMeasure, DataAttribute,  
1348 +** “datastructure” for the classes Dataflow, Dimension, MeasureDimension, TimeDimension, PrimaryMeasure, DataAttribute,
1184 1184  ** “conceptscheme” for the classes Concept and ConceptScheme o “codelist” for the class Codelist.
1185 -* The **class-name** can be omitted as it can be deduced from the VTL invocation.  In particular, starting from the VTL class of the invoked artefact (e.g. dataset, component, identifier, measure, attribute, variable, valuedomain),  which is known given the syntax of the invoking VTL operator[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[11~]^^>>path:#_ftn11]](%%), the SDMX class can be deduced from the mapping rules between VTL and SDMX (see the section “Mapping between VTL and SDMX” hereinafter)[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[12~]^^>>path:#_ftn12]](%%).
1186 -* If the **agency-id** is not specified, it is assumed by default equal to the agency-id of the TransformationScheme, UserDefinedOperatorScheme or RulesetScheme from which the artefact is invoked. For example, the agency-id can be omitted if it is the same as the invoking TransformationScheme and cannot be omitted if the artefact comes from another agency.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[13~]^^>>path:#_ftn13]](%%)  Take also into account that, according to the VTL consistency rules, the agency of the result of a Transformation must be the same as its TransformationScheme, therefore the agency-id can be omitted for all the results (left part of Transformation statements).
1187 -* As for the **maintainedobject-id**, this is essential in some cases while in other cases it can be omitted: o if the referenced artefact is a Dataflow, which is a maintainable class, the maintainedobject-id is the dataflow-id and obviously cannot be omitted;
1188 -** if the referenced artefact is a Dimension, MeasureDimension, TimeDimension, PrimaryMeasure, DataAttribute, which are not maintainable and belong to the DataStructure maintainable class, the maintainedobject-id is the dataStructure-id and can be omitted, given that these components are always invoked within the invocation of a Dataflow, whose dataStructure-id can be deduced from the
1350 +* The **class-name** can be omitted as it can be deduced from the VTL invocation.  In particular, starting from the VTL class of the invoked artefact (e.g. dataset, component, identifier, measure, attribute, variable, valuedomain),  which is known given the syntax of the invoking VTL operator[[^^~[11~]^^>>path:#_ftn11]], the SDMX class can be deduced from the mapping rules between VTL and SDMX (see the section “Mapping between VTL and SDMX” hereinafter)[[^^~[12~]^^>>path:#_ftn12]].
1351 +* If the **agency-id** is not specified, it is assumed by default equal to the agency-id of the TransformationScheme, UserDefinedOperatorScheme or RulesetScheme from which the artefact is invoked. For example, the agency-id can be omitted if it is the same as the invoking T,,ransformationScheme,, and cannot be omitted if the artefact comes from another agency.[[^^~[13~]^^>>path:#_ftn13]]  Take also into account that, according to the VTL consistency rules, the agency of the result of a ,,Transformation,, must be the same as its ,,TransformationScheme,,, therefore the agency-id can be omitted for all the results (left part of ,,Transformation,, statements).
1352 +* As for the **maintainedobject-id**, this is essential in some cases while in other cases it can be omitted: o if the referenced artefact is a ,,Dataflow,,, which is a maintainable class, the maintainedobject-id is the dataflow-id and obviously cannot be omitted;
1353 +** if the referenced artefact is a Dimension, MeasureDimension, TimeDimension, PrimaryMeasure, DataAttribute, which are not maintainable and belong to the ,,DataStructure,, maintainable class, the maintainedobject-id is the dataStructure-id and can be omitted, given that these components are always invoked within the invocation of a ,,Dataflow,,, whose dataStructure-id can be deduced from the
1189 1189  
1190 -SDMX structural definitions;  o if the referenced artefact is a Concept, which is not maintainable and belong to the ConceptScheme maintainable class,,, ,,the maintained object is the conceptScheme-id and cannot be omitted;
1355 +SDMX structural definitions;  o if the referenced artefact is a ,,Concept, ,,which is not maintainable and belong to the ,,ConceptScheme ,,maintainable class,,, ,,the maintained object is the conceptScheme-id and cannot be omitted;
1191 1191  
1192 -*
1193 -** if the referenced artefact is a ConceptScheme, which is a,, ,,maintainable class,,, ,,the maintained object is the conceptScheme-id and obviously cannot be omitted;
1194 -** if the referenced artefact is a Codelist, which is a maintainable class, the maintainedobject-id is the codelist-id and obviously cannot be omitted.
1357 +*
1358 +** if the referenced artefact is a ,,ConceptScheme, ,,which is a,, ,,maintainable class,,, ,,the maintained object is the ,,conceptScheme-id,, and obviously cannot be omitted;
1359 +** if the referenced artefact is a ,,Codelist, ,,which is a maintainable class, the maintainedobject-id is the ,,codelist-id,, and obviously cannot be omitted.
1195 1195  * When the maintainedobject-id is omitted, the **maintainedobject-version** is omitted too. When the maintainedobject-id is not omitted and the maintainedobject-version is omitted, the version 1.0 is assumed by default.,, ,,
1196 1196  * As said, the **container-object-id** does not apply to the classes that can be referenced in VTL transformations, therefore is not present in their URN
1197 -* The **object-id** does not exist for the artefacts belonging to the Dataflow, ConceptScheme and Codelist classes, while it exists and cannot be omitted for the artefacts belonging to the classes Dimension, MeasureDimension, TimeDimension, PrimaryMeasure, DataAttribute and Concept, as for them the object-id is the main identifier of the artefact
1362 +* The **object-id** does not exist for the artefacts belonging to the ,,Dataflow,,,,, ConceptScheme,, and ,,Codelist,, classes, while it exists and cannot be omitted for the artefacts belonging to the classes Dimension, MeasureDimension, TimeDimension, PrimaryMeasure, DataAttribute and Concept, as for
1198 1198  
1364 +them the object-id is the main identifier of the artefact
1365 +
1199 1199  The simplified object identifier is obtained by omitting all the first part of the URN, including the special characters, till the first part not omitted.
1200 1200  
1201 1201  For example, the full formulation that uses the complete URN shown at the end of the previous paragraph:
1202 1202  
1203 -‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DFR(1.0)’  :=
1204 -‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DF1(1.0)’   +
1370 +‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DFR(1.0)’  := ‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DF1(1.0)’   +
1371 +
1205 1205  ‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DF2(1.0)’
1206 1206  
1207 -by omitting all the non-essential parts would become simply:                          
1374 +by omitting all the non-essential parts would become simply:  
1208 1208  
1209 1209  DFR  :=  DF1 + DF2
1210 1210  
1211 -The references to the Codelists can be simplified similarly. For example, given the non-abbreviated reference to the Codelist  AG:CL_FREQ(1.0), which is[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[14~]^^>>path:#_ftn14]](%%):
1378 +The references to the ,,Codelists,, can be simplified similarly. For example, given the non-abbreviated reference to the ,,Codelist,,  AG:CL_FREQ(1.0), which is[[^^~[14~]^^>>path:#_ftn14]]:
1212 1212  
1213 1213  ‘urn:sdmx:org.sdmx.infomodel.codelist.Codelist=AG:CL_FREQ(1.0)’
1214 1214  
1215 -if the Codelist is referenced from a ruleset scheme belonging to the agency AG, omitting all the optional parts, the abbreviated reference would become simply[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[15~]^^>>path:#_ftn15]](%%):
1382 +if the ,,Codelist,, is referenced from a ruleset scheme belonging to the agency AG, omitting all the optional parts, the abbreviated reference would become simply[[^^~[15~]^^>>path:#_ftn15]]:
1216 1216  
1217 1217  CL_FREQ
1218 1218  
1219 1219  As for the references to the components, it can be enough to specify the  componentId, given that the dataStructure-Id can be omitted. An example of non-abbreviated reference, if the data structure is DST1 and the component is SECTOR, is the following:
1220 1220  
1221 -‘urn:sdmx:org.sdmx.infomodel.datastructure.DataStructure=AG:DST1(1.0).SECTOR’
1388 +‘urn:sdmx:org.sdmx.infomodel.datastructure.DataStructure=AG:DST1(1.0).SECTOR’ The corresponding fully abbreviated reference, if made from a transformation scheme belonging to AG, would become simply: 
1222 1222  
1223 -The corresponding fully abbreviated reference, if made from a transformation scheme belonging to AG, would become simply: 
1224 -
1225 1225  SECTOR
1226 1226  
1227 -For example, the transformation for renaming the component SECTOR of the dataflow DF1 into SEC can be written as[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[16~]^^>>path:#_ftn16]](%%):
1392 +For example, the transformation for renaming the component SECTOR of the dataflow DF1 into SEC can be written as[[^^~[16~]^^>>path:#_ftn16]]:
1228 1228  
1229 1229  ‘DFR(1.0)’ := ‘DF1(1.0)’ [rename SECTOR to SEC]
1230 1230  
... ... @@ -1258,9 +1258,9 @@
1258 1258  
1259 1259  The VTL Rulesets have a signature, in which the Value Domains or the Variables on which the Ruleset is defined are declared, and a body, which contains the rules. 
1260 1260  
1261 -In the signature, given the mapping between VTL and SDMX better described in the following paragraphs, a reference to a VTL Value Domain becomes a reference to a SDMX Codelist or to a SDMX ConceptScheme (for SDMX measure dimensions), while a reference to a VTL Represented Variable becomes a reference to a SDMX Concept, assuming for it a definite representation[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[17~]^^>>path:#_ftn17]](%%).
1426 +In the signature, given the mapping between VTL and SDMX better described in the following paragraphs, a reference to a VTL Value Domain becomes a reference to a SDMX Codelist or to a SDMX ConceptScheme (for SDMX measure dimensions), while a reference to a VTL Represented Variable becomes a reference to a SDMX Concept, assuming for it a definite representation[[^^~[17~]^^>>path:#_ftn17]].
1262 1262  
1263 -In general, for referencing SDMX Codelists and Concepts, the conventions described in the previous paragraphs apply. In the Ruleset syntax, the elements that reference SDMX artefacts are called “valueDomain” and “variable” for the Datapoint Rulesets and “ruleValueDomain”, “ruleVariable”, “condValueDomain” “condVariable” for the Hierarchical Rulesets). The syntax of the Ruleset signature allows also to define aliases of the elements above, these aliases are valid only within the specific ruleset definition statement and cannot be mapped to SDMX.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[18~]^^>>path:#_ftn18]](%%)
1428 +In general, for referencing SDMX Codelists and Concepts, the conventions described in the previous paragraphs apply. In the Ruleset syntax, the elements that reference SDMX artefacts are called “valueDomain” and “variable” for the Datapoint Rulesets and “ruleValueDomain”, “ruleVariable”, “condValueDomain” “condVariable” for the Hierarchical Rulesets). The syntax of the Ruleset signature allows also to define aliases of the elements above, these aliases are valid only within the specific ruleset definition statement and cannot be mapped to SDMX.[[^^~[18~]^^>>path:#_ftn18]]
1264 1264  
1265 1265  In the body of the Rulesets, the Codes and in general all the Values can be written without any other specification, because the artefact  which the Values are referred (Codelist, ConceptScheme, Concept) to can be deduced from the Ruleset signature.
1266 1266  
... ... @@ -1274,24 +1274,26 @@
1274 1274  
1275 1275  Every time a SDMX object is referenced in a VTL Transformation as an input operand, there is the need to generate a VTL definition of the object, so that the VTL operations can take place. This can be made starting from the SDMX definition and applying a SDMX-VTL mapping method in the direction from SDMX to VTL. The possible mapping methods from SDMX to VTL are described in the following paragraphs and are conceived to allow the automatic deduction of the VTL definition of the object from the knowledge of the SDMX definition. 
1276 1276  
1277 -In the opposite direction, every time an object calculated by means of VTL must be treated as a SDMX object (for example for exchanging it through SDMX), there is the need of a SDMX definition of the object, so that the SDMX operations can take place.  The SDMX definition is needed for the VTL objects for which a SDMX use is envisaged[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[19~]^^>>path:#_ftn19]](%%).
1442 +In the opposite direction, every time an object calculated by means of VTL must be treated as a SDMX object (for example for exchanging it through SDMX), there is the need of a SDMX definition of the object, so that the SDMX operations can take place.  The SDMX definition is needed for the VTL objects for which a SDMX use is envisaged[[^^~[19~]^^>>path:#_ftn19]].
1278 1278  
1279 1279  The mapping methods from VTL to SDMX are described in the following paragraphs as well, however they do not allow the complete SDMX definition to be automatically deduced from the VTL definition,  more than all because the former typically contains additional information in respect to the latter. For example, the definition of a SDMX DSD includes also some mandatory information not available in VTL (like the concept scheme to which the SDMX components refer, the assignmentStatus and attributeRelationship for the DataAttributes and so on). Therefore the mapping methods from VTL to SDMX provide only a general guidance for generating SDMX definitions properly starting from the information available in VTL, independently of how the SDMX definition it is actually generated (manually, automatically or part and part). 
1280 1280  
1281 1281  === 10.3.2 General mapping of VTL and SDMX data structures ===
1282 1282  
1283 -This section makes reference to the VTL “Model for data and their structure”[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[20~]^^>>path:#_ftn20]](%%) and the correspondent SDMX “Data Structure Definition”[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[21~]^^>>path:#_ftn21]](%%).
1448 +This section makes reference to the VTL “Model for data and their structure”[[^^~[20~]^^>>path:#_ftn20]] and the correspondent SDMX “Data Structure Definition”[[^^~[21~]^^>>path:#_ftn21]].
1284 1284  
1285 -The main type of artefact that the VTL can manipulate is the VTL Data Set, which in general is mapped to the SDMX Dataflow. This means that a VTL Transformation, in the SDMX context, expresses the algorithm for calculating a derived Dataflow starting from some already existing Dataflows (either collected or derived).[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[22~]^^>>path:#_ftn22]](%%)
1450 +The main type of artefact that the VTL can manipulate is the VTL Data Set, which in general is mapped to the SDMX Dataflow. This means that a VTL Transformation, in the SDMX context, expresses the algorithm for calculating a derived Dataflow starting from some already existing Dataflows (either collected or derived).[[^^~[22~]^^>>path:#_ftn22]]
1286 1286  
1287 1287  While the VTL Transformations are defined in term of Dataflow definitions, they are assumed to be executed on instances of such Dataflows, provided at runtime to the VTL engine (the mechanism for identifying the instances to be processed are not part of the VTL specifications and depend on the implementation of the VTL-based systems).  As already said, the SDMX Datasets are instances of SDMX Dataflows, therefore a VTL Transformation defined on some SDMX Dataflows can be applied on some corresponding SDMX Datasets.
1288 1288  
1289 1289  A VTL Data Set is structured by one and just one Data Structure and a VTL Data Structure can structure any number of Data Sets. Correspondingly, in the SDMX context a SDMX Dataflow is structured by one and just one DataStructureDefinition and one DataStructureDefinition can structure any number of Dataflows.
1290 1290  
1291 -A VTL Data Set has a Data Structure made of Components, which in turn can be Identifiers, Measures and Attributes. Similarly, a SDMX DataflowDefinition has a DataStructureDefinition made of components that can be DimensionComponents, PrimaryMeasure and DataAttributes. In turn, a SDMX DimensionComponent can be a Dimension, a TimeDimension or a MeasureDimension. Correspondingly, in the SDMX implementation of the VTL, the VTL Identifiers can be (optionally) distinguished in three sub-classes (Simple Identifier, Time Identifier, Measure Identifier) even if such a distinction is not evidenced in the VTL IM. 
1456 +A VTL Data Set has a Data Structure made of Components, which in turn can be Identifiers, Measures and Attributes. Similarly, a SDMX DataflowDefinition has a DataStructureDefinition made of components that can be DimensionComponents, PrimaryMeasure and DataAttributes. In turn, a
1292 1292  
1293 -However, a VTL Data Structure can have any number of Identifiers, Measures and Attributes, while a SDMX 2.1 DataStructureDefinition can have any number of Dimensions and DataAttributes but just one PrimaryMeasure[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[23~]^^>>path:#_ftn23]](%%). This is due to a difference between SDMX 2.1 and VTL in the possible representation methods of the data that contain more measures.
1458 +SDMX DimensionComponent can be a Dimension, a TimeDimension or a MeasureDimension. Correspondingly, in the SDMX implementation of the VTL, the VTL Identifiers can be (optionally) distinguished in three sub-classes (Simple Identifier, Time Identifier, Measure Identifier) even if such a distinction is not evidenced in the VTL IM. 
1294 1294  
1460 +However, a VTL Data Structure can have any number of Identifiers, Measures and Attributes, while a SDMX 2.1 DataStructureDefinition can have any number of Dimensions and DataAttributes but just one PrimaryMeasure[[^^~[23~]^^>>path:#_ftn23]]. This is due to a difference between SDMX 2.1 and VTL in the possible representation methods of the data that contain more measures.
1461 +
1295 1295  As for SDMX, because the data structure cannot contain more than one measure component (i.e., the primaryMeasure), the representation of data having more measures is possible only by means of a particular dimension, called MeasureDimension, which is aimed at containing the name of the measure concepts, so that for each observation the value contained in the PrimaryMeasure component is the value of the measure concept reported in the MeasureDimension component. 
1296 1296  
1297 1297  Instead VTL allows either  the method above (an identifier containing the name of the measure together with just one measure component) or a more generic method that consists in defining more measure components in the data structure, one for each measure.
... ... @@ -1300,27 +1300,28 @@
1300 1300  
1301 1301  === 10.3.3 Mapping from SDMX to VTL data structures ===
1302 1302  
1303 -==== 10.3.3.1 Basic Mapping** ** ====
1470 +**10.3.3.1 Basic Mapping **
1304 1304  
1305 -The main mapping method from SDMX to VTL is called **Basic **mapping. This is considered as the default mapping method and is applied unless a different method is specified through the VtlMappingScheme and VtlDataflowMapping classes.
1472 +The main mapping method from SDMX to VTL is called **Basic **mapping. This is considered as the default mapping method and is applied unless a different method is specified through the VtlMappingScheme and VtlDataflowMapping classes. 1842 When transforming **from SDMX to VTL**, this method consists in leaving the 1843 components unchanged and maintaining their names and roles, according to the 1844 following table:
1306 1306  
1307 -When transforming **from SDMX to VTL**, this method consists in leaving the components unchanged and maintaining their names and roles, according to the following table:
1474 +|SDMX|VTL
1475 +|Dimension|(Simple) Identifier
1476 +|Time Dimension|(Time) Identifier
1477 +|Measure Dimension|(Measure) Identifier
1478 +|Primary Measure|Measure
1479 +|Data Attribute|Attribute
1308 1308  
1309 -(% style="width:636.294px" %)
1310 -|(% style="width:286px" %)**SDMX**|(% style="width:347px" %)**VTL**
1311 -|(% style="width:286px" %)Dimension|(% style="width:347px" %)(Simple) Identifier
1312 -|(% style="width:286px" %)Time Dimension|(% style="width:347px" %)(Time) Identifier
1313 -|(% style="width:286px" %)Measure Dimension|(% style="width:347px" %)(Measure) Identifier
1314 -|(% style="width:286px" %)Primary Measure|(% style="width:347px" %)Measure
1315 -|(% style="width:286px" %)Data Attribute|(% style="width:347px" %)Attribute
1481 +According to this method, the resulting VTL structures are always mono-measure
1316 1316  
1317 -According to this method, the resulting VTL structures are always mono-measure (i.e., they have just one measure component) and their Measure is the SDMX PrimaryMeasure. Nevertheless, if the SDMX data structure has a MeasureDimension, which can convey the name of one or more measure concepts, such unique measure component can contain the value of more (conceptual) measures (one for each observation).
1483 +(i.e., they have just one measure component) and their Measure is the SDMX
1318 1318  
1485 +PrimaryMeasure. Nevertheless, if the SDMX data structure has a MeasureDimension, which can convey the name of one or more measure concepts, such unique measure component can contain the value of more (conceptual) measures (one for each observation).
1486 +
1319 1319  As for the SDMX DataAttributes, in VTL they are all considered “at data point / observation level” (i.e. dependent on all the VTL Identifiers), because VTL does not have the SDMX AttributeRelationships, which defines the construct to which the DataAttribute is related (e.g. observation, dimension or set or group of dimensions, whole data set).
1320 1320  
1321 1321  With the Basic mapping, one SDMX observation generates one VTL data point.
1322 1322  
1323 -==== 10.3.3.2 Pivot Mapping ====
1491 +**10.3.3.2 Pivot Mapping **
1324 1324  
1325 1325  An alternative mapping method from SDMX to VTL is the **Pivot **mapping, which is different from the Basic method only for the SDMX data structures that contain a MeasureDimension, which are mapped to multi-measure VTL data structures.  
1326 1326  
... ... @@ -1340,27 +1340,29 @@
1340 1340  
1341 1341  The summary mapping table of the “pivot” mapping from SDMX to VTL for the SDMX data structures that contain a MeasureDimension is the following:
1342 1342  
1343 -(% style="width:941.294px" %)
1344 -|(% style="width:441px" %)**SDMX**|(% style="width:497px" %)**VTL**
1345 -|(% style="width:441px" %)Dimension|(% style="width:497px" %)(Simple) Identifier
1346 -|(% style="width:441px" %)TimeDimension|(% style="width:497px" %)(Time) Identifier
1347 -|(% style="width:441px" %)MeasureDimension & PrimaryMeasure|(% style="width:497px" %)One Measure for each Concept of the SDMX Measure Dimension
1348 -|(% style="width:441px" %)DataAttribute not depending on the MeasureDimension|(% style="width:497px" %)Attribute
1349 -|(% style="width:441px" %)DataAttribute depending on the MeasureDimension|(% style="width:497px" %)One Attribute for each Concept of the SDMX Measure Dimension
1511 +|SDMX|VTL
1512 +|Dimension|(Simple) Identifier
1513 +|TimeDimension|(Time) Identifier
1514 +|MeasureDimension & PrimaryMeasure|One Measure for each Concept of the SDMX Measure Dimension
1515 +|DataAttribute not depending on the MeasureDimension|Attribute
1516 +|DataAttribute depending on the MeasureDimension|One Attribute for each Concept of the SDMX Measure Dimension
1350 1350  
1351 -Using this mapping method, the components of the data structure can change in the conversion from SDMX to VTL and it must be taken into account that the VTL statements can reference only the components of the resulting VTL data structure.
1518 +Using this mapping method, the components of the data structure can change in the conversion from SDMX to VTL and it must be taken into account that the VTL 1908 statements can reference only the components of the resulting VTL data structure.
1352 1352  
1353 -At observation / data point level, calling Cj (j=1, … n) the j^^th^^ Concept of the MeasureDimension:
1520 +At observation / data point level, calling Cj (j=1, … n) the j^^th^^ Concept of the 1911 MeasureDimension:
1354 1354  
1355 -* The set of SDMX observations having the same values for all the Dimensions except than the MeasureDimension become one multi-measure VTL Data Point, having one Measure for each Concept Cj of the SDMX MeasureDimension;
1356 -* The values of the SDMX simple Dimensions, TimeDimension and DataAttributes not depending on the MeasureDimension (these components by definition have always the same values for all the observations of the set above) become the values of the corresponding VTL (simple) Identifiers, (time) Identifier and Attributes.
1357 -* The value of the PrimaryMeasure of the SDMX observation belonging to the set above and having MeasureDimension=Cj becomes the value of the VTL Measure Cj
1358 -* For the SDMX DataAttributes depending on the MeasureDimension, the value of the DataAttribute DA of the SDMX observation belonging to the set above and having MeasureDimension=Cj becomes the value of the VTL Attribute DA_Cj
1522 + The set of SDMX observations having the same values for all the Dimensions except than the MeasureDimension become one multi-measure VTL Data Point, having one Measure for each Concept Cj of the SDMX MeasureDimension;
1359 1359  
1360 -==== 10.3.3.3 From SDMX DataAttributes to VTL Measures ====
1524 +*
1525 +** The values of the SDMX simple Dimensions, TimeDimension and DataAttributes not depending on the MeasureDimension (these components by definition have always the same values for all the observations of the set above) become the values of the corresponding VTL (simple) Identifiers, (time) Identifier and Attributes.
1526 +** The value of the PrimaryMeasure of the SDMX observation belonging to the set above and having MeasureDimension=Cj becomes the value of the VTL Measure Cj
1527 +** For the SDMX DataAttributes depending on the MeasureDimension, the value of the DataAttribute DA of the SDMX observation belonging to the set above and having MeasureDimension=Cj becomes the value of the VTL Attribute DA_Cj
1361 1361  
1362 -* In some cases it may happen that the DataAttributes of the SDMX DataStructure need to be managed as Measures in VTL. Therefore, a variant of both the methods above consists in transforming all the SDMX DataAttributes in VTL Measures. When DataAttributes are converted to Measures, the  two methods above are called Basic_A2M and Pivot_A2M (the suffix “A2M” stands for Attributes to Measures). Obviously, the resulting VTL data structure is, in general, multi-measure and does not contain Attributes.
1529 +**10.3.3.3 From SDMX DataAttributes to VTL Measures **
1363 1363  
1531 +*
1532 +** In some cases it may happen that the DataAttributes of the SDMX DataStructure need to be managed as Measures in VTL. Therefore, a variant of both the methods above consists in transforming all the SDMX DataAttributes in VTL Measures. When DataAttributes are converted to Measures, the  two methods above are called Basic_A2M and Pivot_A2M (the suffix “A2M” stands for Attributes to Measures). Obviously, the resulting VTL data structure is, in general, multi-measure and does not contain Attributes.
1533 +
1364 1364  The Basic_A2M and Pivot_A2M behaves respectively like the Basic and Pivot methods, except that the final VTL components, which according to the Basic and Pivot methods would have had the role of Attribute, assume instead the role of Measure.
1365 1365  
1366 1366  Proper VTL features allow changing the role of specific attributes even after the SDMX to VTL mapping: they can be useful when only some of the DataAttributes need to be managed as VTL Measures.
... ... @@ -1367,7 +1367,7 @@
1367 1367  
1368 1368  === 10.3.4 Mapping from VTL to SDMX data structures ===
1369 1369  
1370 -==== 10.3.4.1 Basic Mapping** ** ====
1540 +**10.3.4.1 Basic Mapping **
1371 1371  
1372 1372  The main mapping method **from VTL to SDMX** is called **Basic **mapping as well.
1373 1373  
... ... @@ -1375,19 +1375,20 @@
1375 1375  
1376 1376  The method consists in leaving the components unchanged and maintaining their names and roles in SDMX, according to the following mapping table, which is the same as the basic mapping from SDMX to VTL, only seen in the opposite direction.
1377 1377  
1378 -This mapping method cannot be applied for SDMX 2.1 if the VTL data structure has more than one measure component, given that the SDMX 2.1 DataStructureDefinition allows just one measure component (the PrimaryMeasure). In this case it becomes mandatory to specify a different mapping method through the VtlMappingScheme and VtlDataflowMapping classes.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[24~]^^>>path:#_ftn24]](%%)
1548 +This mapping method cannot be applied for SDMX 2.1 if the VTL data structure has more than one measure component, given that the SDMX 2.1 DataStructureDefinition allows just one measure component (the
1379 1379  
1380 -Please note that the VTL measures can have any name while in SDMX 2.1 the MeasureComponent has the mandatory name “obs_value”, therefore the name of the VTL measure name must become “obs_value” in SDMX 2.1. 
1550 +PrimaryMeasure). In this case it becomes mandatory to specify a different 1958 mapping method through the VtlMappingScheme and VtlDataflowMapping 1959 classes.[[^^~[24~]^^>>path:#_ftn24]]
1381 1381  
1552 +1960 Please note that the VTL measures can have any name while in SDMX 2.1 the 1961 MeasureComponent has the mandatory name “obs_value”, therefore the name of the VTL measure name must become “obs_value” in SDMX 2.1. 
1553 +
1382 1382  Mapping table:
1383 1383  
1384 -(% style="width:592.294px" %)
1385 -|(% style="width:253px" %)**VTL**|(% style="width:336px" %)**SDMX**
1386 -|(% style="width:253px" %)(Simple) Identifier|(% style="width:336px" %)Dimension
1387 -|(% style="width:253px" %)(Time) Identifier|(% style="width:336px" %)TimeDimension
1388 -|(% style="width:253px" %)(Measure) Identifier|(% style="width:336px" %)MeasureDimension
1389 -|(% style="width:253px" %)Measure|(% style="width:336px" %)PrimaryMeasure
1390 -|(% style="width:253px" %)Attribute|(% style="width:336px" %)DataAttribute
1556 +|VTL|SDMX
1557 +|(Simple) Identifier|Dimension
1558 +|(Time) Identifier|TimeDimension
1559 +|(Measure) Identifier|MeasureDimension
1560 +|Measure|PrimaryMeasure
1561 +|Attribute|DataAttribute
1391 1391  
1392 1392  If the distinction between simple identifier, time identifier and measure identifier is not maintained in the VTL environment, the classification between Dimension, TimeDimension and MeasureDimension exists only in SDMX, as declared in the relevant DataStructureDefinition.
1393 1393  
... ... @@ -1397,12 +1397,14 @@
1397 1397  
1398 1398  As  said, the resulting SDMX definitions must be compliant with the SDMX consistency rules. For example, the SDMX DSD must have the assignmentStatus,  which does not exist in VTL, the AttributeRelationship for the DataAttributes and so on.
1399 1399  
1400 -==== 10.3.4.2 Unpivot Mapping ====
1571 +**10.3.4.2 Unpivot Mapping **
1401 1401  
1402 1402  An alternative mapping method from VTL to SDMX is the **Unpivot **mapping.  
1403 1403  
1404 -Although this mapping method can be used in any case, it makes major sense in case the VTL data structure has more than one measure component (multi-measures VTL structure). For such VTL structures, in fact, the basic method cannot be applied, given that by maintaining the data structure unchanged the resulting SDMX data structure would have more than one measure component, which is not allowed by SDMX 2.1 (it allows just one measure component, the PrimaryMeasure, called “obs_value”).
1575 +Although this mapping method can be used in any case, it makes major sense in case the VTL data structure has more than one measure component (multi-measures VTL structure). For such VTL structures, in fact, the basic method cannot be applied, given that by maintaining the data structure unchanged the resulting SDMX data structure would have more than one measure component, which is not allowed by SDMX 2.1 (it allows just one measure component, the PrimaryMeasure, called
1405 1405  
1577 +“obs_value”).
1578 +
1406 1406  The multi-measures VTL structures have not a Measure Identifier (because the Measures are separate components) and need to be converted to SDMX dataflows having an added MeasureDimension which disambiguates the multiple measures, and an added PrimaryMeasure, in which the measures’ values are maintained.
1407 1407  
1408 1408  The **unpivot** mapping behaves like follows:
... ... @@ -1418,25 +1418,34 @@
1418 1418  
1419 1419  The summary mapping table of the **unpivot** mapping method is the following:
1420 1420  
1421 -(% style="width:904.294px" %)
1422 -|(% style="width:291px" %)**VTL**|(% style="width:611px" %)**SDMX**
1423 -|(% style="width:291px" %)(Simple) Identifier|(% style="width:611px" %)Dimension
1424 -|(% style="width:291px" %)(Time) Identifier|(% style="width:611px" %)TimeDimension
1425 -|(% style="width:291px" %)All Measure Components|(% style="width:611px" %)(((
1426 -MeasureDimension (having one Measure Concept for each VTL measure component) & PrimaryMeasure
1594 +
1595 +|VTL|SDMX
1596 +|(Simple) Identifier|Dimension
1597 +|(Time) Identifier|TimeDimension
1598 +|All Measure Components|(((
1599 +MeasureDimension (having one Measure Concept for each VTL measure component) &
1600 +
1601 +PrimaryMeasure
1427 1427  )))
1428 -|(% style="width:291px" %)Attribute |(% style="width:611px" %)(((
1429 -DataAttribute depending on all SDMX Dimensions including the TimeDimension and except the MeasureDimension
1603 +|Attribute |(((
1604 +DataAttribute depending on all
1605 +
1606 +SDMX Dimensions including the
1607 +
1608 +TimeDimension and except the MeasureDimension
1430 1430  )))
1431 1431  
1432 1432  At observation / data point level:
1433 1433  
1434 -* a multi-measure VTL Data Point becomes a set of SDMX observations, one for each VTL measure
1435 -* the values of the VTL identifiers become the values of the corresponding SDMX Dimensions, for all the observations of the set above
1436 -* the name of the j^^th^^ VTL measure (e.g. “Cj”) becomes the value of the SDMX MeasureDimension of the j^^th^^ observation of the set (i.e. the Concept Cj)
1437 -* the value of the j^^th^^ VTL measure becomes the value of the SDMX PrimaryMeasure of the j^^th^^ observation of the set
1438 -* the values of the VTL Attributes become the values of the corresponding SDMX DataAttributes (in principle for all the observations of the set above)
1613 + a multi-measure VTL Data Point becomes a set of SDMX observations, one for each VTL measure
1439 1439  
1615 + the values of the VTL identifiers become the values of the corresponding SDMX Dimensions, for all the observations of the set above
1616 +
1617 +*
1618 +** the name of the j^^th^^ VTL measure (e.g. “Cj”) becomes the value of the SDMX MeasureDimension of the j^^th^^ observation of the set (i.e. the Concept Cj)
1619 +** the value of the j^^th^^ VTL measure becomes the value of the SDMX PrimaryMeasure of the j^^th^^ observation of the set
1620 +** the values of the VTL Attributes become the values of the corresponding SDMX DataAttributes (in principle for all the observations of the set above)
1621 +
1440 1440  If desired, this method can be applied also to mono-measure VTL structures, provided that none of the VTL components has already the role of measure identifier.
1441 1441  
1442 1442  Like in the general case, a MeasureDimension component called “measure_name” would be added to the SDMX DataStructure and would have just one possible measure concept, corresponding to the unique VTL measure. The original VTL measure component would not become a Component in the SDMX data structure. The value of the VTL measure would be assigned to the SDMX PrimaryMeasure called “obs_value”.
... ... @@ -1443,31 +1443,29 @@
1443 1443  
1444 1444  In any case, the resulting SDMX definitions must be compliant with the SDMX consistency rules. For example, the possible Concepts of the SDMX MeasureDimension need to be listed in a SDMX ConceptScheme, with proper id, agency and version; moreover, the SDMX DSD must have the assignmentStatus, which does not exist in VTL, the attributeRelationship for the DataAttributes and so on.
1445 1445  
1446 -==== 10.3.4.3 From VTL Measures to SDMX Data Attributes** ** ====
1628 +**10.3.4.3 From VTL Measures to SDMX Data Attributes **
1447 1447  
1448 1448  For the multi-measure VTL structures (having more than one Measure Component), it may happen that the Measures of the VTL Data Structure need to be managed as DataAttributes in SDMX. Therefore a third mapping method consists in transforming one VTL measure in the SDMX primaryMeasure and all the other VTL Measures in SDMX DataAttributes. This method is called M2A (“M2A” stands for “Measures to DataAttributes”).
1449 1449  
1450 1450  When applied to mono-measure VTL structures (having one Measure component), the M2A method behaves like the Basic mapping (the VTL Measure component becomes the SDMX primary measure “obs_value”, there is no additional VTL measure to be converted to SDMX DataAttribute). Therefore the mapping table is the same as for the Basic method:
1451 1451  
1452 -(% style="width:591.294px" %)
1453 -|(% style="width:252px" %)**VTL**|(% style="width:336px" %)**SDMX**
1454 -|(% style="width:252px" %)(Simple) Identifier|(% style="width:336px" %)Dimension
1455 -|(% style="width:252px" %)(Time) Identifier|(% style="width:336px" %)TimeDimension
1456 -|(% style="width:252px" %)(Measure) Identifier (if any)|(% style="width:336px" %)MeasureDimension
1457 -|(% style="width:252px" %)Measure|(% style="width:336px" %)PrimaryMeasure
1458 -|(% style="width:252px" %)Attribute|(% style="width:336px" %)DataAttribute
1634 +|VTL|SDMX
1635 +|(Simple) Identifier|Dimension
1636 +|(Time) Identifier|TimeDimension
1637 +|(Measure) Identifier (if any)|MeasureDimension
1638 +|Measure|PrimaryMeasure
1639 +|Attribute|DataAttribute
1459 1459  
1460 1460  For multi-measure VTL structures (having more than one Measure component), one VTL Measure becomes the SDMX PrimaryMeasure while the other VTL Measures maintain their names and values but assume the role of DataAttribute in SDMX. The choice of the VTL Measure that correspond to the SDMX PrimaryMeasure is left to the definer of the SDMX data structure definition.
1461 1461  
1462 -Taking into account that the multi-measure VTL structures do not have a measure identifier, the mapping table is the following:
1643 +2Taking into account that the multi-measure VTL structures do not have a measure 2073 identifier, the mapping table is the following:
1463 1463  
1464 -(% style="width:588.294px" %)
1465 -|(% style="width:259px" %)**VTL**|(% style="width:326px" %)**SDMX**
1466 -|(% style="width:259px" %)(Simple) Identifier|(% style="width:326px" %)Dimension
1467 -|(% style="width:259px" %)(Time) Identifier|(% style="width:326px" %)TimeDimension
1468 -|(% style="width:259px" %)One of the Measures|(% style="width:326px" %)PrimaryMeasure
1469 -|(% style="width:259px" %)Other Measures|(% style="width:326px" %)DataAttribute
1470 -|(% style="width:259px" %)Attribute|(% style="width:326px" %)DataAttribute
1645 +|VTL|SDMX
1646 +|(Simple) Identifier|Dimension
1647 +|(Time) Identifier|TimeDimension
1648 +|One of the Measures|PrimaryMeasure
1649 +|Other Measures|DataAttribute
1650 +|Attribute|DataAttribute
1471 1471  
1472 1472  Even in this case, the resulting SDMX definitions must be compliant with the SDMX consistency rules. For example, the SDMX DSD must have the assignmentStatus,  which does not exist in VTL, the attributeRelationship for the DataAttributes and so on. In particular, the primaryMeasure of the SDMX 2.1 DSD must be called “obs_value” and must be one of the VTL Measures, chosen by the DSD definer.
1473 1473  
... ... @@ -1475,68 +1475,92 @@
1475 1475  
1476 1476  In order to define and understand properly VTL transformations, the applied mapping methods must be specified in the SDMX structural metadata. If the default mapping method (Basic) is applied, no specification is needed.
1477 1477  
1658 +
1478 1478  A customized mapping can be defined through the VtlMappingScheme and VtlDataflowMapping classes (see the section of the SDMX IM relevant to the VTL). A VtlDataflowMapping allows specifying the mapping methods to be used for a specific dataflow, both in the direction from SDMX to VTL (toVtlMappingMethod) and from VTL to SDMX (fromVtlMappingMethod); in fact a VtlDataflowMapping associates the structured URN that identifies a SDMX dataflow to its VTL alias and its mapping methods.
1479 1479  
1480 -It is possible to specify the toVtlMappingMethod and fromVtlMappingMethod also for the conventional dataflow called “generic_dataflow”: in this case the specified mapping methods are intended to become the default ones, overriding the “Basic” methods. In turn, the toVtlMappingMethod and fromVtlMappingMethod declared for a specific Dataflow are intended to override the default ones for such a Dataflow.
1661 +It is possible to specify the toVtlMappingMethod and fromVtlMappingMethod also for the conventional dataflow called “generic_dataflow”: in this case the specified mapping methods are intended to become the default ones, overriding the
1481 1481  
1663 +“Basic” methods. In turn, the toVtlMappingMethod and fromVtlMappingMethod declared for a specific Dataflow are intended to override the default ones for such a Dataflow.
1664 +
1482 1482   The VtlMappingScheme is a container for zero or more VtlDataflowMapping (besides possible mappings to artefacts other than dataflows).
1483 1483  
1484 -=== 10.3.6 Mapping dataflow subsets to distinct VTL data sets[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^**~[25~]**^^>>path:#_ftn25]](%%) ===
1667 +=== 10.3.6 Mapping dataflow subsets to distinct VTL data sets[[^^**~[25~]**^^>>path:#_ftn25]] ===
1485 1485  
1486 -Until now it as been assumed to map one SMDX Dataflow to one VTL dataset and vice-versa. This mapping one-to-one is not mandatory according to VTL because a VTL data set is meant to be a set of observations (data points) on a logical plane, having the same logical data structure and the same general meaning, independently of the possible physical representation or storage (see VTL 2.0 User Manual page 24), therefore a SDMX Dataflow can be seen either as a unique set of data observations (corresponding to one VTL data set) or as the union of many sets of data observations (each one corresponding to a distinct VTL data set).
1669 +Until now it as been assumed to map one SMDX Dataflow to one VTL dataset and vice-versa. This mapping one-to-one is not mandatory according to VTL because a VTL data set is meant to be a set of observations (data points) on a logical plane, having the same logical data structure and the same general meaning, independently of the possible physical representation or storage (see VTL 2.0 User Manual page
1487 1487  
1488 -As a matter of fact, in some cases it can be useful to define VTL operations involving definite parts of a SDMX Dataflow instead than the whole.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[26~]^^>>path:#_ftn26]](%%)
1671 +24), therefore a SDMX Dataflow can be seen either as a unique set of data observations (corresponding to one VTL data set) or as the union of many sets of data observations (each one corresponding to a distinct VTL data set).
1489 1489  
1490 -Therefore, in order to make the coding of  VTL operations simpler when applied on parts of SDMX Dataflows, it is allowed to map distinct parts of a SDMX Dataflow to distinct VTL data sets according to the following rules and conventions. This kind of mapping is possible both from SDMX to VTL and from VTL to SDMX, as better explained below.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[27~]^^>>path:#_ftn27]](%%)
1673 +As a matter of fact, in some cases it can be useful to define VTL operations involving definite parts of a SDMX Dataflow instead than the whole.[[^^~[26~]^^>>path:#_ftn26]]
1491 1491  
1492 -Given a SDMX Dataflow and some predefined Dimensions of its DataStructure, it is allowed to map the subsets of observations that have the same combination of values for such Dimensions to correspondent VTL datasets.
1675 +Therefore, in order to make the coding of  VTL operations simpler when applied on parts of SDMX Dataflows, it is allowed to map distinct parts of a SDMX Dataflow to distinct VTL data sets according to the following rules and conventions. This kind of mapping is possible both from SDMX to VTL and from VTL to SDMX, as better explained below.[[^^~[27~]^^>>path:#_ftn27]]
1493 1493  
1494 -For example, assuming that the SDMX dataflow DF1(1.0) has the Dimensions INDICATOR, TIME_PERIOD and COUNTRY, and that the user declares the Dimensions INDICATOR and COUNTRY as basis for the mapping (i.e. the mapping dimensions):  the observations that have the same values for INDICATOR and COUNTRY would be mapped to the same VTL dataset (and vice-versa).
1677 + Given a SDMX Dataflow and some predefined Dimensions of its
1495 1495  
1679 +DataStructure, it is allowed to map the subsets of observations that have the same combination of values for such Dimensions to correspondent VTL datasets.
1680 +
1681 +For example, assuming that the SDMX dataflow DF1(1.0) has the Dimensions INDICATOR, TIME_PERIOD and COUNTRY, and that the user declares the
1682 +
1683 +Dimensions INDICATOR and COUNTRY as basis for the mapping (i.e. the mapping dimensions):  the observations that have the same values for INDICATOR and COUNTRY would be mapped to the same VTL dataset (and vice-versa).
1684 +
1496 1496  In practice, this kind mapping is obtained like follows:
1497 1497  
1498 -* For a given SDMX dataflow, the user (VTL definer) declares  the dimension components on which the mapping will be based, in a given order.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[28~]^^>>path:#_ftn28]](%%) Following the example above, imagine that the user declares the dimensions INDICATOR and COUNTRY.
1687 +* For a given SDMX dataflow, the user (VTL definer) declares  the dimension components on which the mapping will be based, in a given order.[[^^~[28~]^^>>path:#_ftn28]] Following the example above, imagine that the user declares the dimensions INDICATOR and COUNTRY.
1499 1499  * The VTL dataset is given a name using a special notation also called “ordered concatenation” and composed of the following parts: 
1500 -** The reference to the SDMX dataflow (expressed according to the rules described in the previous paragraphs, i.e. URN, abbreviated URN or another alias); for example DF(1.0);
1501 -** a slash (“/”) as a separator; [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[29~]^^>>path:#_ftn29]]
1502 -** The reference to a specific part of the SDMX dataflow above, expressed as the concatenation of the values that the SDMX dimensions declared above must have, separated by dots (“.”) and written in the order in which these dimensions are defined[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[30~]^^>>path:#_ftn30]](%%) . For example  POPULATION.USA would mean that such a VTL dataset is mapped to the SDMX observations for which the dimension  //INDICATOR// is equal to POPULATION and the dimension //COUNTRY// is equal to USA.
1689 +** The reference to the SDMX dataflow (expressed according to the rules described in the previous paragraphs, i.e. URN, abbreviated
1503 1503  
1691 +URN or another alias); for example DF(1.0); o a slash (“/”) as a separator; [[^^~[29~]^^>>path:#_ftn29]]
1692 +
1693 +*
1694 +** The reference to a specific part of the SDMX dataflow above, expressed as the concatenation of the values that the SDMX dimensions declared above must have, separated by dots (“.”) and written in the order in which these dimensions are defined[[^^~[30~]^^>>path:#_ftn30]] . For example  POPULATION.USA would mean that such a VTL dataset is mapped to the SDMX observations for which the dimension  //INDICATOR// is equal to POPULATION and the dimension //COUNTRY// is equal to USA.
1695 +
1504 1504  In the VTL transformations, this kind of dataset name must be referenced between single quotes because the slash (“/”) is not a regular character according to the VTL rules.
1505 1505  
1506 1506  Therefore, the generic name of this kind of VTL datasets would be:
1507 1507  
1508 -> ‘DF(1.0)///INDICATORvalue//.//COUNTRYvalue//’
1700 +‘DF(1.0)///INDICATORvalue//.//COUNTRYvalue//’
1509 1509  
1510 1510  Where DF(1.0) is the Dataflow and //INDICATORvalue// and //COUNTRYvalue //are placeholders for one value of the INDICATOR and // //COUNTRY dimensions.
1511 1511  
1512 1512  Instead the specific name of one of these VTL datasets would be:
1513 1513  
1514 -> ‘DF(1.0)/POPULATION.USA’
1706 +‘DF(1.0)/POPULATION.USA’
1515 1515  
1516 1516  In particular, this is the VTL dataset that contains all the observations of the dataflow DF(1.0) for which  //INDICATOR// = POPULATION and //COUNTRY// = USA.
1517 1517  
1518 1518  Let us now analyse the different meaning of this kind of mapping in the two mapping directions, i.e. from SDMX to VTL and from VTL to SDMX.
1519 1519  
1520 -As already said, the mapping from SDMX to VTL happens when the VTL datasets are operand of VTL transformations, instead the mapping from VTL to SDMX happens when the VTL datasets are result of VTL transformations[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[31~]^^>>path:#_ftn31]](%%) and need to be treated as SDMX objects. This kind of mapping can be applied independently in the two directions and the Dimensions on which the mapping is based can be different in the two directions: these Dimensions are defined in the ToVtlSpaceKey and in the FromVtlSpaceKey classes respectively.
1712 +As already said, the mapping from SDMX to VTL happens when the VTL datasets are operand of VTL transformations, instead the mapping from VTL to SDMX happens when the VTL datasets are result of VTL transformations[[^^~[31~]^^>>path:#_ftn31]] and need to be treated as SDMX objects. This kind of mapping can be applied independently in the two directions and the Dimensions on which the mapping is based can be different in the two directions: these Dimensions are defined in the ToVtlSpaceKey and in the FromVtlSpaceKey classes respectively.
1521 1521  
1522 -First, let us see what happens in the__ mapping direction from SDMX to VTL__, i.e. when parts of a SDMX dataflow (e.g. DF1(1.0)) need to be mapped to distinct VTL datasets that are operand of some VTL transformations.
1714 +First, let us see what happens in the mapping direction from SDMX to VTL, i.e. when parts of a SDMX dataflow (e.g. DF1(1.0)) need to be mapped to distinct VTL datasets that are operand of some VTL transformations.
1523 1523  
1524 -As already said, each VTL dataset is assumed to contain all the observations of the SDMX dataflow having INDICATOR=//INDICATORvalue //and COUNTRY=//COUNTRYvalue//. For example, the VTL dataset ‘DF1(1.0)/POPULATION.USA’ would contain all the observations of DF1(1.0) having INDICATOR = POPULATION and COUNTRY = USA.
1716 +As already said, each VTL dataset is assumed to contain all the observations of the
1525 1525  
1526 -In order to obtain the data structure of these VTL datasets from the SDMX one, it is assumed that the SDMX dimensions on which the mapping is based are dropped, i.e. not maintained in the VTL data structure; this is possible because their values are fixed for each one of the invoked VTL datasets[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[32~]^^>>path:#_ftn32]](%%). After that, the mapping method from SDMX to VTL specified for the dataflow DF1(1.0) is applied (i.e. basic, pivot …). 
1718 +SDMX dataflow having INDICATOR=//INDICATORvalue //and COUNTRY=
1527 1527  
1528 -In the example above, for all the datasets of the kind ‘DF1(1.0)///INDICATORvalue//.//COUNTRYvalue//, the dimensions INDICATOR and COUNTRY would be dropped so that the data structure of all the resulting VTL data sets would have the identifier TIME_PERIOD only.
1720 +//COUNTRYvalue//. For example, the VTL dataset ‘DF1(1.0)/POPULATION.USA’ would contain all the observations of DF1(1.0) having INDICATOR = POPULATION and COUNTRY = USA.
1529 1529  
1722 +In order to obtain the data structure of these VTL datasets from the SDMX one, it is assumed that the SDMX dimensions on which the mapping is based are dropped, i.e. not maintained in the VTL data structure; this is possible because their values are fixed for each one of the invoked VTL datasets[[^^~[32~]^^>>path:#_ftn32]]. After that, the mapping method from SDMX to VTL specified for the dataflow DF1(1.0) is applied (i.e. basic, pivot …). 
1723 +
1724 +In the example above, for all the datasets of the kind
1725 +
1726 +‘DF1(1.0)///INDICATORvalue//.//COUNTRYvalue//’, the dimensions INDICATOR and COUNTRY would be dropped so that the data structure of all the resulting VTL data sets would have the identifier TIME_PERIOD only.
1727 +
1530 1530  It should be noted that the desired VTL datasets (i.e. of the kind ‘DF1(1.0)/// INDICATORvalue//.//COUNTRYvalue//’) can be obtained also by applying the VTL operator “**sub**” (subspace) to the dataflow DF1(1.0), like in the following VTL expression:
1531 1531  
1532 -> ‘DF1(1.0)/POPULATION.USA’ :=
1533 -> DF1(1.0) [ sub  INDICATOR=“POPULATION”, COUNTRY=“USA” ];
1534 -> ‘DF1(1.0)/POPULATION.CANADA’ :=
1535 -> DF1(1.0) [ sub  INDICATOR=“POPULATION”, COUNTRY=“CANADA” ];
1536 -> …   …   …
1730 +‘DF1(1.0)/POPULATION.USA’ := 
1537 1537  
1538 -In fact the VTL operator “sub has exactly the same behaviour. Therefore, mapping different parts of a SDMX dataflow to different VTL datasets in the direction from SDMX to VTL through the ordered concatenation notation is equivalent to a proper use of the operator **sub**on such a dataflow. [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[33~]^^>>path:#_ftn33]]
1732 +DF1(1.0) [ sub  INDICATOR=“POPULATION”, COUNTRY=USA” ];
1539 1539  
1734 +
1735 +‘DF1(1.0)/POPULATION.CANADA’ := 
1736 +
1737 +DF1(1.0) [ sub  INDICATOR=“POPULATION”, COUNTRY=“CANADA” ];
1738 +
1739 +
1740 +…   …   …
1741 +
1742 +In fact the VTL operator “sub” has exactly the same behaviour. Therefore, mapping different parts of a SDMX dataflow to different VTL datasets in the direction from SDMX to VTL through the ordered concatenation notation is equivalent to a proper use of the operator “**sub**” on such a dataflow. [[^^~[33~]^^>>path:#_ftn33]]
1743 +
1540 1540  In the direction from SDMX to VTL it is allowed to omit the value of one or more Dimensions on which the mapping is based, but maintaining all the separating dots (therefore it may happen to find two or more consecutive dots and dots in the beginning or in the end). The absence of value means that for the corresponding Dimension all the values are kept and the Dimension is not dropped.
1541 1541  
1542 1542  For example, ‘DF(1.0)/POPULATION.’ (note the dot in the end of the name) is the VTL dataset that contains all the observations of the dataflow DF(1.0) for which  //INDICATOR// = POPULATION and COUNTRY = any value.
... ... @@ -1543,50 +1543,97 @@
1543 1543  
1544 1544  This is equivalent to the application of the VTL “sub” operator only to the identifier //INDICATOR//:
1545 1545  
1546 -> ‘DF1(1.0)/POPULATION.’ := 
1547 -> DF1(1.0) [ sub  INDICATOR=“POPULATION” ];
1750 +‘DF1(1.0)/POPULATION.’ := 
1548 1548  
1752 +DF1(1.0) [ sub  INDICATOR=“POPULATION” ];
1753 +
1754 +
1549 1549  Therefore the VTL dataset ‘DF1(1.0)/POPULATION.’ would have the identifiers COUNTRY and TIME_PERIOD.
1550 1550  
1551 1551  Heterogeneous invocations of the same Dataflow are allowed, i.e. omitting different Dimensions in different invocations.
1552 1552  
1553 -Let us now analyse the __mapping direction from VTL to SDMX__.
1759 +Let us now analyse the mapping direction from VTL to SDMX.
1554 1554  
1555 1555  In this situation, distinct parts of a SDMX dataflow are calculated as distinct VTL datasets, under the constraint that they must have the same VTL data structure.
1556 1556  
1557 1557  For example, let us assume that the VTL programmer wants to calculate the SDMX dataflow DF2(1.0) having the Dimensions TIME_PERIOD, INDICATOR, and COUNTRY and that such a programmer finds it convenient to calculate separately the parts of DF2(1.0) that have different combinations of values for INDICATOR and COUNTRY:
1558 1558  
1559 -* each part is calculated as a  VTL derived dataset, result of a dedicated VTL transformation; [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[34~]^^>>path:#_ftn34]](%%)
1560 -* the data structure of all these VTL datasets has the TIME_PERIOD identifier and does not have the INDICATOR and COUNTRY identifiers.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[35~]^^>>path:#_ftn35]]
1765 +* each part is calculated as a  VTL derived dataset, result of a dedicated VTL transformation; [[^^~[34~]^^>>path:#_ftn34]]
1766 +* the data structure of all these VTL datasets has the TIME_PERIOD identifier and does not have the INDICATOR and COUNTRY identifiers.[[^^~[35~]^^>>path:#_ftn35]]
1561 1561  
1562 -Under these hypothesis, such derived VTL datasets can be mapped to DF2(1.0) by declaring the Dimensions INDICATOR and COUNTRY as mapping dimensions[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[36~]^^>>path:#_ftn36]](%%).
1768 +Under these hypothesis, such derived VTL datasets can be mapped to DF2(1.0) by declaring the Dimensions INDICATOR and COUNTRY as mapping dimensions[[^^~[36~]^^>>path:#_ftn36]].
1563 1563  
1564 -The corresponding VTL transformations, assuming that the result needs to be persistent, would be of this kind:^^ ^^[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[37~]^^>>path:#_ftn37]]
1770 +The corresponding VTL transformations, assuming that the result needs to be persistent, would be of this kind:^^ ^^[[^^~[37~]^^>>path:#_ftn37]]
1565 1565  
1566 1566  ‘DF2(1.0)///INDICATORvalue//.//COUNTRYvalue//’  <-  expression
1567 1567  
1568 1568  Some examples follow, for some specific values of INDICATOR and COUNTRY:
1569 1569  
1570 -‘DF2(1.0)/GDPPERCAPITA.USA’  <-   expression11;
1776 + ‘DF2(1.0)/GDPPERCAPITA.USA’    <-   expression11;
1777 +
1571 1571  ‘DF2(1.0)/GDPPERCAPITA.CANADA’   <-   expression12;
1779 +
1572 1572  …   …   …
1573 -‘DF2(1.0)/POPGROWTH.USA’  <-   expression21;
1574 -‘DF2(1.0)/POPGROWTH.CANADA’  <-   expression22;
1575 1575  
1782 + ‘DF2(1.0)/POPGROWTH.USA’   <-   expression21;
1783 +
1784 + ‘DF2(1.0)/POPGROWTH.CANADA’    <-   expression22;
1785 +
1576 1576  …   …   …
1577 1577  
1788 +
1578 1578  As said, it is assumed that these VTL derived datasets have the TIME_PERIOD as the only identifier.  In the mapping from VTL to SMDX, the Dimensions INDICATOR and COUNTRY are added to the VTL data structure on order to obtain the SDMX one, with the following values respectively:
1579 1579  
1580 -[[image:1747859458410-183.png||height="170" width="663"]]
1791 +|(((
1792 + //VTL dataset //
1581 1581  
1794 +
1795 +)))|(% colspan="2" %)//INDICATOR value //|(% colspan="2" %)//COUNTRY value//
1796 +|‘DF2(1.0)/GDPPERCAPITA.USA’    |GDPPERCAPITA| | |USA
1797 +|(((
1798 +‘DF2(1.0)/GDPPERCAPITA.CANADA’  
1799 +
1800 +…   …   …
1801 +)))|GDPPERCAPITA| | |CANADA
1802 +|‘DF2(1.0)/POPGROWTH.USA’   |POPGROWTH | | |USA
1803 +|(((
1804 +‘DF2(1.0)/POPGROWTH.CANADA’   
1805 +
1806 +…   …   …
1807 +)))|POPGROWTH | | |CANADA 
1808 +
1582 1582  It should be noted that the application of this many-to-one mapping from VTL to SDMX is equivalent to an appropriate sequence of VTL Transformations. These use the VTL operator “calc” to add the proper VTL  identifiers (in the example, INDICATOR and COUNTRY) and to assign to them the proper values and the operator “union” in order to obtain the final VTL dataset (in the example DF2(1.0)), that can be mapped one-to-one to the homonymous SDMX Dataflow.  Following the same example, these VTL transformations would be:
1583 1583  
1584 -[[image:1747859612718-454.png||height="451" width="602"]]
1811 +DF2bis_GDPPERCAPITA_USA    :=   ‘DF2(1.0)/GDPPERCAPITA.USA’
1585 1585  
1586 -In other words, starting from the datasets explicitly calculated through VTL (in the example ‘DF2(1.0)/GDPPERCAPITA.USA’ and so on), the first step consists in calculating other (non-persistent) VTL datasets (in the example DF2bis_GDPPERCAPITA_USA and so on) by adding the identifiers INDICATOR and COUNTRY with the desired values (//INDICATORvalue// and //COUNTRYvalue)//. Finally, all these non-persistent data sets are united and give the final result DF2(1.0)[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[38~]^^>>path:#_ftn38]](%%), which can be mapped one-to-one to the homonymous SDMX dataflow having the dimension components TIME_PERIOD, INDICATOR and COUNTRY.
1813 +[calc  identifier INDICATOR := GDPPERCAPITA”,  identifier  COUNTRY := ”USA”];
1587 1587  
1588 -Therefore, mapping different VTL datasets having the same data structure to different parts of a SDMX dataflow, i.e. in the direction from VTL to SDMX, through the ordered concatenation notation is equivalent to a proper use of the operators “calc” and “union” on such datasets. [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[39~]^^>>path:#_ftn39]](%%)[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[40~]^^>>path:#_ftn40]]
1815 +DF2bis_GDPPERCAPITA_CANADA :=   ‘DF2(1.0)/GDPPERCAPITA.CANADA’   [calc  identifier INDICATOR:=”GDPPERCAPITA”,  identifier COUNTRY:=”CANADA”]; …   …  
1589 1589  
1817 +DF2bis_POPGROWTH_USA     :=  ‘DF2(1.0)/POPGROWTH.USA’ 
1818 +
1819 +[calc  identifier INDICATOR := ”POPGROWTH”,  identifier  COUNTRY :=”USA”];
1820 +
1821 +DF2bis_POPGROWTH_CANADA’  :=  ‘DF2(1.0)/POPGROWTH.CANADA’
1822 +
1823 +[calc  identifier INDICATOR := ”POPGROWTH”,  identifier  COUNTRY := ”CANADA”]; …   …   …
1824 +
1825 +DF2(1.0)   <-   UNION          (DF2bis_GDPPERCAPITA_USA’,
1826 +
1827 +DF2bis_GDPPERCAPITA_CANADA’,
1828 +
1829 +… ,
1830 +
1831 +DF2bis_POPGROWTH_USA’,
1832 +
1833 +DF2bis_POPGROWTH_CANADA’ 
1834 +
1835 +…);
1836 +
1837 +In other words, starting from the datasets explicitly calculated through VTL (in the example ‘DF2(1.0)/GDPPERCAPITA.USA’ and so on), the first step consists in calculating other (non-persistent) VTL datasets (in the example DF2bis_GDPPERCAPITA_USA and so on) by adding the identifiers INDICATOR and COUNTRY with the desired values (//INDICATORvalue// and //COUNTRYvalue)//. Finally, all these non-persistent data sets are united and give the final result DF2(1.0)[[^^~[38~]^^>>path:#_ftn38]], which can be mapped one-to-one to the homonymous SDMX dataflow having the dimension components TIME_PERIOD, INDICATOR and COUNTRY.
1838 +
1839 +Therefore, mapping different VTL datasets having the same data structure to different parts of a SDMX dataflow, i.e. in the direction from VTL to SDMX, through the ordered concatenation notation is equivalent to a proper use of the operators “calc” and “union” on such datasets. [[^^~[39~]^^>>path:#_ftn39]][[^^~[40~]^^>>path:#_ftn40]]
1840 +
1590 1590  It is worth noting that in the direction from VTL to SDMX it is mandatory to specify the value for every Dimension on which the mapping is based (in other word, in the name of the calculated VTL dataset is not possible to omit the value of some of the Dimensions).
1591 1591  
1592 1592  === 10.3.7 Mapping variables and value domains between VTL and SDMX ===
... ... @@ -1593,35 +1593,52 @@
1593 1593  
1594 1594  With reference to the VTL “model for Variables and Value domains”, the following additional mappings have to be considered:
1595 1595  
1596 -(% style="width:890.835px" %)
1597 -|(% style="width:314px" %)VTL|(% style="width:574px" %)SDMX
1598 -|(% style="width:314px" %)**Data Set Component**|(% style="width:574px" %)Although this abstraction exists in SDMX, it does not have an explicit definition and correspond to a Component (either a Dimension or a PrimaryMeasure or a DataAttribute) belonging to one specific Dataflow^^42^^
1599 -|(% style="width:314px" %)**Represented Variable**|(% style="width:574px" %)**Concept** with  a definite Representation
1600 -|(% style="width:314px" %)**Value Domain**|(% style="width:574px" %)**Representation** (see the Structure Pattern in the Base Package)
1601 -|(% style="width:314px" %)**Enumerated Value Domain / Code List**|(% style="width:574px" %)(((
1602 -**Codelist** (for enumerated Dimension, PrimaryMeasure, DataAttribute) or **ConceptScheme **(for MeasureDimension)
1847 +|VTL|SDMX
1848 +|**Data Set Component**|Although this abstraction exists in SDMX, it does not have an explicit definition and correspond to a Component (either a Dimension or a PrimaryMeasure or a DataAttribute) belonging to one specific Dataflow^^42^^
1849 +|**Represented Variable**|**Concept** with  a definite Representation
1850 +|**Value Domain**|**Representation** (see the Structure Pattern in the Base Package)
1851 +|**Enumerated Value Domain / Code List**|(((
1852 +**Codelist** (for enumerated
1853 +
1854 +Dimension, PrimaryMeasure,
1855 +
1856 +DataAttribute) or **ConceptScheme**
1857 +
1858 +(for MeasureDimension)
1603 1603  )))
1604 -|(% style="width:314px" %)**Code**|(% style="width:574px" %)**Code** (for enumerated Dimension, PrimaryMeasure, DataAttribute) or **Concept** (for MeasureDimension)
1605 -|(% style="width:314px" %)**Described Value Domain**|(% style="width:574px" %)(((
1606 -non-enumerated** Representation **(having Facets / ExtendedFacets, see the Structure Pattern in the Base Package)
1860 +|**Code**|**Code** (for enumerated Dimension, PrimaryMeasure, DataAttribute) or **Concept** (for MeasureDimension)
1861 +|**Described Value Domain**|(((
1862 +non-enumerated** Representation**
1863 +
1864 +(having Facets / ExtendedFacets, see the Structure Pattern in the Base Package)
1607 1607  )))
1608 -|(% style="width:314px" %)**Value**|(% style="width:574px" %)(((
1609 -Although this abstraction exists in SDMX, it does not have an explicit definition and correspond to a **Code** of a Codelist (for enumerated Representations) or to a valid **value **(for non-enumerated** **Representations) or to a **Concept **(for MeasureDimension)
1866 +|**Value**|(((
1867 +Although this abstraction exists in SDMX, it does not have an explicit definition and correspond to a **Code** of a
1868 +
1869 +Codelist (for enumerated
1870 +
1871 +Representations) or to a valid **value **(for non-enumerated** **
1872 +
1873 +Representations) or to a **Concept**
1874 +
1875 +(for MeasureDimension)
1610 1610  )))
1611 -|(% style="width:314px" %)**Value Domain Subset / Set**|(% style="width:574px" %)This abstraction does not exist in SDMX
1612 -|(% style="width:314px" %)**Enumerated Value Domain Subset / Enumerated Set**|(% style="width:574px" %)This abstraction does not exist in SDMX
1613 -|(% style="width:314px" %)**Described Value Domain Subset / Described Set**|(% style="width:574px" %)This abstraction does not exist in SDMX
1614 -|(% style="width:314px" %)**Set list**|(% style="width:574px" %)This abstraction does not exist in SDMX
1877 +|**Value Domain Subset / Set**|This abstraction does not exist in SDMX
1878 +|**Enumerated Value Domain Subset / Enumerated Set**|This abstraction does not exist in SDMX
1879 +|**Described Value Domain Subset / Described Set**|This abstraction does not exist in SDMX
1880 +|**Set list**|This abstraction does not exist in SDMX
1615 1615  
1616 1616  The main difference between VTL and SDMX relies on the fact that the VTL artefacts for defining subsets of Value Domains do not exist in SDMX, therefore the VTL features for referring to predefined subsets are not available in SDMX. These artefacts are the Value Domain Subset (or Set), either enumerated or described, the Set List (list of values belonging to enumerated subsets) and the Data Set Component (aimed at defining the set of values that the Component of a Data Set can take, possibly a subset of the codes of Value Domain).
1617 1617  
1618 -Another difference consists in the fact that all Value Domains are considered as identifiable objects in VTL either if enumerated or not, while in SDMX  the Codelist (corresponding to a VTL enumerated Value Domain) is identifiable, while the SDMX non-enumerated Representation (corresponding to a VTL non-enumerated Value Domain) is not identifiable. As a consequence, the definition of the VTL rulesets, which in VTL can refer either to enumerated or non-enumerated value domains, in SDMX can refer only to enumerated Value Domains (i.e. to SDMX Codelists). 
1884 +Another difference consists in the fact that all Value Domains are considered as identifiable objects in VTL either if enumerated or not, while in SDMX  the Codelist (corresponding to a VTL enumerated Value Domain) is identifiable, while the SDMX non-enumerated Representation (corresponding to a VTL non-enumerated Value
1619 1619  
1620 -As for the mapping between VTL variables and SDMX Concepts, it should be noted that these artefacts do not coincide perfectly. In fact, the VTL variables are  represented variables, defined always on the same Value Domain (“Representation in SDMX) independently of the data set / data structure in which they appear[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[41~]^^>>path:#_ftn41]](%%), while the SDMX Concepts can have different Representations in different DataStructures.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[42~]^^>>path:#_ftn42]](%%) This means that one SDMX Concept can correspond to many VTL Variables, one for each representation the Concept has.
1886 +Domain) is not identifiable. As a consequence, the definition of the VTL rulesets, which in VTL can refer either to enumerated or non-enumerated value domains, in SDMX can refer only to enumerated Value Domains (i.e. to SDMX Codelists). 
1621 1621  
1888 +As for the mapping between VTL variables and SDMX Concepts, it should be noted that these artefacts do not coincide perfectly. In fact, the VTL variables are  represented variables, defined always on the same Value Domain (“Representation” in SDMX) independently of the data set / data structure in which they appear[[^^~[41~]^^>>path:#_ftn41]], while the SDMX Concepts can have different Representations in different DataStructures.[[^^~[42~]^^>>path:#_ftn42]] This means that one SDMX Concept can correspond to many VTL Variables, one for each representation the Concept has.
1889 +
1622 1622  Therefore, it is important to be aware that some VTL operations (for example the binary operations at data set level) are consistent only if the components having the same names in the operated VTL data sets have also the same representation (i.e. the same Value Domain as for VTL).   For example, it is possible to obtain correct results from the VTL expression
1623 1623  
1624 - DS_c  :=  DS_a  +  DS_b  (where DS_a, DS_b, DS_c   are VTL Data Sets)
1892 + DS_c  :=  DS_a  +  DS_b  (where DS_a, DS_b, DS_c   are VTL Data Sets)
1625 1625  
1626 1626  if the matching components in DS_a and DS_b (e.g. ref_date, geo_area, sector …) refer to the same general representation. In simpler words, DS_a  and DS_b must use the same values/codes (for ref_date, geo_area, sector … ), otherwise the relevant values would not match and the result of the operation would be wrong.
1627 1627  
... ... @@ -1645,7 +1645,6 @@
1645 1645  
1646 1646  The VTL basic scalar types are listed below and follow a hierarchical structure in terms of supersets/subsets (e.g. “scalar” is the superset of all the basic scalar types):
1647 1647  
1648 -[[image:1747859722732-549.png||height="283" width="224"]]
1649 1649  
1650 1650  **Figure 13 – VTL Basic Scalar Types**
1651 1651  
... ... @@ -1667,252 +1667,303 @@
1667 1667  
1668 1668  The opposite conversion, i.e. from VTL to SDMX, happens when a VTL result, i.e. a VTL data set output of a transformation, must become a SDMX artefact (or part of it). The values of the VTL result must be converted into the desired (SDMX) external representations (data types) of the SDMX artefact.
1669 1669  
1670 -=== 10.4.3 Mapping SDMX data types to VTL basic scalar types ===
1937 +=== 10.4.3 Mapping SDMX data types to VTL basic scalar types ===
1671 1671  
1672 1672  The following table describes the default mapping for converting from the SDMX data types to the VTL basic scalar types.
1673 1673  
1674 -(% style="width:653.835px" %)
1675 -|(% style="width:366px" %)**SDMX data type (BasicComponentDataType)**|(% style="width:284px" %)**Default VTL basic scalar type**
1676 -|(% style="width:366px" %)(((
1677 -**String**
1941 +|**SDMX data type (BasicComponentDataType)**|**Default VTL basic scalar type**
1942 +|(((
1943 +**String   **
1944 +
1678 1678  (string allowing any character)
1679 -)))|(% style="width:284px" %)**string**
1680 -|(% style="width:366px" %)(((
1681 -**Alpha   **
1946 +)))|**string**
1947 +|(((
1948 +**Alpha    **
1949 +
1682 1682  (string which only allows A-z)
1683 -)))|(% style="width:284px" %)**string**
1684 -|(% style="width:366px" %)(((
1685 -**AlphaNumeric**
1951 +)))|**string**
1952 +|(((
1953 +**AlphaNumeric  **
1954 +
1686 1686  (string which only allows A-z and 0-9)
1687 -)))|(% style="width:284px" %)**string**
1688 -|(% style="width:366px" %)(((
1689 -**Numeric**
1956 +)))|**string**
1957 +|(((
1958 +**Numeric   **
1959 +
1690 1690  (string which only allows 0-9, but is not numeric so that is can having leading zeros)
1691 -)))|(% style="width:284px" %)**string**
1692 -|(% style="width:366px" %)(((
1693 -**BigInteger**
1961 +)))|**string**
1962 +|(((
1963 +**BigInteger **
1964 +
1694 1694  (corresponds to XML Schema xs:integer datatype; infinite set of integer values)
1695 -)))|(% style="width:284px" %)**integer**
1696 -|(% style="width:366px" %)(((
1697 -**Integer**
1698 -(corresponds to XML Schema xs:int datatype; between -2147483648 and +2147483647 (inclusive))
1699 -)))|(% style="width:284px" %)**integer**
1700 -|(% style="width:366px" %)(((
1701 -**Long**
1702 -(corresponds to XML Schema xs:long datatype; between -9223372036854775808 and +9223372036854775807 (inclusive))
1703 -)))|(% style="width:284px" %)**integer**
1704 -|(% style="width:366px" %)(((
1705 -**Short**
1966 +)))|**integer**
1967 +|(((
1968 +**Integer **
1969 +
1970 +(corresponds to XML Schema xs:int datatype; between
1971 +
1972 +-2147483648 and +2147483647 (inclusive))
1973 +)))|**integer**
1974 +|(((
1975 +**Long **
1976 +
1977 +(corresponds to XML Schema xs:long datatype;
1978 +
1979 +between -9223372036854775808 and +9223372036854775807 (inclusive))
1980 +)))|**integer**
1981 +|(((
1982 +**Short **
1983 +
1706 1706  (corresponds to XML Schema xs:short datatype; between -32768 and -32767 (inclusive))
1707 -)))|(% style="width:284px" %)**integer**
1708 -|(% style="width:366px" %)(((
1985 +)))|**integer**
1986 +|(((
1709 1709  **Decimal**
1988 +
1710 1710  (corresponds to XML Schema xs:decimal datatype; subset of real numbers that can be represented as decimals)
1711 -)))|(% style="width:284px" %)**number**
1712 -|(% style="width:366px" %)(((
1713 -**Float**
1990 +)))|**number**
1991 +|(((
1992 +**Float **
1993 +
1714 1714  (corresponds to XML Schema xs:float datatype; patterned after the IEEE single-precision 32-bit floating point type)
1715 -)))|(% style="width:284px" %)**number**
1716 -|(% style="width:366px" %)(((
1717 -**Double**
1995 +)))|**number**
1996 +|(((
1997 +**Double **
1998 +
1718 1718  (corresponds to XML Schema xs:double datatype; patterned after the IEEE double-precision 64-bit floating point type)
1719 -)))|(% style="width:284px" %)**number**
1720 -|(% style="width:366px" %)(((
1721 -**Boolean**
1722 -(corresponds to the XML Schema xs:boolean datatype; support the mathematical concept of binary-valued logic: {true, false}) 
1723 -)))|(% style="width:284px" %)**boolean**
1724 -|(% style="width:366px" %)(((
1725 -**URI**
2000 +)))|**number**
2001 +|(((
2002 +**Boolean **
2003 +
2004 +(corresponds to the XML Schema xs:boolean datatype; support the mathematical concept of binary-valued logic: {true, false})
2005 +)))|**boolean**
2006 +|(((
2007 +**URI **
2008 +
1726 1726  (corresponds to the XML Schema xs:anyURI; absolute or relative Uniform Resource Identifier Reference)
1727 -)))|(% style="width:284px" %)**string**
1728 -|(% style="width:366px" %)(((
1729 -**Count**
2010 +)))|**string**
2011 +|(((
2012 +**Count   **
2013 +
1730 1730  (an integer following a sequential pattern, increasing by 1 for each occurrence)
1731 -)))|(% style="width:284px" %)**integer**
1732 -|(% style="width:366px" %)(((
1733 -**InclusiveValueRange**
2015 +)))|**integer**
2016 +|(((
2017 +**InclusiveValueRange **
2018 +
1734 1734  (decimal number within a closed interval, whose bounds are specified in the SDMX representation by the facets minValue and maxValue)
1735 -)))|(% style="width:284px" %)**number**
1736 -|(% style="width:366px" %)(((
1737 -**ExclusiveValueRange**
2020 +)))|**number**
2021 +|(((
2022 +**ExclusiveValueRange **
2023 +
1738 1738  (decimal number within an open interval, whose bounds are specified in the SDMX representation by the facets minValue and maxValue)
1739 -)))|(% style="width:284px" %)**number**
1740 -|(% style="width:366px" %)(((
1741 -**Incremental **
2025 +)))|**number**
2026 +|(((
2027 +**Incremental  **
2028 +
1742 1742  (decimal number the increased by a specific interval (defined by the interval facet), which is typically enforced outside of the XML validation)
1743 -)))|(% style="width:284px" %)**number**
1744 -|(% style="width:366px" %)(((
1745 -**ObservationalTimePeriod**
2030 +)))|**number**
2031 +|(((
2032 +**ObservationalTimePeriod   **
2033 +
1746 1746  (superset of StandardTimePeriod and TimeRange)
1747 -)))|(% style="width:284px" %)**time**
1748 -|(% style="width:366px" %)(((
1749 -**StandardTimePeriod**
2035 +)))|**time**
2036 +|(((
2037 +**StandardTimePeriod   **
2038 +
1750 1750  (superset of BasicTimePeriod and ReportingTimePeriod)
1751 -)))|(% style="width:284px" %)**time**
1752 -|(% style="width:366px" %)(((
1753 -**BasicTimePeriod**
2040 +)))|**time**
2041 +|(((
2042 +**BasicTimePeriod  **
2043 +
1754 1754  (superset of GregorianTimePeriod and DateTime)
1755 -)))|(% style="width:284px" %)**date**
1756 -|(% style="width:366px" %)(((
1757 -**GregorianTimePeriod**
2045 +)))|**date**
2046 +|(((
2047 +**GregorianTimePeriod   **
2048 +
1758 1758  (superset of GregorianYear, GregorianYearMonth, and GregorianDay)
1759 -)))|(% style="width:284px" %)**date**
1760 -|(% style="width:366px" %)**GregorianYear **(YYYY)  |(% style="width:284px" %)**date**
1761 -|(% style="width:366px" %)**GregorianYearMonth** / **GregorianMonth**    (YYYY-MM)|(% style="width:284px" %)**date**
1762 -|(% style="width:366px" %)**GregorianDay **(YYYY-MM-DD)|(% style="width:284px" %)**date**
1763 -|(% style="width:366px" %)(((
2050 +)))|**date**
2051 +|**GregorianYear     **(YYYY)  |**date**
2052 +|**GregorianYearMonth** / **GregorianMonth**    (YYYY-MM)|**date**
2053 +|**GregorianDay    **(YYYY-MM-DD)|**date**
2054 +|(((
1764 1764  **ReportingTimePeriod **
1765 -(superset of RepostingYear, ReportingSemester, ReportingTrimester, ReportingQuarter, ReportingMonth, ReportingWeek, ReportingDay)
1766 -)))|(% style="width:284px" %)**time_period**
1767 -|(% style="width:366px" %)(((
1768 -**ReportingYear**
2056 +
2057 +(superset of RepostingYear, ReportingSemester,
2058 +
2059 +ReportingTrimester, ReportingQuarter, ReportingMonth,
2060 +
2061 +ReportingWeek, ReportingDay)
2062 +)))|**time_period**
2063 +|(((
2064 +**ReportingYear   **
2065 +
1769 1769  (YYYY-A1 – 1 year period)
1770 -)))|(% style="width:284px" %)**time_period**
1771 -|(% style="width:366px" %)(((
1772 -**ReportingSemester**
2067 +)))|**time_period**
2068 +|(((
2069 +**ReportingSemester  **
2070 +
1773 1773  (YYYY-Ss – 6 month period)
1774 -)))|(% style="width:284px" %)**time_period**
1775 -|(% style="width:366px" %)(((
1776 -**ReportingTrimester**
2072 +)))|**time_period**
2073 +|(((
2074 +**ReportingTrimester **
2075 +
1777 1777  (YYYY-Tt – 4 month period)
1778 -)))|(% style="width:284px" %)**time_period**
1779 -|(% style="width:366px" %)(((
1780 -**ReportingQuarter**
2077 +)))|**time_period**
2078 +|(((
2079 +**ReportingQuarter   **
2080 +
1781 1781  (YYYY-Qq – 3 month period)
1782 -)))|(% style="width:284px" %)**time_period**
1783 -|(% style="width:366px" %)(((
1784 -**ReportingMonth**
2082 +)))|**time_period**
2083 +|(((
2084 +**ReportingMonth   **
2085 +
1785 1785  (YYYY-Mmm – 1 month period)
1786 -)))|(% style="width:284px" %)**time_period**
1787 -|(% style="width:366px" %)(((
1788 -**ReportingWeek**
2087 +)))|**time_period**
2088 +|(((
2089 +**ReportingWeek   **
2090 +
1789 1789  (YYYY-Www – 7 day period; following ISO 8601 definition of a week in a year)
1790 -)))|(% style="width:284px" %)**time_period**
1791 -|(% style="width:366px" %)(((
1792 -**ReportingDay**
2092 +)))|**time_period**
2093 +|(((
2094 +**ReportingDay   **
2095 +
1793 1793  (YYYY-Dddd – 1 day period)
1794 -)))|(% style="width:284px" %)**time_period**
1795 -|(% style="width:366px" %)(((
1796 -**DateTime**
2097 +)))|**time_period**
2098 +|(((
2099 +**DateTime  **
2100 +
1797 1797  (YYYY-MM-DDThh:mm:ss)
1798 -)))|(% style="width:284px" %)**date**
1799 -|(% style="width:366px" %)(((
2102 +)))|**date**
2103 +|(((
1800 1800  **TimeRange   **
1801 1801  
1802 1802  (YYYY-MM-DD(Thh:mm:ss)?/<duration>)
1803 -)))|(% style="width:284px" %)**time**
1804 -|(% style="width:366px" %)(((
1805 -**Month**
1806 -(~-~-MM; speicifies a month independent of a year; e.g. February is black history month in the United States)
1807 -)))|(% style="width:284px" %)**string**
1808 -|(% style="width:366px" %)(((
1809 -**MonthDay**
2107 +)))|**time**
2108 +|(((
2109 +**Month   **
2110 +
2111 +(~-~-MM; speicifies a month independent of a year; e.g.
2112 +
2113 +February is black history month in the United States)
2114 +)))|**string**
2115 +|(((
2116 +**MonthDay   **
2117 +
1810 1810  (~-~-MM-DD; specifies a day within a month independent of a year; e.g. Christmas is December 25^^th^^;  used to specify reporting year start day)
1811 -)))|(% style="width:284px" %)**string**
1812 -|(% style="width:366px" %)(((
1813 -**Day**
2119 +)))|**string**
2120 +|(((
2121 +**Day   **
2122 +
1814 1814  (~-~--DD; specifies a day independent of a month or year; e.g. the 15^^th^^ is payday)
1815 -)))|(% style="width:284px" %)**string**
1816 -|(% style="width:366px" %)(((
1817 -**Time**
2124 +)))|**string**
2125 +|(((
2126 +**Time   **
2127 +
1818 1818  (hh:mm:ss; time independent of a date; e.g. coffee break is at 10:00 AM)
1819 -)))|(% style="width:284px" %)**string**
1820 -|(% style="width:366px" %)(((
1821 -**Duration**
2129 +)))|**string**
2130 +|(((
2131 +**Duration **
2132 +
1822 1822  (corresponds to XML Schema xs:duration datatype)
1823 -)))|(% style="width:284px" %)**duration**
1824 -|(% style="width:366px" %)XHTML|(% style="width:284px" %)Metadata type – not applicable
1825 -|(% style="width:366px" %)KeyValues|(% style="width:284px" %)Metadata type – not applicable
1826 -|(% style="width:366px" %)IdentifiableReference|(% style="width:284px" %)Metadata type – not applicable
1827 -|(% style="width:366px" %)DataSetReference|(% style="width:284px" %)Metadata type – not applicable
1828 -|(% style="width:366px" %)AttachmentConstraintReference|(% style="width:284px" %)Metadata type – not applicable
2134 +)))|**duration**
2135 +|XHTML|Metadata type – not applicable
2136 +|KeyValues|Metadata type – not applicable
2137 +|IdentifiableReference|Metadata type – not applicable
2138 +|DataSetReference|Metadata type – not applicable
2139 +|AttachmentConstraintReference|Metadata type – not applicable
1829 1829  
2141 +
2142 +
1830 1830  **Figure 14 – Mappings from SDMX data types to VTL Basic Scalar Types**
1831 1831  
1832 1832  When VTL takes in input SDMX artefacts, it is assumed that a type conversion according to the table above always happens. In case a different VTL basic scalar type is desired, it can be achieved in the VTL program taking in input the default VTL basic scalar type above and applying to it the VTL type conversion features (see the implicit and explicit type conversion and the “cast” operator in the VTL Reference Manual).
1833 1833  
1834 -=== 10.4.4 Mapping VTL basic scalar types to SDMX data types ===
2147 +=== 10.4.4 Mapping VTL basic scalar types to SDMX data types ===
1835 1835  
1836 1836  The following table describes the default conversion from the VTL basic scalar types to the SDMX data types .
1837 1837  
1838 -(% style="width:923.835px" %)
1839 -|(% style="width:191px" %)**VTL basic scalar type**|(% style="width:419px" %)**Default SDMX data type (BasicComponentDataType)**|(% style="width:311px" %)**Default output format**
1840 -|(% style="width:191px" %)**String**|(% style="width:419px" %)**String **|(% style="width:311px" %)Like XML (xs:string)
1841 -|(% style="width:191px" %)**Number**|(% style="width:419px" %)**Float **|(% style="width:311px" %)Like XML (xs:float)
1842 -|(% style="width:191px" %)**Integer**|(% style="width:419px" %)**Integer **|(% style="width:311px" %)Like XML (xs:int)
1843 -|(% style="width:191px" %)**Date**|(% style="width:419px" %)**DateTime**|(% style="width:311px" %)YYYY-MM-DDT00:00:00Z
1844 -|(% style="width:191px" %)**Time**|(% style="width:419px" %)**StandardTimePeriod**|(% style="width:311px" %)<date>/<date> (as defined above)
1845 -|(% style="width:191px" %)**time_period**|(% style="width:419px" %)(((
1846 -**ReportingTimePeriod
1847 -(StandardReportingPeriod)**
1848 -)))|(% style="width:311px" %)(((
2151 +|**VTL basic scalar type**|**Default SDMX data type (BasicComponentDataType)**|**Default output format**
2152 +|**String**|**String **|Like XML (xs:string)
2153 +|**Number**|**Float **|Like XML (xs:float)
2154 +|**Integer**|**Integer **|Like XML (xs:int)
2155 +|**Date**|**DateTime**|YYYY-MM-DDT00:00:00Z
2156 +|**Time**|**StandardTimePeriod**|<date>/<date> (as defined above)
2157 +|**time_period**|(((
2158 +**ReportingTimePeriod**
2159 +
2160 +**(StandardReportingPeriod)**
2161 +)))|(((
1849 1849   YYYY-Pppp
2163 +
1850 1850  (according to SDMX )
1851 1851  )))
1852 -|(% style="width:191px" %)**Duration**|(% style="width:419px" %)**Duration **|(% style="width:311px" %)(((
2166 +|**Duration**|**Duration **|(((
1853 1853  Like XML (xs:duration)
2168 +
1854 1854  PnYnMnDTnHnMnS
1855 1855  )))
1856 -|(% style="width:191px" %)**Boolean**|(% style="width:419px" %)**Boolean **|(% style="width:311px" %)(((
1857 -Like XML (xs:boolean) with the values “true” or “false”
2171 +|**Boolean**|**Boolean **|(((
2172 +Like XML (xs:boolean) with the values
2173 +
2174 +“true” or “false”
1858 1858  )))
1859 1859  
1860 1860  **Figure 14 – Mappings from SDMX data types to VTL Basic Scalar Types**
1861 1861  
1862 -In case a different default conversion is desired, it can be achieved through the CustomTypeScheme and CustomType artefacts (see also the section Transformations and Expressions of the SDMX information model).
2179 +In case a different default conversion is desired, it can be achieved through the
1863 1863  
2181 +CustomTypeScheme and CustomType artefacts (see also the section Transformations and Expressions of the SDMX information model).
2182 +
1864 1864  The custom output formats can be specified by means of the VTL formatting mask described in the section “Type Conversion and Formatting Mask” of the VTL Reference Manual. Such a section describes the masks for the VTL basic scalar types “number”, “integer”, “date”, “time”, “time_period” and “duration” and gives examples. As for the types “string” and “boolean” the VTL conventions are extended with some other special characters as described in the following table.
1865 1865  
1866 -(% style="width:671.835px" %)
1867 -|(% colspan="2" style="width:669px" %)**VTL special characters for the formatting masks**
1868 -|(% colspan="2" style="width:669px" %)** **
1869 -|(% colspan="2" style="width:669px" %)**Number **
1870 -|(% style="width:141px" %)D|(% style="width:528px" %)one numeric digit (if the scientific notation is adopted, D is only for the mantissa)
1871 -|(% style="width:141px" %)E|(% style="width:528px" %)one numeric digit (for the exponent of the scientific notation)
1872 -|(% style="width:141px" %).    (dot)|(% style="width:528px" %)possible separator between the integer and the decimal parts.
1873 -|(% style="width:141px" %),   (comma)|(% style="width:528px" %)possible separator between the integer and the decimal parts.
1874 -|(% style="width:141px" %) |(% style="width:528px" %)
1875 -|(% colspan="2" style="width:669px" %)**Time and duration**
1876 -|(% style="width:141px" %)C |(% style="width:528px" %)century
1877 -|(% style="width:141px" %)Y|(% style="width:528px" %)year
1878 -|(% style="width:141px" %)S|(% style="width:528px" %)semester
1879 -|(% style="width:141px" %)Q|(% style="width:528px" %)quarter
1880 -|(% style="width:141px" %)M|(% style="width:528px" %)month
1881 -|(% style="width:141px" %)W|(% style="width:528px" %)week
1882 -|(% style="width:141px" %)D|(% style="width:528px" %)day
1883 -|(% style="width:141px" %)h |(% style="width:528px" %)hour digit (by default on 24 hours)
1884 -|(% style="width:141px" %)M|(% style="width:528px" %)minute
1885 -|(% style="width:141px" %)S|(% style="width:528px" %)second
1886 -|(% style="width:141px" %)D|(% style="width:528px" %)decimal of second
1887 -|(% style="width:141px" %)P|(% style="width:528px" %)period indicator (representation in one digit for the duration)
1888 -|(% style="width:141px" %)P|(% style="width:528px" %)number of the periods specified in the period indicator
1889 -|(% style="width:141px" %)AM/PM |(% style="width:528px" %)indicator of AM / PM (e.g. am/pm for “am” or “pm”)
1890 -|(% style="width:141px" %)MONTH|(% style="width:528px" %)uppercase textual representation of the month (e.g., JANUARY for January)
1891 -|(% style="width:141px" %)DAY|(% style="width:528px" %)uppercase textual representation of the day (e.g., MONDAY for Monday)
1892 -|(% style="width:141px" %)Month|(% style="width:528px" %)lowercase textual representation of the month (e.g., january)
1893 -|(% style="width:141px" %)Day|(% style="width:528px" %)lowercase textual representation of the month (e.g., monday)
1894 -|(% style="width:141px" %)Month|(% style="width:528px" %)First character uppercase, then lowercase textual representation of the month (e.g., January)
1895 -|(% style="width:141px" %)Day|(% style="width:528px" %)First character uppercase, then lowercase textual representation of the day using (e.g. Monday)
1896 -|(% style="width:141px" %) |(% style="width:528px" %)
1897 -|(% colspan="2" style="width:669px" %)**String  **
1898 -|(% style="width:141px" %)X|(% style="width:528px" %)any string character
1899 -|(% style="width:141px" %)Z|(% style="width:528px" %)any string character from “A” to “z”
1900 -|(% style="width:141px" %)9|(% style="width:528px" %)any string character from “0” to “9”
1901 -|(% style="width:141px" %) |(% style="width:528px" %)
1902 -|(% colspan="2" style="width:669px" %)**Boolean **
1903 -|(% style="width:141px" %)B|(% style="width:528px" %)Boolean using “true” for True and “false” for False
1904 -|(% style="width:141px" %)1|(% style="width:528px" %)Boolean using “1” for True and “0” for False
1905 -|(% style="width:141px" %)0|(% style="width:528px" %)Boolean using “0” for True and “1” for False
1906 -|(% style="width:141px" %) |(% style="width:528px" %)
1907 -|(% colspan="2" style="width:669px" %)Other qualifiers
1908 -|(% style="width:141px" %)*|(% style="width:528px" %)an arbitrary number of digits (of the preceding type)
1909 -|(% style="width:141px" %)+|(% style="width:528px" %)at least one digit (of the preceding type)
1910 -|(% style="width:141px" %)( )|(% style="width:528px" %)optional digits (specified within the brackets)
1911 -|(% style="width:141px" %)\|(% style="width:528px" %)prefix for the special characters that must appear in the mask
1912 -|(% style="width:141px" %)N|(% style="width:528px" %)fixed number of digits used in the preceding  textual representation of the month or the day
1913 -|(% style="width:141px" %) |(% style="width:528px" %)
2185 +|(% colspan="2" %)**VTL special characters for the formatting masks**
2186 +|(% colspan="2" %)** **
2187 +|(% colspan="2" %)**Number **
2188 +|D|one numeric digit (if the scientific notation is adopted, D is only for the mantissa)
2189 +|E|one numeric digit (for the exponent of the scientific notation)
2190 +|.    (dot)|possible separator between the integer and the decimal parts.
2191 +|,   (comma)|possible separator between the integer and the decimal parts.
2192 +| |
2193 +|(% colspan="2" %)**Time and duration**
2194 +|C |century
2195 +|Y|year
2196 +|S|semester
2197 +|Q|quarter
2198 +|M|month
2199 +|W|week
2200 +|D|day
2201 +|h |hour digit (by default on 24 hours)
2202 +|M|minute
2203 +|S|second
2204 +|D|decimal of second
2205 +|P|period indicator (representation in one digit for the duration)
2206 +|P|number of the periods specified in the period indicator
2207 +|AM/PM |indicator of AM / PM (e.g. am/pm for “am” or “pm”)
2208 +|MONTH|uppercase textual representation of the month (e.g., JANUARY for January)
2209 +|DAY|uppercase textual representation of the day (e.g., MONDAY for Monday)
2210 +|Month|lowercase textual representation of the month (e.g., january)
2211 +|Day|lowercase textual representation of the month (e.g., monday)
2212 +|Month|First character uppercase, then lowercase textual representation of the month (e.g., January)
2213 +|Day|First character uppercase, then lowercase textual representation of the day using (e.g. Monday)
2214 +| |
2215 +|(% colspan="2" %)**String  **
2216 +|X|any string character
2217 +|Z|any string character from “A” to “z”
2218 +|9|any string character from “0” to “9”
2219 +| |
2220 +|(% colspan="2" %)**Boolean **
2221 +|B|Boolean using “true” for True and “false” for False
2222 +|1|Boolean using “1” for True and “0” for False
2223 +|0|Boolean using “0” for True and “1” for False
2224 +| |
2225 +|(% colspan="2" %)Other qualifiers
2226 +|*|an arbitrary number of digits (of the preceding type)
2227 +|+|at least one digit (of the preceding type)
2228 +|( )|optional digits (specified within the brackets)
2229 +|\|prefix for the special characters that must appear in the mask
2230 +|N|fixed number of digits used in the preceding  textual representation of the month or the day
2231 +| |
1914 1914  
1915 -The default conversion, either standard or customized, can be used to deduce automatically the representation of the components of the result of a VTL transformation. In alternative, the representation of the resulting SDMX Dataflow can be given explicitly by providing its DataStructureDefinition. In other words, the representation specified in the DSD, if available, overrides any default conversion[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[43~]^^>>path:#_ftn43]](%%).
2233 +The default conversion, either standard or customized, can be used to deduce automatically the representation of the components of the result of a VTL transformation. In alternative, the representation of the resulting SDMX Dataflow can be given explicitly by providing its DataStructureDefinition. In other words, the representation specified in the DSD, if available, overrides any default conversion[[^^~[43~]^^>>path:#_ftn43]].
1916 1916  
1917 1917  === 10.4.5 Null Values ===
1918 1918  
... ... @@ -1932,8 +1932,10 @@
1932 1932  
1933 1933  A different format can be specified in the attribute “vtlLiteralFormat” of the CustomType artefact (see also the section Transformations and Expressions of the SDMX information model).
1934 1934  
1935 -Like in the case of the conversion of NULLs described in the previous paragraph, the overriding assumption is applied, for a certain VTL basic scalar type, if a value is found for the vtlLiteralFormat attribute of the CustomType of such VTL basic scalar type. The overriding assumption is applied for all the literals of a related VTL TransformationScheme.
2253 +Like in the case of the conversion of NULLs described in the previous paragraph, the overriding assumption is applied, for a certain VTL basic scalar type, if a value is found for the vtlLiteralFormat attribute of the CustomType of such VTL basic scalar type. The overriding assumption is applied for all the literals of a related VTL
1936 1936  
2255 +TransformationScheme.
2256 +
1937 1937  In case a literal is operand of a VTL Cast operation, the format specified in the Cast overrides all the possible otherwise specified formats.
1938 1938  
1939 1939  = 11 Annex I: How to eliminate extra element in the .NET SDMX Web Service =
... ... @@ -1942,18 +1942,12 @@
1942 1942  
1943 1943  For implementing an SDMX compliant Web Service the standardised WSDL file should be used that describes the expected request/response structure. The request message of the operation contains a wrapper element (e.g. “GetGenericData”) that wraps a tag called “GenericDataQuery”, which is the actual SDMX query XML message that contains the query to be processed by the Web Service. In the same way the response is formulated in a wrapper element “GetGenericDataResponse”.
1944 1944  
1945 -As defined in the SOAP specification, the root element of a SOAP message is the Envelope, which contains an optional Header and a mandatory Body. These are illustrated below along with the Body contents according to the WSDL:
2265 +As defined in the SOAP specification, the root element of a SOAP message is the Envelope, which contains an optional Header and a mandatory Body. These are illustrated below along with the Body contents according to the WSDL:
1946 1946  
1947 -[[image:1747854006117-843.png]]
1948 -
1949 1949  The problem that initiated the present analysis refers to the difference in the way SOAP requests are when trying to implement the aforementioned Web Service in .NET framework.
1950 1950  
1951 1951  Building such a Web Service using the .NET framework is done by exposing a method (i.e. the getGenericData in the example) with an XML document argument (lets name it “Query”). **The difference that appears in Microsoft .Net implementations is that there is a need for an extra XML container around the SDMX GenericDataQuery.** This is the expected behavior since the framework is let to publish automatically the Web Service as a remote procedure call, thus wraps each parameter into an extra element. The .NET request is illustrated below:
1952 1952  
1953 -[[image:1747854039499-443.png]]
1954 -
1955 -[[image:1747854067769-691.png]]
1956 -
1957 1957  Furthermore this extra element is also inserted in the automatically generated WSDL from the framework. Therefore this particularity requires custom clients for the .NET Web Services that is not an interoperable solution.
1958 1958  
1959 1959  == 11.2 Solution ==
... ... @@ -1974,30 +1974,20 @@
1974 1974  
1975 1975  To understand how the **XmlAnyElement** attribute works we present the following two web methods:
1976 1976  
1977 -[[image:1747854096778-844.png]]
2291 +In this method the **input** parameter is decorated with the **XmlAnyElement** parameter. This is a hint that this parameter will be de-serialized from an **xsd:any** element. Since the attribute is not passed any parameters, it means that the entire XML element for this parameter in the SOAP message will be in the Infoset that is represented by this **XmlElement** parameter.
1978 1978  
1979 -In this method the **input** parameter is decorated with the **XmlAnyElement** parameter. This is a hint that this parameter will be de-serialized from an **xsd:any** element. Since the attribute is not passed any parameters, it means that the entire XML element for this parameter in the SOAP message will be in the Infoset that is represented by this **XmlElement** parameter.
2293 +The difference between the two is that for the first method, **SubmitXml**, the
1980 1980  
1981 -[[image:1747854127303-270.png]]
2295 +XmlSerializer will expect an element named **input** to be an immediate child of the **SubmitXml** element in the SOAP body. The second method, **SubmitXmlAny**, will not care what the name of the child of the **SubmitXmlAny** element is. It will plug whatever XML is included into the input parameter. The message style from ASP.NET Help for the two methods is shown below. First we look at the message for the method without the **XmlAnyElement** attribute.
1982 1982  
1983 -The difference between the two is that for the first method, **SubmitXml**, the XmlSerializer will expect an element named **input** to be an immediate child of the **SubmitXml** element in the SOAP body. The second method, **SubmitXmlAny**, will not care what the name of the child of the **SubmitXmlAny** element is. It will plug whatever XML is included into the input parameter. The message style from ASP.NET Help for the two methods is shown below. First we look at the message for the method without the **XmlAnyElement** attribute.
1984 -
1985 -[[image:1747854163928-581.png]]
1986 -
1987 1987  Now we look at the message for the method that uses the **XmlAnyElement** attribute.
1988 1988  
1989 -[[image:1747854190641-364.png]]
1990 -
1991 -[[image:1747854236732-512.png]]
1992 -
1993 1993  The method decorated with the **XmlAnyElement** attribute has one fewer wrapping elements. Only an element with the name of the method wraps what is passed to the **input** parameter.
1994 1994  
1995 -For more information please consult: [[http:~~/~~/msdn.microsoft.com/en-us/library/aa480498.aspx>>http://msdn.microsoft.com/en-us/library/aa480498.aspx]]
2301 +For more information please consult:  [[http:~~/~~/msdn.microsoft.com/en>>url:http://msdn.microsoft.com/en-us/library/aa480498.aspx]][[->>url:http://msdn.microsoft.com/en-us/library/aa480498.aspx]][[us/library/aa480498.aspx>>url:http://msdn.microsoft.com/en-us/library/aa480498.aspx]][[url:http://msdn.microsoft.com/en-us/library/aa480498.aspx]]
1996 1996  
1997 1997  Furthermore at this point the problem with the different requests has been solved. However there is still the difference in the produced WSDL that has to be taken care. The automatic generated WSDL now doesn’t insert the extra element, but defines the content of the operation wrapper element as “xsd:any” type.
1998 1998  
1999 -[[image:1747854286398-614.png]]
2000 -
2001 2001  Without a common WSDL still the solution doesn’t enforce interoperability. In order to
2002 2002  
2003 2003  “fix” the WSDL, there two approaches. The first is to intervene in the generation process. This is a complicated approach, compared to the second approach, which overrides the generation process and returns the envisioned WSDL for the SDMX Web Service.
... ... @@ -2010,27 +2010,16 @@
2010 2010  
2011 2011  In the context of the SDMX Web Service, applying the above solution translates into the following:
2012 2012  
2013 -[[image:1747854385465-132.png]]
2014 -
2015 2015  The SOAP request/response will then be as follows:
2016 2016  
2017 2017  **GenericData Request**
2018 2018  
2019 -[[image:1747854406014-782.png]]
2020 -
2021 2021  **GenericData Response**
2022 2022  
2023 -[[image:1747854424488-855.png]]
2024 -
2025 2025  For overriding the automatically produced WSDL, in the solution explorer right click the project and select “Add” -> “New item…”. Then select the “Global Application Class”. This will create “.asax” class file in which the following code should replace the existing empty method:
2026 2026  
2027 -[[image:1747854453895-524.png]]
2028 -
2029 -[[image:1747854476631-125.png]]
2030 -
2031 2031  The SDMX_WSDL.wsdl should reside in the in the root directory of the application. After applying this solution the returned WSDL is the envisioned. Thus in the request message definition contains:
2032 2032  
2033 -[[image:1747854493363-776.png]]
2034 2034  
2035 2035  ----
2036 2036  
... ... @@ -2123,5 +2123,3 @@
2123 2123  [[~[42~]>>path:#_ftnref42]] A Concept becomes a Component in a DataStructureDefinition, and Components can have different LocalRepresentations in different DataStructureDefinitions, also overriding the (possible) base representation of the Concept.
2124 2124  
2125 2125  [[~[43~]>>path:#_ftnref43]] The representation given in the DSD should obviously be compatible with the VTL data type.
2126 -
2127 -{{putFootnotes/}}
1747854006117-843.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -18.7 KB
Content
1747854039499-443.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -3.0 KB
Content
1747854067769-691.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -21.4 KB
Content
1747854096778-844.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -10.6 KB
Content
1747854127303-270.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -12.1 KB
Content
1747854163928-581.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -29.8 KB
Content
1747854190641-364.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -31.5 KB
Content
1747854236732-512.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -2.0 KB
Content
1747854286398-614.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747854385465-132.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747854406014-782.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747854424488-855.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747854453895-524.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747854476631-125.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747854493363-776.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747855024745-946.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747855054559-410.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747855075263-887.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747855402867-579.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747855462293-368.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747855493531-357.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747856459132-767.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747859398930-848.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747859458410-183.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747859612718-454.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -55.0 KB
Content
1747859722732-549.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.helena
Size
... ... @@ -1,1 +1,0 @@
1 -18.8 KB
Content
© Semantic R&D Group, 2026