Changes for page SDMX 2.1 Standards. Section 6. Technical Notes
Last modified by Artur K. on 2026/05/29 14:28
Summary
-
Page properties (2 modified, 0 added, 0 removed)
-
Attachments (0 modified, 26 added, 0 removed)
- 1747854006117-843.png
- 1747854039499-443.png
- 1747854067769-691.png
- 1747854096778-844.png
- 1747854127303-270.png
- 1747854163928-581.png
- 1747854190641-364.png
- 1747854236732-512.png
- 1747854286398-614.png
- 1747854385465-132.png
- 1747854406014-782.png
- 1747854424488-855.png
- 1747854453895-524.png
- 1747854476631-125.png
- 1747854493363-776.png
- 1747855024745-946.png
- 1747855054559-410.png
- 1747855075263-887.png
- 1747855402867-579.png
- 1747855462293-368.png
- 1747855493531-357.png
- 1747856459132-767.png
- 1747859398930-848.png
- 1747859458410-183.png
- 1747859612718-454.png
- 1747859722732-549.png
Details
- Page properties
-
- Author
-
... ... @@ -1,1 +1,1 @@ 1 -xwiki:XWiki.he lena1 +xwiki:XWiki.arturkryazhev - Content
-
... ... @@ -4,10 +4,11 @@ 4 4 5 5 **Revision History** 6 6 7 -|**Revision**|**Date**|**Contents** 8 -| |April 2011|Initial release 9 -|1.0|April 2013|Added section 9 - Transforming between versions of SDMX 10 -|2.0|July 2020|Added section 10 – Validation and Transformation Language – before the Annex 1. 7 +(% style="width:954.835px" %) 8 +|(% style="width:106px" %)**Revision**|(% style="width:124px" %)**Date**|(% style="width:723px" %)**Contents** 9 +|(% style="width:106px" %) |(% style="width:124px" %)April 2011|(% style="width:723px" %)Initial release 10 +|(% style="width:106px" %)1.0|(% style="width:124px" %)April 2013|(% style="width:723px" %)Added section 9 - Transforming between versions of SDMX 11 +|(% style="width:106px" %)2.0|(% style="width:124px" %)July 2020|(% style="width:723px" %)Added section 10 – Validation and Transformation Language – before the Annex 1. 11 11 12 12 = 1 Purpose and Structure = 13 13 ... ... @@ -41,7 +41,7 @@ 41 41 42 42 === 3.2.1 Introduction === 43 43 44 -The purpose of this sub-section is to provide an introduction to the SDMX-IM relating to Data Structure Definitions and Data Sets for those whose primary interest is in the use of the XML or EDI formats. For those wishing to have a deeper understanding of the Information Model, the full SDMX-IM document, and other sections in this guide provide a more in-depth view, along with UML diagrams and supporting explanation. For those who are unfamiliar with DSDs, an appendix to the SDMX-IM provides a tutorial which may serve as a useful introduction.45 +The purpose of this sub-section is to provide an introduction to the SDMX-IM relating to Data Structure Definitions and Data Sets for those whose primary interest is in the use of the XML or EDI formats. For those wishing to have a deeper understanding of the Information Model, the full SDMX-IM document, and other sections in this guide provide a more in-depth view, along with UML diagrams and supporting explanation. For those who are unfamiliar with DSDs, an appendix to the SDMX-IM provides a tutorial which may serve as a useful introduction. 45 45 46 46 The SDMX-IM is used to describe the basic data and metadata structures used in all of the SDMX data formats. The Information Model concerns itself with statistical data and its structural metadata, and that is what is described here. Both structural metadata and data have some additional metadata in common, related to their management and administration. These aspects of the data model are not addressed in this section and covered elsewhere in this guide or in the full SDMX-IM document. 47 47 ... ... @@ -69,13 +69,13 @@ 69 69 70 70 To allow for applications which only understand time series data, variations of these formats have been introduced in the form of two data messages; //GenericTimeSeriesData// and //StructureSpecificTimeSeriesData//. It is important to note that these variations are built on the same root structure and can be processed in the same manner as the base format so that they do NOT introduce additional processing requirements. 71 71 72 - ===//Structure Definition//===73 +**//Structure Definition//** 73 73 74 74 The SDMX-ML Structure Message supports the use of annotations to the structure, which is not supported by the SDMX-EDI syntax. 75 75 76 76 The SDMX-ML Structure Message allows for the structures on which a Data Structure Definition depends – that is, codelists and concepts – to be either included in the message or to be referenced by the message containing the data structure definition. XML syntax is designed to leverage URIs and other Internet-based referencing mechanisms, and these are used in the SDMX-ML message. This option is not available to those using the SDMX-EDI structure message. 77 77 78 - ===//Validation//===79 +**//Validation//** 79 79 80 80 SDMX-EDI – as is typical of EDIFACT syntax messages – leaves validation to dedicated applications (“validation” being the checking of syntax, data typing, and adherence of the data message to the structure as described in the structural definition.) 81 81 ... ... @@ -83,19 +83,19 @@ 83 83 84 84 The SDMX-ML DSD-specific messages will allow validation of XML syntax and datatyping to be performed with a generic XML parser, and enforce agreement between the structural definition and the data to a moderate degree with the same tool. 85 85 86 - ===//Update and Delete Messages and Documentation Messages//===87 +//Update and Delete Messages and Documentation Messages// 87 87 88 88 All SDMX data messages allow for both delete messages and messages consisting of only data or only documentation. 89 89 90 - ===//Character Encodings//===91 +**//Character Encodings//** 91 91 92 92 All SDMX-ML messages use the UTF-8 encoding, while SDMX-EDI uses the ISO 8879-1 character encoding. There is a greater capacity with UTF-8 to express some character sets (see the “APPENDIX: MAP OF ISO 8859-1 (UNOC) CHARACTER SET (LATIN 1 OR “WESTERN”) in the document “SYNTAX AND DOCUMENTATION VERSION 2.0”.) Many transformation tools are available which allow XML instances with UTF-8 encodings to be expressed as ISO 8879-1-encoded characters, and to transform UTF-8 into ISO 8879-1. Such tools should be used when transforming SDMX-ML messages into SDMX-EDI messages and vice-versa. 93 93 94 - ===//Data Typing//===95 +**//Data Typing//** 95 95 96 96 The XML syntax and EDIFACT syntax have different data-typing mechanisms. The section below provides a set of conventions to be observed when support for messages in both syntaxes is required. For more information on the SDMX-ML representations of data, see below. 97 97 98 -=== =3.3.2 Data Types ====99 +=== 3.3.2 Data Types === 99 99 100 100 The XML syntax has a very different mechanism for data-typing than the EDIFACT syntax, and this difference may create some difficulties for applications which support both EDIFACT-based and XML-based SDMX data formats. This section provides a set of conventions for the expression in data in all formats, to allow for clean interoperability between them. 101 101 ... ... @@ -145,7 +145,7 @@ 145 145 146 146 ==== 3.4.1.1 Central Institutions and Their Role in Statistical Data Exchanges ==== 147 147 148 -Central institutions are the organisations to which other partner institutions "report" statistics. These statistics are used by central institutions either to compile aggregates and/or they are put together and made available in a uniform manner (e.g. on-line or on a CD-ROM or through file transfers). Therefore, central institutions receive data from other institutions and, usually, they also "disseminate" data to individual and/or institutions for end-use. Within a country, a NSI or a national central bank (NCB) plays, of course, a central institution role as it collects data from other entities and it disseminates statistical information to end users. In SDMX the role of central institution is very important: every statistical message is based on underlying structural definitions (statistical concepts, code lists, DSDs) which have been devised by a particular agency, usually a central institution. Such an institution plays the role of the reference "structural definitions maintenance agency" for the corresponding messages which are exchanged. Of course, two institutions could exchange data using/referring to structural information devised by a third institution.149 +Central institutions are the organisations to which other partner institutions "report" statistics. These statistics are used by central institutions either to compile aggregates and/or they are put together and made available in a uniform manner (e.g. on-line or on a CD-ROM or through file transfers). Therefore, central institutions receive data from other institutions and, usually, they also "disseminate" data to individual and/or institutions for end-use. Within a country, a NSI or a national central bank (NCB) plays, of course, a central institution role as it collects data from other entities and it disseminates statistical information to end users. In SDMX the role of central institution is very important: every statistical message is based on underlying structural definitions (statistical concepts, code lists, DSDs) which have been devised by a particular agency, usually a central institution. Such an institution plays the role of the reference "structural definitions maintenance agency" for the corresponding messages which are exchanged. Of course, two institutions could exchange data using/referring to structural information devised by a third institution. 149 149 150 150 Central institutions can play a double role: 151 151 ... ... @@ -159,13 +159,13 @@ 159 159 (% class="wikigeneratedid" id="HDimensions2CAttributesandCodeLists" %) 160 160 __Dimensions, Attributes and Code Lists__ 161 161 162 -**//Avoid dimensions that are not appropriate for all the series in the data structure definition.//** If some dimensions are not applicable (this is evident from the need to have a code in a code list which is marked as “not applicable”, “not relevant” or “total”) for some series then consider moving these series to a new data structure definition in which these dimensions are dropped from the key structure. This is a judgement call as it is sometimes difficult to achieve this without increasing considerably the number of DSDs.163 +**//Avoid dimensions that are not appropriate for all the series in the data structure definition.//** If some dimensions are not applicable (this is evident from the need to have a code in a code list which is marked as “not applicable”, “not relevant” or “total”) for some series then consider moving these series to a new data structure definition in which these dimensions are dropped from the key structure. This is a judgement call as it is sometimes difficult to achieve this without increasing considerably the number of DSDs. 163 163 164 164 **//Devise DSDs with a small number of Dimensions for public viewing of data.//** A DSD with the number dimensions in excess 6 or 7 is often difficult for non specialist users to understand. In these cases it is better to have a larger number of DSDs with smaller “cubes” of data, or to eliminate dimensions and aggregate the data at a higher level. Dissemination of data on the web is a growing use case for the SDMX standards: the differentiation of observations by dimensionality which are necessary for statisticians and economists are often obscure to public consumers who may not always understand the semantic of the differentiation. 165 165 166 -**//Avoid composite dimensions.//** Each dimension should correspond to a single characteristic of the data, not to a combination of characteristics.167 +**//Avoid composite dimensions.//** Each dimension should correspond to a single characteristic of the data, not to a combination of characteristics. 167 167 168 -**//Consider the inclusion of the following attributes//**. Once the key structure of a data structure definition has been decided, then the set of (preferably mandatory) attributes of this data structure definition has to be defined. In general, some statistical concepts are deemed necessary across all Data Structure Definitions to qualify the contained information. Examples of these are:169 +**//Consider the inclusion of the following attributes//**. Once the key structure of a data structure definition has been decided, then the set of (preferably mandatory) attributes of this data structure definition has to be defined. In general, some statistical concepts are deemed necessary across all Data Structure Definitions to qualify the contained information. Examples of these are: 169 169 170 170 * A descriptive title for the series (this is most useful for dissemination of data for viewing e.g. on the web) 171 171 * Collection (e.g. end of period, averaged or summed over period) ... ... @@ -187,7 +187,6 @@ 187 187 188 188 The same code list can be used for several statistical concepts, within a data structure definition or across DSDs. Note that SDMX has recognised that these classifications are often quite large and the usage of codes in any one DSD is only a small extract of the full code list. In this version of the standard it is possible to exchange and disseminate a **partial code list** which is extracted from the full code list and which supports the dimension values valid for a particular DSD. 189 189 190 -(% class="wikigeneratedid" id="HDataStructureDefinitionStructure" %) 191 191 __Data Structure Definition Structure__ 192 192 193 193 The following items have to be specified by a structural definitions maintenance agency when defining a new data structure definition: ... ... @@ -231,7 +231,7 @@ 231 231 232 232 //Static properties//. 233 233 234 -* Upon creation of a series the sender has to provide to the receiver values for all mandatory attributes. In case they are available, values for conditional attributes should also be provided. Whereas initially this information may be provided by means other than SDMX-ML or SDMX-EDI messages (e.g. paper, telephone) it is expected that partner institutions will be in a position to provide this information in SDMX-ML or SDMX-EDI format over time.234 +* Upon creation of a series the sender has to provide to the receiver values for all mandatory attributes. In case they are available, values for conditional attributes should also be provided. Whereas initially this information may be provided by means other than SDMX-ML or SDMX-EDI messages (e.g. paper, telephone) it is expected that partner institutions will be in a position to provide this information in SDMX-ML or SDMX-EDI format over time. 235 235 * A centre may agree with its data exchange partners special procedures for authorising the setting of attributes' initial values. 236 236 * Attribute values at a data set level are set and maintained exclusively by the centre administrating the exchanged data set. 237 237 ... ... @@ -238,7 +238,7 @@ 238 238 //Communication of changes// to the centre. 239 239 240 240 * Following the creation of a series, the attribute values do not have to be reported again by senders, as long as they do not change. 241 -* Whenever changes in attribute values for a series (or sibling group) occur, the reporting institutions should report either all attribute values again (this is the recommended option) or only the attribute values which have changed. This applies both to the mandatory and the conditional attributes. For example, if a previously reported value for a conditional attribute is no longer valid, this has to be reported to the centre.241 +* Whenever changes in attribute values for a series (or sibling group) occur, the reporting institutions should report either all attribute values again (this is the recommended option) or only the attribute values which have changed. This applies both to the mandatory and the conditional attributes. For example, if a previously reported value for a conditional attribute is no longer valid, this has to be reported to the centre. 242 242 * A centre may agree with its data exchange partners special procedures for authorising modifications in the attribute values. 243 243 244 244 Communication of observation level attributes “observation status”, "observation confidentiality", "observation pre-break". ... ... @@ -282,7 +282,7 @@ 282 282 283 283 = 4 General Notes for Implementers = 284 284 285 -This section discusses a number of topics other than the exchange of data sets in SDMX-ML and SDMX-EDI. Supported only in SDMX-ML, these topics include the use of the reference metadata mechanism in SDMX, the use of Structure Sets and Reporting Taxonomies, the use of Processes, a discussion of time and data-typing, and some of the conventional mechanisms within the SDMX-ML Structure message regarding versioning and external referencing.285 +This section discusses a number of topics other than the exchange of data sets in SDMX-ML and SDMX-EDI. Supported only in SDMX-ML, these topics include the use of the reference metadata mechanism in SDMX, the use of Structure Sets and Reporting Taxonomies, the use of Processes, a discussion of time and data-typing, and some of the conventional mechanisms within the SDMX-ML Structure message regarding versioning and external referencing. 286 286 287 287 This section does not go into great detail on these topics, but provides a useful overview of these features to assist implementors in further use of the parts of the specification which are relevant to them. 288 288 ... ... @@ -325,7 +325,7 @@ 325 325 * ExclusiveValueRange (xs:decimal with the minValue and maxValue facets supplying the bounds) 326 326 * Incremental (xs:decimal with a specified interval; the interval is typically enforced outside of the XML validation) 327 327 * TimeRange (common:TimeRangeType, start DateTime + Duration,) 328 -* ObservationalTimePeriod (common: ObservationalTimePeriodType, a union of StandardTimePeriod and TimeRange).328 +* ObservationalTimePeriod (common: ObservationalTimePeriodType, a union of StandardTimePeriod and TimeRange). 329 329 * StandardTimePeriod (common: StandardTimePeriodType, a union of BasicTimePeriod and TimeRange). 330 330 * BasicTimePeriod (common: BasicTimePeriodType, a union of GregorianTimePeriod and DateTime) 331 331 * GregorianTimePeriod (common:GregorianTimePeriodType, a union of GregorianYear, GregorianMonth, and GregorianDay) ... ... @@ -409,7 +409,7 @@ 409 409 410 410 This is used to unambiguously state that a date-time represents an observation at a single point in time. Therefore, if one wants to use SDMX for data which is measured at a distinct point in time rather than being reported over a period, the date-time representation can be used. 411 411 412 -Representation: xs:dateTime (YYYY-MM-DDThh:mm:ss)[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[1~]^^>>path:#_ftn1]] 412 +Representation: xs:dateTime (YYYY-MM-DDThh:mm:ss)[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[1~]^^>>path:#_ftn1]] 413 413 414 414 === 4.2.6 Standard Reporting Period === 415 415 ... ... @@ -458,7 +458,7 @@ 458 458 Period Duration: P7D (seven days) 459 459 Limit per year: 53 460 460 Representation: common:ReportingWeekType (YYYY-Www, e.g. 2000-W53) 461 -Notes: There are either 52 or 53 weeks in a reporting year. This is based on the ISO 8601 definition of a week (Monday - Saturday), where the first week of a reporting year is defined as the week with the first Thursday on or after the reporting year start day.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[2~]^^>>path:#_ftn2]](%%) The reporting week is always represented as two digits, therefore 1-9 are 0 padded (e.g. 01). This allows the values to be sorted chronologically using textual sorting methods. 461 +Notes: There are either 52 or 53 weeks in a reporting year. This is based on the ISO 8601 definition of a week (Monday - Saturday), where the first week of a reporting year is defined as the week with the first Thursday on or after the reporting year start day.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[2~]^^>>path:#_ftn2]](%%) The reporting week is always represented as two digits, therefore 1-9 are 0 padded (e.g. 01). This allows the values to be sorted chronologically using textual sorting methods. 462 462 463 463 **Reporting Day**: 464 464 Period Indicator: D ... ... @@ -481,7 +481,7 @@ 481 481 ~1. If [REPORTING_YEAR_START_DATE] is a Friday, Saturday, or Sunday:** 482 482 Add^^3^^ (P3D, P2D, or P1D respectively) to the [REPORTING_YEAR_START_DATE]. The result is the [REPORTING_YEAR_BASE]. 483 483 484 - 2. **If [REPORTING_YEAR_START_DATE] is a Monday, Tuesday, Wednesday, or Thursday:**484 +2. **If [REPORTING_YEAR_START_DATE] is a Monday, Tuesday, Wednesday, or Thursday:** 485 485 Add^^3^^ (P0D, -P1D, -P2D, or -P3D respectively) to the [REPORTING_YEAR_START_DATE]. The result is the [REPORTING_YEAR_BASE]. 486 486 b) **Else:** 487 487 The [REPORTING_YEAR_START_DATE] is the [REPORTING_YEAR_BASE] ... ... @@ -497,7 +497,7 @@ 497 497 g) If the [PERIOD_INDICATOR] is D, the [PERIOD_DURATION] is P1D. 498 498 499 499 **3. Determine [PERIOD_START]:** 500 -Subtract one from the [PERIOD_VALUE] and multiply this by the [PERIOD_DURATION]. Add[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[3~]^^>>path:#_ftn3]](%%) this to the [REPORTING_YEAR_BASE]. The result is the [PERIOD_START]. 500 +Subtract one from the [PERIOD_VALUE] and multiply this by the [PERIOD_DURATION]. Add[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[3~]^^>>path:#_ftn3]](%%) this to the [REPORTING_YEAR_BASE]. The result is the [PERIOD_START]. 501 501 502 502 **4. Determine the [PERIOD_END]:** 503 503 Multiply the [PERIOD_VALUE] by the [PERIOD_DURATION]. Add^^3^^ this to the [REPORTING_YEAR_BASE] add^^3^^ -P1D. The result is the [PERIOD_END]. ... ... @@ -542,27 +542,27 @@ 542 542 543 543 === 4.2.8 Time Format === 544 544 545 -In version 2.0 of SDMX there is a recommendation to use the time format attribute to gives additional information on the way time is represented in the message. Following an appraisal of its usefulness this is no longer required. However, it is still possible, if required , to include the time format attribute in SDMX-ML. 545 +In version 2.0 of SDMX there is a recommendation to use the time format attribute to gives additional information on the way time is represented in the message. Following an appraisal of its usefulness this is no longer required. However, it is still possible, if required , to include the time format attribute in SDMX-ML. 546 546 547 -(% style="width:1 049.29px" %)548 -|**Code**|(% style="width: 926px" %)**Format**549 -|**OTP**|(% style="width: 926px" %)Observational Time Period: Superset of all SDMX time formats (Gregorian Time Period, Reporting Time Period, and Time Range)550 -|**STP**|(% style="width: 926px" %)Standard Time Period: Superset of Gregorian and Reporting Time Periods551 -|**GTP**|(% style="width: 926px" %)Superset of all Gregorian Time Periods and date-time552 -|**RTP**|(% style="width: 926px" %)Superset of all Reporting Time Periods553 -|**TR**|(% style="width: 926px" %)Time Range: Start time and duration (YYYY-MMDD(Thh:mm:ss)?/<duration>)554 -|**GY**|(% style="width: 926px" %)Gregorian Year (YYYY)555 -|**GTM**|(% style="width: 926px" %)Gregorian Year Month (YYYY-MM)556 -|**GD**|(% style="width: 926px" %)Gregorian Day (YYYY-MM-DD)557 -|**DT**|(% style="width: 926px" %)Distinct Point: date-time (YYYY-MM-DDThh:mm:ss)558 -|**RY**|(% style="width: 926px" %)Reporting Year (YYYY-A1)559 -|**RS**|(% style="width: 926px" %)Reporting Semester (YYYY-Ss)560 -|**RT**|(% style="width: 926px" %)Reporting Trimester (YYYY-Tt)561 -|**RQ**|(% style="width: 926px" %)Reporting Quarter (YYYY-Qq)562 -|**RM**|(% style="width: 926px" %)Reporting Month (YYYY-Mmm)563 -|**Code**|(% style="width: 926px" %)**Format**564 -|**RW**|(% style="width: 926px" %)Reporting Week (YYYY-Www)565 -|**RD**|(% style="width: 926px" %)Reporting Day (YYYY-Dddd)547 +(% style="width:716.835px" %) 548 +|(% style="width:197px" %)**Code**|(% style="width:517px" %)**Format** 549 +|(% style="width:197px" %)**OTP**|(% style="width:517px" %)Observational Time Period: Superset of all SDMX time formats (Gregorian Time Period, Reporting Time Period, and Time Range) 550 +|(% style="width:197px" %)**STP**|(% style="width:517px" %)Standard Time Period: Superset of Gregorian and Reporting Time Periods 551 +|(% style="width:197px" %)**GTP**|(% style="width:517px" %)Superset of all Gregorian Time Periods and date-time 552 +|(% style="width:197px" %)**RTP**|(% style="width:517px" %)Superset of all Reporting Time Periods 553 +|(% style="width:197px" %)**TR**|(% style="width:517px" %)Time Range: Start time and duration (YYYY-MMDD(Thh:mm:ss)?/<duration>) 554 +|(% style="width:197px" %)**GY**|(% style="width:517px" %)Gregorian Year (YYYY) 555 +|(% style="width:197px" %)**GTM**|(% style="width:517px" %)Gregorian Year Month (YYYY-MM) 556 +|(% style="width:197px" %)**GD**|(% style="width:517px" %)Gregorian Day (YYYY-MM-DD) 557 +|(% style="width:197px" %)**DT**|(% style="width:517px" %)Distinct Point: date-time (YYYY-MM-DDThh:mm:ss) 558 +|(% style="width:197px" %)**RY**|(% style="width:517px" %)Reporting Year (YYYY-A1) 559 +|(% style="width:197px" %)**RS**|(% style="width:517px" %)Reporting Semester (YYYY-Ss) 560 +|(% style="width:197px" %)**RT**|(% style="width:517px" %)Reporting Trimester (YYYY-Tt) 561 +|(% style="width:197px" %)**RQ**|(% style="width:517px" %)Reporting Quarter (YYYY-Qq) 562 +|(% style="width:197px" %)**RM**|(% style="width:517px" %)Reporting Month (YYYY-Mmm) 563 +|(% style="width:197px" %)**Code**|(% style="width:517px" %)**Format** 564 +|(% style="width:197px" %)**RW**|(% style="width:517px" %)Reporting Week (YYYY-Www) 565 +|(% style="width:197px" %)**RD**|(% style="width:517px" %)Reporting Day (YYYY-Dddd) 566 566 567 567 **Table 1: SDMX-ML Time Format Codes** 568 568 ... ... @@ -601,7 +601,7 @@ 601 601 602 602 It has been possible since SDMX 2.0 for a Component to specify a representation of a time span. Depending on the format of the data message, this resulted in either an element with 2 XML attributes for holding the start time and the duration or two separate XML attributes based on the underlying Component identifier. For example if REF_PERIOD were given a representation of time span, then in the Compact data format, it would be represented by two XML attributes; REF_PERIODStartTime (holding the start) and REF_PERIOD (holding the duration). If a new simple type is introduced in the SDMX schemas that can hold ISO 8601 time intervals, then this will no longer be necessary. What was represented as this: 603 603 604 - <Series REF_PERIODStartTime="2000-01-01T00:00:00" REF_PERIOD="P2M"/>604 +<Series REF_PERIODStartTime="2000-01-01T00:00:00" REF_PERIOD="P2M"/> 605 605 606 606 can now be represented with this: 607 607 ... ... @@ -642,9 +642,7 @@ 642 642 **Examples:** 643 643 644 644 **Gregorian Period** 645 - 646 646 Query Parameter: Greater than 2010 647 - 648 648 Literal Interpretation: Any data where the start period occurs after 2010-1231T23:59:59. 649 649 650 650 Example Matches: ... ... @@ -662,15 +662,11 @@ 662 662 * 2010-D185 or later (reporting year start day ~-~-07-01 or later) 663 663 664 664 **Reporting Period with explicit start day** 665 - 666 666 Query Parameter: Greater than or equal to 2009-Q3, reporting year start day = "-07-01" 667 - 668 668 Literal Interpretation: Any data where the start period occurs on after 2010-0101T00:00:00 (Note that in this case 2009-Q3 is converted to the explicit date range of 2010-01-01/2010-03-31 because of the reporting year start day value). Example Matches: Same as previous example 669 669 670 670 **Reporting Period with "Any" start day** 671 - 672 672 Query Parameter: Greater than or equal to 2010-Q3, reporting year start day = "Any" 673 - 674 674 Literal Interpretation: Any data with a reporting period where the start period is on or after the start period of 2010-Q3 for the same reporting year start day, or and data where the start period is on or after 2010-07-01. Example Matches: 675 675 676 676 * 2011 or later ... ... @@ -682,13 +682,10 @@ 682 682 * 2010-T3 (any reporting year start day) 683 683 * 2010-Q3 or later (any reporting year start day) 684 684 * 2010-M07 or later (any reporting year start day) 685 -* 2010-W27 or later (reporting year start day ~-~-01-01)^^4^^ 2010-D182 or later (reporting year start day ~-~-01-01) 686 -* 2010-W28 or later (reporting year start day ~-~-07-01)^^5^^ 679 +* 2010-W27 or later (reporting year start day ~-~-01-01){{footnote}}2010-Q3 (with a reporting year start day of --01-01) starts on 2010-07-01. This is day 4 of week 26, therefore the first week matched is week 27.{{/footnote}} 2010-D182 or later (reporting year start day ~-~-01-01) 680 +* 2010-W28 or later (reporting year start day ~-~-07-01){{footnote}}2010-Q3 (with a reporting year start day of --07-01) starts on 2011-01-01. This is day 6 of week 27, therefore the first week matched is week 28.{{/footnote}} 681 +* 2010-D185 or later (reporting year start day ~-~-07-01) 687 687 688 -^^4^^ 2010-Q3 (with a reporting year start day of ~-~-01-01) starts on 2010-07-01. This is day 4 of week 26, therefore the first week matched is week 27. 689 - 690 - 2010-D185 or later (reporting year start day ~-~-07-01) 691 - 692 692 == 4.3 Structural Metadata Querying Best Practices == 693 693 694 694 When querying for structural metadata, the ability to state how references should be resolved is quite powerful. However, this mechanism is not always necessary and can create an undue burden on the systems processing the queries if it is not used properly. ... ... @@ -705,8 +705,6 @@ 705 705 706 706 This mechanism is an “early binding” one – everything with a versioned identity is a known quantity, and will not change. It is worth pointing out that in some cases relationships are essentially one-way references: an illustrative case is that of Categories. While a Category may be referenced by many dataflows and metadata flows, the addition of more references from flow objects does not version the Category. This is because the flows are not properties of the Categories – they merely make references to it. If the name of a Category changed, or its subCategories changed, then versioning would be necessary. 707 707 708 -^^5^^ 2010-Q3 (with a reporting year start day of ~-~-07-01) starts on 2011-01-01. This is day 6 of week 27, therefore the first week matched is week 28. 709 - 710 710 Versioning operates at the level of versionable and maintainable objects in the SDMX information model. If any of the children of objects at these levels change, then the objects themselves are versioned. 711 711 712 712 One area which is much impacted by this versioning scheme is the ability to reference external objects. With the many dependencies within the various structural objects in SDMX, it is useful to have a scheme for external referencing. This is done at the level of maintainable objects (DSDs, code lists, concept schemes, etc.) In an SDMX-ML Structure Message, whenever an “isExternalReference” attribute is set to true, then the application must resolve the address provided in the associated “uri” attribute and use the SDMX-ML Structure Message stored at that location for the full definition of the object in question. Alternately, if a registry “urn” attribute has been provided, the registry can be used to supply the full details of the object. ... ... @@ -729,13 +729,13 @@ 729 729 730 730 [[image:1747836776649-282.jpeg]] 731 731 732 - 1.**1: Schematic of the Metadata Structure Definition**721 +**Figure 1: Schematic of the Metadata Structure Definition** 733 733 734 734 The MSD comprises the specification of the object types to which metadata can be reported in a Metadata Set (Metadata Target(s)), and the Report Structure(s) comprising the Metadata Attributes that identify the Concept for which metadata may be reported in the Metadata Set. Importantly, one Report Structure references the Metadata Target for which it is relevant. One Report Structure can reference many Metadata Target i.e. the same Report Structure can be used for different target objects. 735 735 736 736 [[image:1747836776655-364.jpeg]] 737 737 738 - 1.**2: Example MSD showing Metadata Targets**727 +**Figure 2: Example MSD showing Metadata Targets** 739 739 740 740 Note that the SDMX-ML schemas have explicit XML elements for each identifiable object type because identifying, for instance, a Maintainable Object has different properties from an Identifiable Object which must also include the agencyId, version, and id of the Maintainable Object in which it resides. 741 741 ... ... @@ -745,8 +745,10 @@ 745 745 746 746 [[image:1747836776658-510.jpeg]] 747 747 748 -**Figure 3: Example MSD showing specification of three Metadata Attributes **This example shows the following hierarchy of Metadata Attributes:737 +**Figure 3: Example MSD showing specification of three Metadata Attributes** 749 749 739 +This example shows the following hierarchy of Metadata Attributes: 740 + 750 750 Source – this is presentational and no metadata is expected to be reported at this level 751 751 752 752 * Source Type ... ... @@ -758,12 +758,9 @@ 758 758 759 759 [[image:1747836776677-246.jpeg]] 760 760 761 - **Figure 4: Example Metadata Set **This example shows:752 +**Figure 4: Example Metadata Set **This example shows: 762 762 763 -1. The reference to the MSD, Metadata Report, and Metadata Target 764 - 765 -(MetadataTargetValue) 766 - 754 +1. The reference to the MSD, Metadata Report, and Metadata Target (MetadataTargetValue) 767 767 1. The reported metadata attributes (AttributeValueSet) 768 768 769 769 = 6 Maintenance Agencies = ... ... @@ -784,7 +784,7 @@ 784 784 785 785 [[image:1747836776680-229.jpeg]] 786 786 787 - **Figure 5: Example of Hierarchic Structure of Agencies**775 +**Figure 5: Example of Hierarchic Structure of Agencies** 788 788 789 789 Each agency is identified by its full hierarchy excluding SDMX. 790 790 ... ... @@ -809,9 +809,7 @@ 809 809 The DSD Components of Dimension and Attribute can play a specific role in the DSD and it is important to some applications that this role is specified. For instance, the following roles are some examples: 810 810 811 811 **Frequency **– in a data set the content of this Component contains information on the frequency of the observation values 812 - 813 813 **Geography** - in a data set the content of this Component contains information on the geographic location of the observation values 814 - 815 815 **Unit** **of Measure** - in a data set the content of this Component contains information on the unit of measure of the observation values 816 816 817 817 In order for these roles to be extensible and also to enable user communities to maintain community-specific roles, the roles are maintained in a controlled vocabulary which is implemented in SDMX as Concepts in a Concept Scheme. The Component optionally references this Concept if it is required to declare the role explicitly. Note that a Component can play more than one role and therefore multiple “role” concepts can be referenced. ... ... @@ -820,10 +820,11 @@ 820 820 821 821 The Information Model for this is shown below: 822 822 809 +[[image:1747855024745-946.png]] 823 823 824 - **Figure 8: Information Model Extract for Concept Role**811 +**Figure 8: Information Model Extract for Concept Role** 825 825 826 -It is possible to specify zero or more concept roles for a Dimension, Measure Dimension and Data Attribute (but not the ReportingYearStartDay). The Time Dimension, Primary Measure, and the Attribute ReportingYearStartDay have explicitly defined roles and cannot be further specified with additional concept roles.813 +It is possible to specify zero or more concept roles for a Dimension, Measure Dimension and Data Attribute (but not the ReportingYearStartDay). The Time Dimension, Primary Measure, and the Attribute ReportingYearStartDay have explicitly defined roles and cannot be further specified with additional concept roles. 827 827 828 828 == 7.3 Technical Mechanism == 829 829 ... ... @@ -841,15 +841,14 @@ 841 841 842 842 The Cross-Domain Concept Scheme maintained by SDMX contains concept role concepts (FREQ chosen as an example). 843 843 844 -[[image:17478 36776691-440.jpeg]]831 +[[image:1747855054559-410.png]] 845 845 846 846 Whether this is a role or not depends upon the application understanding that FREQ in the Cross-Domain Concept Scheme is a role of Frequency. 847 847 848 848 Using a Concept Scheme that is not the Cross-Domain Concept Scheme where it is required to assign a role using the Cross-Domain Concept Scheme. Again FREQ is chosen as the example. 849 849 850 -[[image:17478 36776693-898.jpeg]]837 +[[image:1747855075263-887.png]] 851 851 852 - 853 853 This explicitly states that this Dimension is playing a role identified by the FREQ concept in the Cross-Domain Concept Scheme. Again the application needs to understand what FREQ in the Cross-Domain Concept Scheme implies in terms of a role. 854 854 855 855 This is all that is required for interoperability within a community. The important point is that a community must recognise a specific Agency as having the authority to define concept roles and to maintain these “role” concepts in a concept scheme together with documentation on the meaning of the role and any relevant processing implications. This will then ensure there is interoperability between systems that understand the use of these concepts. ... ... @@ -897,7 +897,7 @@ 897 897 898 898 == 8.3 Rules for a Content Constraint == 899 899 900 -=== 8.3.1 Scope of a Content Constraint ===886 +=== 8.3.1 Scope of a Content Constraint === 901 901 902 902 A Content Constraint is used specify the content of a data or metadata source in terms of the component values or the keys. 903 903 ... ... @@ -918,7 +918,7 @@ 918 918 ** IdentifiableObject 919 919 * Metadata Attribute 920 920 921 -The “key” is therefore the combination of the Target Objects that are defined for the Metadata Target.907 +The “key” is therefore the combination of the Target Objects that are defined for the Metadata Target. 922 922 923 923 For a Constraint based on a DSD the Content Constraint can reference one or more of: 924 924 ... ... @@ -936,60 +936,60 @@ 936 936 937 937 In view of the flexibility of constraints attachment, clear rules on their usage are required. These are elaborated below. 938 938 939 -=== 8.3.2 Multiple Content Constraints ===925 +=== 8.3.2 Multiple Content Constraints === 940 940 941 941 There can be many Content Constraints for any Constrainable Artefact (e.g. DSD), subject to the following restrictions: 942 942 943 - **8.3.2.1 Cube Region**929 +==== 8.3.2.1 Cube Region ==== 944 944 945 945 1. The constraint can contain multiple Member Selections (e.g. Dimension) but: 946 -1. A specific Member Selection (e.g. Dimension FREQ)can only be contained in one Content Constraint for any one attached object (e.g. a specific DSD or specific Dataflow)932 +1. A specific Member Selection (e.g. Dimension FREQ) can only be contained in one Content Constraint for any one attached object (e.g. a specific DSD or specific Dataflow) 947 947 948 - **8.3.2.2 Key Set**934 +==== 8.3.2.2 Key Set ==== 949 949 950 -Key Sets will be processed in the order they appear in the Constraint and wildcards can be used (e.g. any key position not reference explicitly is deemed to be “all values”). As the Key Sets can be “included” or “excluded” it is recommended that Key Sets with wildcards are declared before KeySets with specific series keys. This will minimize the risk that keys are inadvertently included or excluded. 936 +Key Sets will be processed in the order they appear in the Constraint and wildcards can be used (e.g. any key position not reference explicitly is deemed to be “all values”). As the Key Sets can be “included” or “excluded” it is recommended that Key Sets with wildcards are declared before KeySets with specific series keys. This will minimize the risk that keys are inadvertently included or excluded. 951 951 952 -=== 8.3.3 Inheritance of a Content Constraint ===938 +=== 8.3.3 Inheritance of a Content Constraint === 953 953 954 - **8.3.3.1 Attachment levels of a Content Constraint**940 +==== 8.3.3.1 Attachment levels of a Content Constraint ==== 955 955 956 956 There are three levels of constraint attachment for which these inheritance rules apply: 957 957 958 - DSD/MSD – top level o Dataflow/Metadataflow – second level 944 +* DSD/MSD – top level 945 +** Dataflow/Metadataflow – second level 946 +*** Provision Agreement – third level 959 959 960 -§ Provision Agreement – third level 961 - 962 962 Note that these rules do not apply to the Simple Datasoucre or Queryable Datasource: the Content Constraint(s) attached to these artefacts are resolved for this artefact only and do not take into account Constraints attached to other artefacts (e.g. Provision Agreement. Dataflow, DSD). 963 963 964 964 It is not necessary for a Content Constraint to be attached to higher level artifact. e.g. it is valid to have a Content Constraint for a Provision Agreement where there are no constraints attached the relevant dataflow or DSD. 965 965 966 - **8.3.3.2 Cascade rules for processing Constraints**952 +==== 8.3.3.2 Cascade rules for processing Constraints ==== 967 967 968 968 The processing of the constraints on either Dataflow/Metadataflow or Provision Agreement must take into account the constraints declared at higher levels. The rules for the lower level constraints (attached to Dataflow/ Metadataflow and Provision Agreement) are detailed below. 969 969 970 970 Note that there can be a situation where a constraint is specified at a lower level before a constraint is specified at a higher level. Therefore, it is possible that a higher level constraint makes a lower level constraint invalid. SDMX makes no rules on how such a conflict should be handled when processing the constraint for attachment. However, the cascade rules on evaluating constraints for usage are clear - the higher level constraint takes precedence in any conflicts that result in a less restrictive specification at the lower level. 971 971 972 - **8.3.3.3 Cube Region**958 +==== 8.3.3.3 Cube Region ==== 973 973 974 974 1. It is not necessary to have a constraint on the higher level artifact (e.g. DSD referenced by the Dataflow) but if there is such a constraint at the higher level(s) then: 975 - 11. The lower level constraint cannot be less restrictive than the constraint specified for the same Member Selection (e.g. Dimension) at the next higher level which constraints that Member Selection (e.g. if the Dimension FREQ is constrained to A, Q in a DSD then the constraint at the Dataflow or Provision Agreement cannot be A, Q, M or even just M – it can only further constrain A,Q).976 - 11. The constraint at the lower level for any one Member Selection further constrains the content for the same Member Selection at the higher level(s).961 +a. The lower level constraint cannot be less restrictive than the constraint specified for the same Member Selection (e.g. Dimension) at the next higher level which constraints that Member Selection (e.g. if the Dimension FREQ is constrained to A, Q in a DSD then the constraint at the Dataflow or Provision Agreement cannot be A, Q, M or even just M – it can only further constrain A,Q). 962 +b. The constraint at the lower level for any one Member Selection further constrains the content for the same Member Selection at the higher level(s). 977 977 1. Any Member Selection which is not referenced in a Content Constraint is deemed to be constrained according to the Content Constraint specified at the next higher level which constraints that Member Selection. 978 978 1. If there is a conflict when resolving the constraint in terms of a lower-level constraint being less restrictive than a higher-level constraint then the constraint at the higher-level is used. 979 979 980 980 Note that it is possible for a Content Constraint at a higher level to constrain, say, four Dimensions in a single constraint, and a Content Constraint at a lower level to constrain the same four in two, three, or four Content Constraints. 981 981 982 - **8.3.3.4 Key Set**968 +==== 8.3.3.4 Key Set ==== 983 983 984 984 1. It is not necessary to have a constraint on the higher level artefact (e.g. DSD referenced by the Dataflow) but if there is such a constraint at the higher level(s) then: 985 - 11.The lower level constraint cannot be less restrictive than the constraint specified at the higher level.986 - 11.The constraint at the lower level for any one Member Selection further constrains the keys specified at the higher level(s).971 +a. The lower level constraint cannot be less restrictive than the constraint specified at the higher level. 972 +b. The constraint at the lower level for any one Member Selection further constrains the keys specified at the higher level(s). 987 987 1. Any Member Selection which is not referenced in a Content Constraint is deemed to be constrained according to the Content Constraint specified at the next higher level which constraints that Member Selection. 988 988 1. If there is a conflict when resolving the keys in the constraint at two levels, in terms of a lower-level constraint being less restrictive than a higher-level constraint, then the offending keys specified at the lower level are not deemed part of the constraint. 989 989 990 990 Note that a Key in a Key Set can have wildcarded Components. For instance the constraint may simply constrain the Dimension FREQ to “A”, and all keys where the FREQ=A are therefore valid. 991 991 992 -The following logic explains how the inheritance mechanism works. Note that this is conceptual logic and actual systems may differ in the way this is implemented. 978 +The following logic explains how the inheritance mechanism works. Note that this is conceptual logic and actual systems may differ in the way this is implemented. 993 993 994 994 1. Determine all possible keys that are valid at the higher level. 995 995 1. These keys are deemed to be inherited by the lower level constrained object, subject to the constraints specified at the lower level. ... ... @@ -997,11 +997,11 @@ 997 997 1. At the lower level inherit all keys that match with the higher level constraint. 998 998 1. If there are keys in the lower level constraint that are not inherited then the key is invalid (i.e. it is less restrictive). 999 999 1000 - **8.3.4Constraints Examples**986 +=== 8.3.4 Constraints Examples === 1001 1001 1002 1002 The following scenario is used. 1003 1003 1004 - ===DSD===990 +__DSD__ 1005 1005 1006 1006 This contains the following Dimensions: 1007 1007 ... ... @@ -1010,114 +1010,45 @@ 1010 1010 * AGE – Age 1011 1011 * CAS – Current Activity Status 1012 1012 1013 -In the DSD common code lists are used and the requirement is to restrict these at various levels to specify the actual code that are valid for the object to which the Content Constraint is attached. 999 +In the DSD common code lists are used and the requirement is to restrict these at various levels to specify the actual code that are valid for the object to which the Content Constraint is attached. 1014 1014 1001 +[[image:1747855493531-357.png]] 1015 1015 1016 -|((( 1017 - 1018 -))) 1003 +**Figure 10: Example Scenario for Constraints** 1019 1019 1020 -|((( 1021 - 1022 -))) 1023 - 1024 -|((( 1025 - 1026 -))) 1027 - 1028 -|((( 1029 -**Figure** 1030 -))) 1031 - 1032 -|((( 1033 -**10** 1034 -))) 1035 - 1036 -|((( 1037 -**:** 1038 -))) 1039 - 1040 -|((( 1041 -**~ Example Sce** 1042 -))) 1043 - 1044 -|((( 1045 -**nario for Constraints** 1046 -))) 1047 - 1048 -|((( 1049 -**~ ** 1050 -))) 1051 - 1052 - 1053 - 1054 1054 Constraints are declared as follows: 1055 1055 1007 +[[image:1747855462293-368.png]] 1056 1056 1057 -|((( 1058 - 1059 -))) 1009 +**Figure 11: Example Content Constraints** 1060 1060 1061 -|((( 1062 - 1063 -))) 1064 - 1065 -|((( 1066 - 1067 -))) 1068 - 1069 -|((( 1070 -**Figure** 1071 -))) 1072 - 1073 -|((( 1074 -**11** 1075 -))) 1076 - 1077 -|((( 1078 -**:** 1079 -))) 1080 - 1081 -|((( 1082 -**~ Example Content Constraints** 1083 -))) 1084 - 1085 -|((( 1086 -**~ ** 1087 -))) 1088 - 1089 - 1090 - 1091 1091 **Notes:** 1092 1092 1093 -1. AGE is constrained for the DSD and is further restricted for the Dataflow 1094 - 1095 -CENSUS_CUBE1. 1096 - 1013 +1. AGE is constrained for the DSD and is further restricted for the Dataflow CENSUS_CUBE1. 1097 1097 1. The same Constraint applies to both Provision Agreements. 1098 1098 1099 1099 The cascade rules elaborated above result as follows: 1100 1100 1101 -DSD 1018 +__DSD__ 1102 1102 1103 1103 ~1. Constrained by eliminating code 001 from the code list for the AGE Dimension. 1104 1104 1105 - ===Dataflow CENSUS_CUBE1===1022 +__Dataflow CENSUS_CUBE1__ 1106 1106 1107 1107 1. Constrained by restricting the code list for the AGE Dimension to codes 002 and 003(note that this is a more restrictive constraint than that declared for the DSD which specifies all codes except code 001). 1108 1108 1. Restricts the CAS codes to 003 and 004. 1109 1109 1110 - ===Dataflow CENSUS_CUBE2===1027 +__Dataflow CENSUS_CUBE2__ 1111 1111 1112 1112 1. Restricts the code list for the CAS Dimension to codes TOT and NAP. 1113 1113 1. Inherits the AGE constraint applied at the level of the DSD. 1114 1114 1115 - ===Provision Agreements CENSUS_CUBE1_IT===1032 +__Provision Agreements CENSUS_CUBE1_IT__ 1116 1116 1117 1117 1. Restricts the codes for the GEO Dimension to IT and its children. 1118 -1. Inherits the constraints from Dataflow CENSUS_CUBE1 for the AGE and CAS Dimensions.1035 +1. Inherits the constraints from Dataflow CENSUS_CUBE1 for the AGE and CAS Dimensions. 1119 1119 1120 - ===Provision Agreements CENSUS_CUBE2_IT===1037 +__Provision Agreements CENSUS_CUBE2_IT__ 1121 1121 1122 1122 1. Restricts the codes for the GEO Dimension to IT and its children. 1123 1123 1. Inherits the constraints from Dataflow CENSUS_CUBE2 for the CAS Dimension. ... ... @@ -1125,17 +1125,17 @@ 1125 1125 1126 1126 The constraints are defined as follows: 1127 1127 1128 - ===DSD Constraint===1045 +__DSD Constraint__ 1129 1129 1130 1130 [[image:1747836776698-720.jpeg]] 1131 1131 1132 - ===Dataflow Constraints===1049 +__Dataflow Constraints__ 1133 1133 1134 1134 [[image:1747836776701-360.jpeg]] 1135 1135 1136 - ===[[image:1747836776707-834.jpeg]]===1053 +[[image:1747836776707-834.jpeg]] 1137 1137 1138 - ===Provision Agreement Constraint===1055 +__Provision Agreement Constraint__ 1139 1139 1140 1140 [[image:1747836776710-262.jpeg]] 1141 1141 ... ... @@ -1147,7 +1147,7 @@ 1147 1147 1148 1148 == 9.2 Groups and Dimension Groups == 1149 1149 1150 -=== 9.2.1 Issue ===1067 +=== 9.2.1 Issue === 1151 1151 1152 1152 Version 2.1 introduces a more granular mechanism for specifying the relationship between a Data Attribute and the Dimensions to which the attribute applies. The technical construct for this is the Dimension Group. This Dimension Group has no direct equivalent in versions 2.0 and 1.0 and so the application transforming data from a version 2.1 data set to a version 2.0 or version 1.0 data set must decide to which construct the attribute value, whose Attribute is declared in a Dimension Group, should be attached. The closest construct is the “Series” attachment level and in many cases this is the correct construct to use. 1153 1153 ... ... @@ -1160,7 +1160,7 @@ 1160 1160 1161 1161 If the conditions defined in 9.2.1are true then on conversion to a version 2.0 or 1.0 DSD (Key Family) the Component/Attribute.attachmentLevel must be set to “Group” and the Component/Attribute/AttachmentGroup” is used to identify the Group. Note that under rule(1) in 1.2.1 this group will have been defined in the V 2.1 DSD and so will be present in the V 2.0 transformation. 1162 1162 1163 -=== 9.2.3 Data ===1080 +=== 9.2.3 Data === 1164 1164 1165 1165 If the conditions defined in 9.2.1are true then, on conversion from a 2.1 data set to a 2.0 or 1.0 dataset the attribute value will be placed in the relevant <Group>. If these conditions are not true then the attribute value will be placed in the <Series>. 1166 1166 ... ... @@ -1172,17 +1172,17 @@ 1172 1172 1173 1173 == 10.1 Introduction == 1174 1174 1175 -The Validation and Transformation Language (VTL) supports the definition of Transformations, which are algorithms to calculate new data starting from already existing ones[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[4~]^^>>path:#_ftn4]](%%). The purpose of the VTL in the SDMX context is to enable the: 1092 +The Validation and Transformation Language (VTL) supports the definition of Transformations, which are algorithms to calculate new data starting from already existing ones[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[4~]^^>>path:#_ftn4]](%%). The purpose of the VTL in the SDMX context is to enable the: 1176 1176 1177 -* definition of validation and transformation algorithms, in order to specify how to calculate new data from existing ones;1094 +* definition of validation and transformation algorithms, in order to specify how to calculate new data from existing ones; 1178 1178 * exchange of the definition of VTL algorithms, also together the definition of the data structures of the involved data (for example, exchange the data structures of a reporting framework together with the validation rules to be applied, exchange the input and output data structures of a calculation task together with the VTL Transformations describing the calculation algorithms); 1179 1179 * compilation and execution of VTL algorithms, either interpreting the VTL transformations or translating them in whatever other computer language is deemed as appropriate. 1180 1180 1181 -It is important to note that the VTL has its own information model (IM), derived from the Generic Statistical Information Model (GSIM) and described in the VTL User Guide. The VTL IM is designed to be compatible with more standards, like SDMX, DDI (Data Documentation Initiative) and GSIM, and includes the model artefacts that can be manipulated (inputs and/or outputs of transformations, e.g. “Data Set”, “Data Structure”) and the model artefacts that allow the definition of the transformation algorithms (e.g. “Transformation”, “Transformation Scheme”).1098 +It is important to note that the VTL has its own information model (IM), derived from the Generic Statistical Information Model (GSIM) and described in the VTL User Guide. The VTL IM is designed to be compatible with more standards, like SDMX, DDI (Data Documentation Initiative) and GSIM, and includes the model artefacts that can be manipulated (inputs and/or outputs of transformations, e.g. “Data Set”, “Data Structure”) and the model artefacts that allow the definition of the transformation algorithms (e.g. “Transformation”, “Transformation Scheme”). 1182 1182 1183 -The VTL language can be applied to SDMX artefacts by mapping the SDMX IM model artefacts to the model artefacts that VTL can manipulate. Thus, the SDMX artefacts can be used in VTL as inputs and/or outputs of transformations. It is important to be aware that the artefacts do not always have the same names in the SDMX and VTL IMs, nor do they always have the same meaning. The more evident example is given by the SDMX Dataset and the VTL “Data Set”, which do not correspond one another: as a matter of fact, the VTL “Data Set” maps to the SDMX “Dataflow”, while the SDMX “Dataset” has no explicit mapping to VTL (such an abstraction is not needed in the definition of VTL transformations). A SDMX “Dataset”, however, is an instance of a SDMX “Dataflow” and can be the artefact on which the VTL transformations are executed (i.e., the transformations are defined on Dataflows and are applied to Dataflow instances that can be Datasets).1100 +The VTL language can be applied to SDMX artefacts by mapping the SDMX IM model artefacts to the model artefacts that VTL can manipulate. Thus, the SDMX artefacts can be used in VTL as inputs and/or outputs of transformations. It is important to be aware that the artefacts do not always have the same names in the SDMX and VTL IMs, nor do they always have the same meaning. The more evident example is given by the SDMX Dataset and the VTL “Data Set”, which do not correspond one another: as a matter of fact, the VTL “Data Set” maps to the SDMX “Dataflow”, while the SDMX “Dataset” has no explicit mapping to VTL (such an abstraction is not needed in the definition of VTL transformations). A SDMX “Dataset”, however, is an instance of a SDMX “Dataflow” and can be the artefact on which the VTL transformations are executed (i.e., the transformations are defined on Dataflows and are applied to Dataflow instances that can be Datasets). 1184 1184 1185 -The VTL programs (Transformation Schemes) are represented in SDMX through the TransformationScheme maintainable class whichis composed of Transformation (nameable artefact). Each Transformation assigns the outcome of the evaluation of a VTL expression to a result.1102 +The VTL programs (Transformation Schemes) are represented in SDMX through the TransformationScheme maintainable class which is composed of Transformation (nameable artefact). Each Transformation assigns the outcome of the evaluation of a VTL expression to a result. 1186 1186 1187 1187 This section does not explain the VTL language or any of the content published in the VTL guides. Rather, this is a description of how the VTL can be used in the SDMX context and applied to SDMX artefacts. 1188 1188 ... ... @@ -1190,16 +1190,14 @@ 1190 1190 1191 1191 === 10.2.1 Introduction === 1192 1192 1193 -The VTL can manipulate SDMX artefacts (or objects) by referencing them through pre-defined conventional names (aliases). 1110 +The VTL can manipulate SDMX artefacts (or objects) by referencing them through pre-defined conventional names (aliases). 1194 1194 1195 1195 The alias of a SDMX artefact can be its URN (Universal Resource Name), an abbreviation of its URN or another user-defined name. 1196 1196 1197 -In any case, the aliases used in the VTL transformations have to be mapped to the 1114 +In any case, the aliases used in the VTL transformations have to be mapped to the SDMX artefacts through the VtlMappingScheme and VtlMapping classes (see the section of the SDMX IM relevant to the VTL). A VtlMapping allows specifying the aliases to be used in the VTL transformations, rulesets[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[5~]^^>>path:#_ftn5]](%%) or user defined operators[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[6~]^^>>path:#_ftn6]](%%) to reference SDMX artefacts. A VtlMappingScheme is a container for zero or more VtlMapping. 1198 1198 1199 - SDMXartefactsthrough theVtlMappingSchemeandVtlMappingclasses(see the sectionoftheSDMXIMrelevant totheVTL). A VtlMappingallows specifying the aliasesto beusedintheVTL transformations,rulesets[[(%class="wikiinternallinkwikiinternallinkwikiinternallink wikiinternallinkwikiinternallink"%)^^~[5~]^^>>path:#_ftn5]](%%)or userdefined operators[[(%class="wikiinternallinkwikiinternallinkwikiinternallinkwikiinternallinkwikiinternallink"%)^^~[6~]^^>>path:#_ftn6]](%%)to referenceSDMXartefacts.A VtlMappingScheme isacontainerfor zeroormoreVtlMapping.1116 +The correspondence between an alias and a SDMX artefact must be one-to-one, meaning that a generic alias identifies one and just one SDMX artefact while a SDMX artefact is identified by one and just one alias. In other words, within a VtlMappingScheme an artefact can have just one alias and different artefacts cannot have the same alias. 1200 1200 1201 -The correspondence between an alias and a SDMX artefact must be one-to-one, meaning that a generic alias identifies one and just one SDMX artefact while a SDMX artefact is identified by one and just one alias. In other words, within a VtlMappingScheme an artefact can have just one alias and different artefacts cannot have the same alias. 1202 - 1203 1203 The references through the URN and the abbreviated URN are described in the following paragraphs. 1204 1204 1205 1205 === 10.2.2 References through the URN === ... ... @@ -1206,15 +1206,15 @@ 1206 1206 1207 1207 This approach has the advantage that in the VTL code the URN of the referenced artefacts is directly intelligible by a human reader but has the drawback that the references are verbose. 1208 1208 1209 -The SDMX URN[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[7~]^^>>path:#_ftn7]](%%) is the concatenation of the following parts, separated by special symbols like dot, equal, asterisk, comma, and parenthesis:^^ ^^ 1124 +The SDMX URN[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[7~]^^>>path:#_ftn7]](%%) is the concatenation of the following parts, separated by special symbols like dot, equal, asterisk, comma, and parenthesis:^^ ^^ 1210 1210 1211 -* SDMXprefix 1212 -* SDMX-IM-package-name 1213 -* class-name 1214 -* agency-id 1126 +* SDMXprefix 1127 +* SDMX-IM-package-name 1128 +* class-name 1129 +* agency-id 1215 1215 * maintainedobject-id 1216 1216 * maintainedobject-version 1217 -* container-object-id [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[8~]^^>>path:#_ftn8]] 1132 +* container-object-id [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[8~]^^>>path:#_ftn8]] 1218 1218 * object-id 1219 1219 1220 1220 The generic structure of the URN is the following: ... ... @@ -1225,7 +1225,7 @@ 1225 1225 1226 1226 The **SDMX prefix** is “urn:sdmx:org”, always the same for all SDMX artefacts. 1227 1227 1228 -The **SDMX-IM-package-name **is the concatenation of the string** **“sdmx.infomodel.” with the package-name which the artefact belongs to. For example, for referencing a dataflow the SDMX-IM-package-name is “sdmx.infomodel.datastructure”, because the class ,,Dataflow,, belongs to the package “datastructure”.1143 +The **SDMX-IM-package-name **is the concatenation of the string** **“sdmx.infomodel.” with the package-name which the artefact belongs to. For example, for referencing a dataflow the SDMX-IM-package-name is “sdmx.infomodel.datastructure”, because the class ,,Dataflow,, belongs to the package “datastructure”. 1229 1229 1230 1230 The **class-name** is the name of the SDMX object class which the SDMX object belongs to (e.g., for referencing a dataflow the class-name is “Dataflow”). The VTL can reference SDMX artefacts that belong to the classes ,,Dataflow, Dimension,,, 1231 1231 ... ... @@ -1233,13 +1233,13 @@ 1233 1233 1234 1234 The **agency-id** is the acronym of the agency that owns the definition of the artefact, for example for the Eurostat artefacts the agency-id is “ESTAT”). The agency-id can be composite (for example AgencyA.Dept1.Unit2). 1235 1235 1236 -The **maintainedobject-id** is the name of the maintained object which the artefact belongs to, and in case the artefact itself is maintainable[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[9~]^^>>path:#_ftn9]](%%), coincides with the name of the artefact. Therefore the maintainedobject-id depends on the class of the artefact: 1151 +The **maintainedobject-id** is the name of the maintained object which the artefact belongs to, and in case the artefact itself is maintainable[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[9~]^^>>path:#_ftn9]](%%), coincides with the name of the artefact. Therefore the maintainedobject-id depends on the class of the artefact: 1237 1237 1238 -* if the artefact is a ,,Dataflow,,,which is a maintainable class,the maintainedobject-id is the Dataflow name (dataflow-id);1239 -* if the artefact is a Dimension, MeasureDimension, TimeDimension, PrimaryMeasure or DataAttribute, which are not maintainable and belong to the ,,DataStructure,,maintainable class, the maintainedobject-id is the name of the DataStructure (dataStructure-id) which the artefact belongs to;1240 -* if the artefact is a ,,Concept,,,which is not maintainable and belongs to the ConceptScheme maintainable class, ,, ,,the maintainedobject-id is the name of the ConceptScheme (conceptScheme-id) which the artefact belongs to;1241 -* if the artefact is a ,,ConceptScheme,,,which is a maintainable class, ,, ,,the maintainedobject-id is the name of the ConceptScheme (conceptScheme-id);1242 -* if the artefact is a ,,Codelist,,,which is a maintainable class,the maintainedobject-id is the Codelist name (codelist-id).1153 +* if the artefact is a Dataflow, which is a maintainable class, the maintainedobject-id is the Dataflow name (dataflow-id); 1154 +* if the artefact is a Dimension, MeasureDimension, TimeDimension, PrimaryMeasure or DataAttribute, which are not maintainable and belong to the DataStructure maintainable class, the maintainedobject-id is the name of the DataStructure (dataStructure-id) which the artefact belongs to; 1155 +* if the artefact is a Concept, which is not maintainable and belongs to the ConceptScheme maintainable class, ,, ,,the maintainedobject-id is the name of the ConceptScheme (conceptScheme-id) which the artefact belongs to; 1156 +* if the artefact is a ConceptScheme, which is a maintainable class, ,, ,,the maintainedobject-id is the name of the ConceptScheme (conceptScheme-id); 1157 +* if the artefact is a Codelist, which is a maintainable class, the maintainedobject-id is the Codelist name (codelist-id). 1243 1243 1244 1244 The **maintainedobject-version** is the version of the maintained object which the artefact belongs to (for example, possible versions are 1.0, 2.1, 3.1.2). 1245 1245 ... ... @@ -1247,18 +1247,13 @@ 1247 1247 1248 1248 The **object-id** is the name of the non-maintainable artefact (when the artefact is maintainable its name is already specified as the maintainedobject-id, see above), in particular it has to be specified: 1249 1249 1250 -* if the artefact is a Dimension, MeasureDimension, TimeDimension, PrimaryMeasure or DataAttribute (the object-id is the name of one of 1165 +* if the artefact is a Dimension, MeasureDimension, TimeDimension, PrimaryMeasure or DataAttribute (the object-id is the name of one of the artefacts above, which are data structure components) 1166 +* if the artefact is a Concept (the object-id is the name of the Concept) 1251 1251 1252 -the artefacts above,whichare data structure components)1168 +For example, by using the URN, the VTL transformation that sums two SDMX dataflows DF1 and DF2 and assigns the result to a third persistent dataflow DFR, assuming that DF1, DF2 and DFR are the maintainedobject-id of the three dataflows, that their version is 1.0 and their Agency is AG, would be written as[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[10~]^^>>path:#_ftn10]](%%): 1253 1253 1254 -* if the artefact is a ,,Concept ,,(the object-id is the name of the ,,Concept,,) 1255 - 1256 -For example, by using the URN, the VTL transformation that sums two SDMX dataflows DF1 and DF2 and assigns the result to a third persistent dataflow DFR, assuming that DF1, DF2 and DFR are the maintainedobject-id of the three dataflows, that their version is 1.0 and their Agency is AG, would be written as[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[10~]^^>>path:#_ftn10]](%%): 1257 - 1258 1258 ‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DFR(1.0)’ <- 1259 - 1260 -‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DF1(1.0)’ + 1261 - 1171 +‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DF1(1.0)’ + 1262 1262 ‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DF2(1.0)’ 1263 1263 1264 1264 === 10.2.3 Abbreviation of the URN === ... ... @@ -1268,52 +1268,50 @@ 1268 1268 The URN can be abbreviated by omitting the parts that are not essential for the identification of the artefact or that can be deduced from other available information, including the context in which the invocation is made. The possible abbreviations are described below. 1269 1269 1270 1270 * The **SDMXPrefix** can be omitted for all the SDMX objects, because it is a prefixed string (urn:sdmx:org), always the same for SDMX objects. 1271 -* The **SDMX-IM-package-name **can be omitted as well because it can be deduced from the class-name that follows it (the table of the SDMX-IM packages and classes that allows this deduction is in the SDMX 2.1 Standards - Section 5 - Registry Specifications, paragraph 6.2.3). In particular, considering the object classes of the artefacts that VTL can reference, the package is: 1272 -** “datastructure” for the classes Dataflow, Dimension, MeasureDimension, TimeDimension, PrimaryMeasure, DataAttribute, 1273 -** “conceptscheme” for the classes Concept and ConceptScheme o “codelist” for the class Codelist. 1274 -* The **class-name** can be omitted as it can be deduced from the VTL invocation. In particular, starting from the VTL class of the invoked artefact (e.g. dataset, component, identifier, measure, attribute, variable, valuedomain), which is known given the syntax of the invoking VTL operator[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[11~]^^>>path:#_ftn11]](%%), the SDMX class can be deduced from the mapping rules between VTL and SDMX (see the section “Mapping between VTL and SDMX” hereinafter)[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[12~]^^>>path:#_ftn12]](%%). 1275 -* If the **agency-id** is not specified, it is assumed by default equal to the agency-id of the TransformationScheme, UserDefinedOperatorScheme or RulesetScheme from which the artefact is invoked. For example, the agency-id can be omitted if it is the same as the invoking T,,ransformationScheme,, and cannot be omitted if the artefact comes from another agency.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[13~]^^>>path:#_ftn13]](%%) Take also into account that, according to the VTL consistency rules, the agency of the result of a ,,Transformation,, must be the same as its ,,TransformationScheme,,, therefore the agency-id can be omitted for all the results (left part of ,,Transformation,, statements). 1276 -* As for the **maintainedobject-id**, this is essential in some cases while in other cases it can be omitted: o if the referenced artefact is a ,,Dataflow,,, which is a maintainable class, the maintainedobject-id is the dataflow-id and obviously cannot be omitted; 1277 -** if the referenced artefact is a Dimension, MeasureDimension, TimeDimension, PrimaryMeasure, DataAttribute, which are not maintainable and belong to the ,,DataStructure,, maintainable class, the maintainedobject-id is the dataStructure-id and can be omitted, given that these components are always invoked within the invocation of a ,,Dataflow,,, whose dataStructure-id can be deduced from the 1278 - 1279 -SDMX structural definitions; o if the referenced artefact is a ,,Concept, ,,which is not maintainable and belong to the ,,ConceptScheme ,,maintainable class,,, ,,the maintained object is the conceptScheme-id and cannot be omitted; 1280 - 1281 -* 1282 -** if the referenced artefact is a ,,ConceptScheme, ,,which is a,, ,,maintainable class,,, ,,the maintained object is the ,,conceptScheme-id,, and obviously cannot be omitted; 1283 -** if the referenced artefact is a ,,Codelist, ,,which is a maintainable class, the maintainedobject-id is the ,,codelist-id,, and obviously cannot be omitted. 1181 +* The **SDMX-IM-package-name **can be omitted as well because it can be deduced from the class-name that follows it (the table of the SDMX-IM packages and classes that allows this deduction is in the SDMX 2.1 Standards - Section 5 - Registry Specifications, paragraph 6.2.3). In particular, considering the object classes of the artefacts that VTL can reference, the package is: 1182 +** “datastructure” for the classes Dataflow, Dimension, MeasureDimension, TimeDimension, PrimaryMeasure, DataAttribute, 1183 +** “conceptscheme” for the classes Concept and ConceptScheme 1184 +** “codelist” for the class Codelist. 1185 +* The **class-name** can be omitted as it can be deduced from the VTL invocation. In particular, starting from the VTL class of the invoked artefact (e.g. dataset, component, identifier, measure, attribute, variable, valuedomain), which is known given the syntax of the invoking VTL operator[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[11~]^^>>path:#_ftn11]](%%), the SDMX class can be deduced from the mapping rules between VTL and SDMX (see the section “Mapping between VTL and SDMX” hereinafter)[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[12~]^^>>path:#_ftn12]](%%). 1186 +* If the **agency-id** is not specified, it is assumed by default equal to the agency-id of the TransformationScheme, UserDefinedOperatorScheme or RulesetScheme from which the artefact is invoked. For example, the agency-id can be omitted if it is the same as the invoking TransformationScheme and cannot be omitted if the artefact comes from another agency.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[13~]^^>>path:#_ftn13]](%%) Take also into account that, according to the VTL consistency rules, the agency of the result of a Transformation must be the same as its TransformationScheme, therefore the agency-id can be omitted for all the results (left part of Transformation statements). 1187 +* As for the **maintainedobject-id**, this is essential in some cases while in other cases it can be omitted: o if the referenced artefact is a Dataflow, which is a maintainable class, the maintainedobject-id is the dataflow-id and obviously cannot be omitted; 1188 +** if the referenced artefact is a Dimension, MeasureDimension, TimeDimension, PrimaryMeasure, DataAttribute, which are not maintainable and belong to the DataStructure maintainable class, the maintainedobject-id is the dataStructure-id and can be omitted, given that these components are always invoked within the invocation of a Dataflow, whose dataStructure-id can be deduced from the SDMX structural definitions; 1189 +** if the referenced artefact is a Concept, which is not maintainable and belong to the ConceptScheme maintainable class,,, ,,the maintained object is the conceptScheme-id and cannot be omitted; 1190 +** if the referenced artefact is a ConceptScheme, which is a,, ,,maintainable class,,, ,,the maintained object is the conceptScheme-id and obviously cannot be omitted; 1191 +** if the referenced artefact is a Codelist, which is a maintainable class, the maintainedobject-id is the codelist-id and obviously cannot be omitted. 1284 1284 * When the maintainedobject-id is omitted, the **maintainedobject-version** is omitted too. When the maintainedobject-id is not omitted and the maintainedobject-version is omitted, the version 1.0 is assumed by default.,, ,, 1285 1285 * As said, the **container-object-id** does not apply to the classes that can be referenced in VTL transformations, therefore is not present in their URN 1286 -* The **object-id** does not exist for the artefacts belonging to the ,,Dataflow, ConceptScheme,,and,,Codelist,,classes, while it exists and cannot be omitted for the artefacts belonging to the classes Dimension, MeasureDimension, TimeDimension, PrimaryMeasure, DataAttribute and Concept, as for1194 +* The **object-id** does not exist for the artefacts belonging to the Dataflow, ConceptScheme and Codelist classes, while it exists and cannot be omitted for the artefacts belonging to the classes Dimension, MeasureDimension, TimeDimension, PrimaryMeasure, DataAttribute and Concept, as for them the object-id is the main identifier of the artefact 1287 1287 1288 -them the object-id is the main identifier of the artefact 1289 - 1290 1290 The simplified object identifier is obtained by omitting all the first part of the URN, including the special characters, till the first part not omitted. 1291 1291 1292 1292 For example, the full formulation that uses the complete URN shown at the end of the previous paragraph: 1293 1293 1294 -‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DFR(1.0)’ := ‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DF1(1.0)’ +1295 - 1200 +‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DFR(1.0)’ := 1201 +‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DF1(1.0)’ + 1296 1296 ‘urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=AG:DF2(1.0)’ 1297 1297 1298 -by omitting all the non-essential parts would become simply: 1204 +by omitting all the non-essential parts would become simply: 1299 1299 1300 -DFR :=DF1 + DF21206 +DFR := DF1 + DF2 1301 1301 1302 -The references to the ,,Codelists,,can be simplified similarly. For example, given the non-abbreviated reference to the,,Codelist,,AG:CL_FREQ(1.0), which is[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[14~]^^>>path:#_ftn14]](%%):1208 +The references to the Codelists can be simplified similarly. For example, given the non-abbreviated reference to the Codelist AG:CL_FREQ(1.0), which is[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[14~]^^>>path:#_ftn14]](%%): 1303 1303 1304 1304 ‘urn:sdmx:org.sdmx.infomodel.codelist.Codelist=AG:CL_FREQ(1.0)’ 1305 1305 1306 -if the ,,Codelist,,is referenced from a ruleset scheme belonging to the agency AG, omitting all the optional parts, the abbreviated reference would become simply[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[15~]^^>>path:#_ftn15]](%%):1212 +if the Codelist is referenced from a ruleset scheme belonging to the agency AG, omitting all the optional parts, the abbreviated reference would become simply[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[15~]^^>>path:#_ftn15]](%%): 1307 1307 1308 1308 CL_FREQ 1309 1309 1310 -As for the references to the components, it can be enough to specify the componentId, given that the dataStructure-Id can be omitted. An example of non-abbreviated reference, if the data structure is DST1 and the component is SECTOR, is the following:1216 +As for the references to the components, it can be enough to specify the componentId, given that the dataStructure-Id can be omitted. An example of non-abbreviated reference, if the data structure is DST1 and the component is SECTOR, is the following: 1311 1311 1312 -‘urn:sdmx:org.sdmx.infomodel.datastructure.DataStructure=AG:DST1(1.0).SECTOR’ The corresponding fully abbreviated reference, if made from a transformation scheme belonging to AG, would become simply:1218 +‘urn:sdmx:org.sdmx.infomodel.datastructure.DataStructure=AG:DST1(1.0).SECTOR’ 1313 1313 1220 +The corresponding fully abbreviated reference, if made from a transformation scheme belonging to AG, would become simply: 1221 + 1314 1314 SECTOR 1315 1315 1316 -For example, the transformation for renaming the component SECTOR of the dataflow DF1 into SEC can be written as[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[16~]^^>>path:#_ftn16]](%%): 1224 +For example, the transformation for renaming the component SECTOR of the dataflow DF1 into SEC can be written as[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[16~]^^>>path:#_ftn16]](%%): 1317 1317 1318 1318 ‘DFR(1.0)’ := ‘DF1(1.0)’ [rename SECTOR to SEC] 1319 1319 ... ... @@ -1323,7 +1323,7 @@ 1323 1323 1324 1324 ‘urn:sdmx:org.sdmx.infomodel.conceptscheme.Concept=AG:CS1(1.0).SECTOR’ 1325 1325 1326 -The corresponding fully abbreviated reference, if made from a RulesetScheme belonging to AG, would become simply: 1234 +The corresponding fully abbreviated reference, if made from a RulesetScheme belonging to AG, would become simply: 1327 1327 1328 1328 CS1(1.0).SECTOR 1329 1329 ... ... @@ -1345,13 +1345,13 @@ 1345 1345 1346 1346 VTL operators, like the ones for validation and hierarchical roll-up. A “rule” consists in a relationship between Values belonging to some Value Domains or taken by some Variables, for example: (i) when the Country is USA then the Currency is USD; (ii) the Benelux is composed by Belgium, Luxembourg, Netherlands. 1347 1347 1348 -The VTL Rulesets have a signature, in which the Value Domains or the Variables on which the Ruleset is defined are declared, and a body, which contains the rules. 1256 +The VTL Rulesets have a signature, in which the Value Domains or the Variables on which the Ruleset is defined are declared, and a body, which contains the rules. 1349 1349 1350 -In the signature, given the mapping between VTL and SDMX better described in the following paragraphs, a reference to a VTL Value Domain becomes a reference to a SDMX Codelist or to a SDMX ConceptScheme (for SDMX measure dimensions), while a reference to a VTL Represented Variable becomes a reference to a SDMX Concept, assuming for it a definite representation[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[17~]^^>>path:#_ftn17]](%%). 1258 +In the signature, given the mapping between VTL and SDMX better described in the following paragraphs, a reference to a VTL Value Domain becomes a reference to a SDMX Codelist or to a SDMX ConceptScheme (for SDMX measure dimensions), while a reference to a VTL Represented Variable becomes a reference to a SDMX Concept, assuming for it a definite representation[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[17~]^^>>path:#_ftn17]](%%). 1351 1351 1352 -In general, for referencing SDMX Codelists and Concepts, the conventions described in the previous paragraphs apply. In the Ruleset syntax, the elements that reference SDMX artefacts are called “valueDomain” and “variable” for the Datapoint Rulesets and “ruleValueDomain”, “ruleVariable”, “condValueDomain” “condVariable” for the Hierarchical Rulesets). The syntax of the Ruleset signature allows also to define aliases of the elements above, these aliases are valid only within the specific ruleset definition statement and cannot be mapped to SDMX.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[18~]^^>>path:#_ftn18]](%%) 1260 +In general, for referencing SDMX Codelists and Concepts, the conventions described in the previous paragraphs apply. In the Ruleset syntax, the elements that reference SDMX artefacts are called “valueDomain” and “variable” for the Datapoint Rulesets and “ruleValueDomain”, “ruleVariable”, “condValueDomain” “condVariable” for the Hierarchical Rulesets). The syntax of the Ruleset signature allows also to define aliases of the elements above, these aliases are valid only within the specific ruleset definition statement and cannot be mapped to SDMX.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[18~]^^>>path:#_ftn18]](%%) 1353 1353 1354 -In the body of the Rulesets, the Codes and in general all the Values can be written without any other specification, because the artefact which the Values are referred (Codelist, ConceptScheme, Concept) to can be deduced from the Ruleset signature.1262 +In the body of the Rulesets, the Codes and in general all the Values can be written without any other specification, because the artefact which the Values are referred (Codelist, ConceptScheme, Concept) to can be deduced from the Ruleset signature. 1355 1355 1356 1356 == 10.3 Mapping between SDMX and VTL artefacts == 1357 1357 ... ... @@ -1359,62 +1359,59 @@ 1359 1359 1360 1360 The mapping methods between the VTL and SDMX object classes allow transforming a SDMX definition in a VTL one and vice-versa for the artefacts to be manipulated. 1361 1361 1362 -It should be remembered that VTL programs (i.e. Transformation Schemes) are represented in SDMX through the TransformationScheme maintainable class which is composed of Transformations (nameable artefacts). Each Transformation assigns the outcome of the evaluation of a VTL expression to a result: the input operands of the expression and the result can be SDMX artefacts.1270 +It should be remembered that VTL programs (i.e. Transformation Schemes) are represented in SDMX through the TransformationScheme maintainable class which is composed of Transformations (nameable artefacts). Each Transformation assigns the outcome of the evaluation of a VTL expression to a result: the input operands of the expression and the result can be SDMX artefacts. 1363 1363 1364 -Every time a SDMX object is referenced in a VTL Transformation as an input operand, there is the need to generate a VTL definition of the object, so that the VTL operations can take place. This can be made starting from the SDMX definition and applying a SDMX-VTL mapping method in the direction from SDMX to VTL. The possible mapping methods from SDMX to VTL are described in the following paragraphs and are conceived to allow the automatic deduction of the VTL definition of the object from the knowledge of the SDMX definition. 1272 +Every time a SDMX object is referenced in a VTL Transformation as an input operand, there is the need to generate a VTL definition of the object, so that the VTL operations can take place. This can be made starting from the SDMX definition and applying a SDMX-VTL mapping method in the direction from SDMX to VTL. The possible mapping methods from SDMX to VTL are described in the following paragraphs and are conceived to allow the automatic deduction of the VTL definition of the object from the knowledge of the SDMX definition. 1365 1365 1366 -In the opposite direction, every time an object calculated by means of VTL must be treated as a SDMX object (for example for exchanging it through SDMX), there is the need of a SDMX definition of the object, so that the SDMX operations can take place. The SDMX definition is needed for the VTL objects for which a SDMX use is envisaged[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[19~]^^>>path:#_ftn19]](%%).1274 +In the opposite direction, every time an object calculated by means of VTL must be treated as a SDMX object (for example for exchanging it through SDMX), there is the need of a SDMX definition of the object, so that the SDMX operations can take place. The SDMX definition is needed for the VTL objects for which a SDMX use is envisaged[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[19~]^^>>path:#_ftn19]](%%). 1367 1367 1368 -The mapping methods from VTL to SDMX are described in the following paragraphs as well, however they do not allow the complete SDMX definition to be automatically deduced from the VTL definition, more than all because the former typically contains additional information in respect to the latter. For example, the definition of a SDMX DSD includes also some mandatory information not available in VTL (like the concept scheme to which the SDMX components refer, the assignmentStatus and attributeRelationship for the DataAttributes and so on). Therefore the mapping methods from VTL to SDMX provide only a general guidance for generating SDMX definitions properly starting from the information available in VTL, independently of how the SDMX definition it is actually generated (manually, automatically or part and part).1276 +The mapping methods from VTL to SDMX are described in the following paragraphs as well, however they do not allow the complete SDMX definition to be automatically deduced from the VTL definition, more than all because the former typically contains additional information in respect to the latter. For example, the definition of a SDMX DSD includes also some mandatory information not available in VTL (like the concept scheme to which the SDMX components refer, the assignmentStatus and attributeRelationship for the DataAttributes and so on). Therefore the mapping methods from VTL to SDMX provide only a general guidance for generating SDMX definitions properly starting from the information available in VTL, independently of how the SDMX definition it is actually generated (manually, automatically or part and part). 1369 1369 1370 1370 === 10.3.2 General mapping of VTL and SDMX data structures === 1371 1371 1372 -This section makes reference to the VTL “Model for data and their structure”[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[20~]^^>>path:#_ftn20]](%%) and the correspondent SDMX “Data Structure Definition”[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[21~]^^>>path:#_ftn21]](%%). 1280 +This section makes reference to the VTL “Model for data and their structure”[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[20~]^^>>path:#_ftn20]](%%) and the correspondent SDMX “Data Structure Definition”[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[21~]^^>>path:#_ftn21]](%%). 1373 1373 1374 -The main type of artefact that the VTL can manipulate is the VTL Data Set, which in general is mapped to the SDMX Dataflow. This means that a VTL Transformation, in the SDMX context, expresses the algorithm for calculating a derived Dataflow starting from some already existing Dataflows (either collected or derived).[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[22~]^^>>path:#_ftn22]](%%) 1282 +The main type of artefact that the VTL can manipulate is the VTL Data Set, which in general is mapped to the SDMX Dataflow. This means that a VTL Transformation, in the SDMX context, expresses the algorithm for calculating a derived Dataflow starting from some already existing Dataflows (either collected or derived).[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[22~]^^>>path:#_ftn22]](%%) 1375 1375 1376 -While the VTL Transformations are defined in term of Dataflow definitions, they are assumed to be executed on instances of such Dataflows, provided at runtime to the VTL engine (the mechanism for identifying the instances to be processed are not part of the VTL specifications and depend on the implementation of the VTL-based systems). As already said, the SDMX Datasets are instances of SDMX Dataflows, therefore a VTL Transformation defined on some SDMX Dataflows can be applied on some corresponding SDMX Datasets.1284 +While the VTL Transformations are defined in term of Dataflow definitions, they are assumed to be executed on instances of such Dataflows, provided at runtime to the VTL engine (the mechanism for identifying the instances to be processed are not part of the VTL specifications and depend on the implementation of the VTL-based systems). As already said, the SDMX Datasets are instances of SDMX Dataflows, therefore a VTL Transformation defined on some SDMX Dataflows can be applied on some corresponding SDMX Datasets. 1377 1377 1378 1378 A VTL Data Set is structured by one and just one Data Structure and a VTL Data Structure can structure any number of Data Sets. Correspondingly, in the SDMX context a SDMX Dataflow is structured by one and just one DataStructureDefinition and one DataStructureDefinition can structure any number of Dataflows. 1379 1379 1380 -A VTL Data Set has a Data Structure made of Components, which in turn can be Identifiers, Measures and Attributes. Similarly, a SDMX DataflowDefinition has a DataStructureDefinition made of components that can be DimensionComponents, PrimaryMeasure and DataAttributes. In turn, a 1288 +A VTL Data Set has a Data Structure made of Components, which in turn can be Identifiers, Measures and Attributes. Similarly, a SDMX DataflowDefinition has a DataStructureDefinition made of components that can be DimensionComponents, PrimaryMeasure and DataAttributes. In turn, a SDMX DimensionComponent can be a Dimension, a TimeDimension or a MeasureDimension. Correspondingly, in the SDMX implementation of the VTL, the VTL Identifiers can be (optionally) distinguished in three sub-classes (Simple Identifier, Time Identifier, Measure Identifier) even if such a distinction is not evidenced in the VTL IM. 1381 1381 1382 - SDMXDimensionComponentcan be a Dimension,aTimeDimensionora MeasureDimension.Correspondingly,intheSDMXimplementationoftheVTL,theVTL Identifiers canbe(optionally)distinguishedin three sub-classes(SimpleIdentifier,TimeIdentifier,MeasureIdentifier)evenifsuchadistinctionisnotevidencedintheVTL IM.1290 +However, a VTL Data Structure can have any number of Identifiers, Measures and Attributes, while a SDMX 2.1 DataStructureDefinition can have any number of Dimensions and DataAttributes but just one PrimaryMeasure[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[23~]^^>>path:#_ftn23]](%%). This is due to a difference between SDMX 2.1 and VTL in the possible representation methods of the data that contain more measures. 1383 1383 1384 - However, aVTLDataStructure canhave anynumber of Identifiers, Measures and Attributes,whilea SDMX 2.1 DataStructureDefinitioncanhave any numberofDimensionsandDataAttributesbut justonePrimaryMeasure[[(% class="wikiinternallinkwikiinternallinkwikiinternallink wikiinternallinkwikiinternallink"%)^^~[23~]^^>>path:#_ftn23]](%%).Thisisdue to adifferencebetweenSDMX2.1andVTLin thepossiblerepresentationmethodsof thedatathatcontainmoremeasures.1292 +As for SDMX, because the data structure cannot contain more than one measure component (i.e., the primaryMeasure), the representation of data having more measures is possible only by means of a particular dimension, called MeasureDimension, which is aimed at containing the name of the measure concepts, so that for each observation the value contained in the PrimaryMeasure component is the value of the measure concept reported in the MeasureDimension component. 1385 1385 1386 - AsforSDMX, becausethedata structurecannotcontainmorethanonemeasurecomponent(i.e., the primaryMeasure),therepresentationofdatahaving more measuresis possibleonly by means of a particular dimension, called MeasureDimension,whichisaimed atcontaining thenameof the measure concepts,sothatfor eachobservationthe valuecontainedinthePrimaryMeasure component isthevalue ofthe measureconceptreportedin theMeasureDimension component.1294 +Instead VTL allows either the method above (an identifier containing the name of the measure together with just one measure component) or a more generic method that consists in defining more measure components in the data structure, one for each measure. 1387 1387 1388 -Instead VTL allows either the method above (an identifier containing the name of the measure together with just one measure component) or a more generic method that consists in defining more measure components in the data structure, one for each measure. 1389 - 1390 1390 Therefore for multi-measure data more mapping options are possible, as described in more detail in the following sections. 1391 1391 1392 1392 === 10.3.3 Mapping from SDMX to VTL data structures === 1393 1393 1394 - **10.3.3.1 Basic Mapping **1300 +==== 10.3.3.1 Basic Mapping** ** ==== 1395 1395 1396 -The main mapping method from SDMX to VTL is called **Basic **mapping. This is considered as the default mapping method and is applied unless a different method is specified through the VtlMappingScheme and VtlDataflowMapping classes. 1842 When transforming **from SDMX to VTL**, this method consists in leaving the 1843 components unchanged and maintaining their names and roles, according to the 1844 following table:1302 +The main mapping method from SDMX to VTL is called **Basic **mapping. This is considered as the default mapping method and is applied unless a different method is specified through the VtlMappingScheme and VtlDataflowMapping classes. 1397 1397 1398 -|SDMX|VTL 1399 -|Dimension|(Simple) Identifier 1400 -|Time Dimension|(Time) Identifier 1401 -|Measure Dimension|(Measure) Identifier 1402 -|Primary Measure|Measure 1403 -|Data Attribute|Attribute 1304 +When transforming **from SDMX to VTL**, this method consists in leaving the components unchanged and maintaining their names and roles, according to the following table: 1404 1404 1405 -According to this method, the resulting VTL structures are always mono-measure 1306 +(% style="width:636.294px" %) 1307 +|(% style="width:286px" %)**SDMX**|(% style="width:347px" %)**VTL** 1308 +|(% style="width:286px" %)Dimension|(% style="width:347px" %)(Simple) Identifier 1309 +|(% style="width:286px" %)Time Dimension|(% style="width:347px" %)(Time) Identifier 1310 +|(% style="width:286px" %)Measure Dimension|(% style="width:347px" %)(Measure) Identifier 1311 +|(% style="width:286px" %)Primary Measure|(% style="width:347px" %)Measure 1312 +|(% style="width:286px" %)Data Attribute|(% style="width:347px" %)Attribute 1406 1406 1407 -(i.e., they have just one measure component) and their Measure is the SDMX 1314 +According to this method, the resulting VTL structures are always mono-measure (i.e., they have just one measure component) and their Measure is the SDMX PrimaryMeasure. Nevertheless, if the SDMX data structure has a MeasureDimension, which can convey the name of one or more measure concepts, such unique measure component can contain the value of more (conceptual) measures (one for each observation). 1408 1408 1409 -PrimaryMeasure. Nevertheless, if the SDMX data structure has a MeasureDimension, which can convey the name of one or more measure concepts, such unique measure component can contain the value of more (conceptual) measures (one for each observation). 1410 - 1411 1411 As for the SDMX DataAttributes, in VTL they are all considered “at data point / observation level” (i.e. dependent on all the VTL Identifiers), because VTL does not have the SDMX AttributeRelationships, which defines the construct to which the DataAttribute is related (e.g. observation, dimension or set or group of dimensions, whole data set). 1412 1412 1413 1413 With the Basic mapping, one SDMX observation generates one VTL data point. 1414 1414 1415 - **10.3.3.2 Pivot Mapping**1320 +==== 10.3.3.2 Pivot Mapping ==== 1416 1416 1417 -An alternative mapping method from SDMX to VTL is the **Pivot **mapping, which is different from the Basic method only for the SDMX data structures that contain a MeasureDimension, which are mapped to multi-measure VTL data structures. 1322 +An alternative mapping method from SDMX to VTL is the **Pivot **mapping, which is different from the Basic method only for the SDMX data structures that contain a MeasureDimension, which are mapped to multi-measure VTL data structures. 1418 1418 1419 1419 The SDMX structures that do not contain a MeasureDimension are mapped like in the Basic mapping (see the previous paragraph). 1420 1420 ... ... @@ -1425,36 +1425,34 @@ 1425 1425 * The SDMX MeasureDimension is not mapped to VTL (it disappears in the VTL Data Structure); 1426 1426 * The SDMX PrimaryMeasure is not mapped to VTL as well (it disappears in the VTL Data Structure); 1427 1427 * A SDMX DataAttribute is mapped in different ways according to its AttributeRelationship: 1428 -** If, according to the SDMX AttributeRelationship, the values of the DataAttribute do not depend on the values of the MeasureDimension, the SDMX DataAttribute becomes a VTL Attribute having the same name. This happens if the AttributeRelationship is not specified (i.e. the DataAttribute does not depend on any DimensionComponent and therefore is at data set level), or if it refers to a set (or a group) of dimensions which does not include the MeasureDimension;1429 -** Otherwise if, according to the SDMX AttributeRelationship, the values of the DataAttribute depend on the MeasureDimension, the SDMX DataAttribute is mapped to one VTL Attribute for each possible Concept of the SDMX MeasureDimension; by default, the names of the VTL Attributes are obtained by concatenating the name of the SDMX DataAttribute and the names of the correspondent1333 +** If, according to the SDMX AttributeRelationship, the values of the DataAttribute do not depend on the values of the MeasureDimension, the SDMX DataAttribute becomes a VTL Attribute having the same name. This happens if the AttributeRelationship is not specified (i.e. the DataAttribute does not depend on any DimensionComponent and therefore is at data set level), or if it refers to a set (or a group) of dimensions which does not include the MeasureDimension; 1334 +** Otherwise if, according to the SDMX AttributeRelationship, the values of the DataAttribute depend on the MeasureDimension, the SDMX DataAttribute is mapped to one VTL Attribute for each possible Concept of the SDMX MeasureDimension; by default, the names of the VTL Attributes are obtained by concatenating the name of the SDMX DataAttribute and the names of the correspondent 1430 1430 1431 1431 Concept of the MeasureDimension separated by underscore; for example, if the SDMX DataAttribute is named DA and the possible concepts of the SDMX MeasureDimension are named C1, C2, …, Cn, then the corresponding VTL Attributes will be named DA_C1, DA_C2, …, DA_Cn (if different names are desired, they can be achieved afterwards by renaming the Attributes through VTL operators). o Like in the Basic mapping, the resulting VTL Attributes are considered as dependent on all the VTL identifiers (i.e. “at data point / observation level”), because VTL does not have the SDMX notion of Attribute Relationship. 1432 1432 1433 1433 The summary mapping table of the “pivot” mapping from SDMX to VTL for the SDMX data structures that contain a MeasureDimension is the following: 1434 1434 1435 -|SDMX|VTL 1436 -|Dimension|(Simple) Identifier 1437 -|TimeDimension|(Time) Identifier 1438 -|MeasureDimension & PrimaryMeasure|One Measure for each Concept of the SDMX Measure Dimension 1439 -|DataAttribute not depending on the MeasureDimension|Attribute 1440 -|DataAttribute depending on the MeasureDimension|One Attribute for each Concept of the SDMX Measure Dimension 1340 +(% style="width:941.294px" %) 1341 +|(% style="width:441px" %)**SDMX**|(% style="width:497px" %)**VTL** 1342 +|(% style="width:441px" %)Dimension|(% style="width:497px" %)(Simple) Identifier 1343 +|(% style="width:441px" %)TimeDimension|(% style="width:497px" %)(Time) Identifier 1344 +|(% style="width:441px" %)MeasureDimension & PrimaryMeasure|(% style="width:497px" %)One Measure for each Concept of the SDMX Measure Dimension 1345 +|(% style="width:441px" %)DataAttribute not depending on the MeasureDimension|(% style="width:497px" %)Attribute 1346 +|(% style="width:441px" %)DataAttribute depending on the MeasureDimension|(% style="width:497px" %)One Attribute for each Concept of the SDMX Measure Dimension 1441 1441 1442 -Using this mapping method, the components of the data structure can change in the conversion from SDMX to VTL and it must be taken into account that the VTL 1908statements can reference only the components of the resulting VTL data structure.1348 +Using this mapping method, the components of the data structure can change in the conversion from SDMX to VTL and it must be taken into account that the VTL statements can reference only the components of the resulting VTL data structure. 1443 1443 1444 -At observation / data point level, calling Cj (j=1, … n) the j^^th^^ Concept of the 1911MeasureDimension:1350 +At observation / data point level, calling Cj (j=1, … n) the j^^th^^ Concept of the MeasureDimension: 1445 1445 1446 - The set of SDMX observations having the same values for all the Dimensions except than the MeasureDimension become one multi-measure VTL Data Point, having one Measure for each Concept Cj of the SDMX MeasureDimension; 1352 +* The set of SDMX observations having the same values for all the Dimensions except than the MeasureDimension become one multi-measure VTL Data Point, having one Measure for each Concept Cj of the SDMX MeasureDimension; 1353 +* The values of the SDMX simple Dimensions, TimeDimension and DataAttributes not depending on the MeasureDimension (these components by definition have always the same values for all the observations of the set above) become the values of the corresponding VTL (simple) Identifiers, (time) Identifier and Attributes. 1354 +* The value of the PrimaryMeasure of the SDMX observation belonging to the set above and having MeasureDimension=Cj becomes the value of the VTL Measure Cj 1355 +* For the SDMX DataAttributes depending on the MeasureDimension, the value of the DataAttribute DA of the SDMX observation belonging to the set above and having MeasureDimension=Cj becomes the value of the VTL Attribute DA_Cj 1447 1447 1448 -* 1449 -** The values of the SDMX simple Dimensions, TimeDimension and DataAttributes not depending on the MeasureDimension (these components by definition have always the same values for all the observations of the set above) become the values of the corresponding VTL (simple) Identifiers, (time) Identifier and Attributes. 1450 -** The value of the PrimaryMeasure of the SDMX observation belonging to the set above and having MeasureDimension=Cj becomes the value of the VTL Measure Cj 1451 -** For the SDMX DataAttributes depending on the MeasureDimension, the value of the DataAttribute DA of the SDMX observation belonging to the set above and having MeasureDimension=Cj becomes the value of the VTL Attribute DA_Cj 1357 +==== 10.3.3.3 From SDMX DataAttributes to VTL Measures ==== 1452 1452 1453 -* *10.3.3.3From SDMX DataAttributes to VTLMeasures**1359 +* In some cases it may happen that the DataAttributes of the SDMX DataStructure need to be managed as Measures in VTL. Therefore, a variant of both the methods above consists in transforming all the SDMX DataAttributes in VTL Measures. When DataAttributes are converted to Measures, the two methods above are called Basic_A2M and Pivot_A2M (the suffix “A2M” stands for Attributes to Measures). Obviously, the resulting VTL data structure is, in general, multi-measure and does not contain Attributes. 1454 1454 1455 -* 1456 -** In some cases it may happen that the DataAttributes of the SDMX DataStructure need to be managed as Measures in VTL. Therefore, a variant of both the methods above consists in transforming all the SDMX DataAttributes in VTL Measures. When DataAttributes are converted to Measures, the two methods above are called Basic_A2M and Pivot_A2M (the suffix “A2M” stands for Attributes to Measures). Obviously, the resulting VTL data structure is, in general, multi-measure and does not contain Attributes. 1457 - 1458 1458 The Basic_A2M and Pivot_A2M behaves respectively like the Basic and Pivot methods, except that the final VTL components, which according to the Basic and Pivot methods would have had the role of Attribute, assume instead the role of Measure. 1459 1459 1460 1460 Proper VTL features allow changing the role of specific attributes even after the SDMX to VTL mapping: they can be useful when only some of the DataAttributes need to be managed as VTL Measures. ... ... @@ -1461,28 +1461,27 @@ 1461 1461 1462 1462 === 10.3.4 Mapping from VTL to SDMX data structures === 1463 1463 1464 - **10.3.4.1 Basic Mapping **1367 +==== 10.3.4.1 Basic Mapping** ** ==== 1465 1465 1466 1466 The main mapping method **from VTL to SDMX** is called **Basic **mapping as well. 1467 1467 1468 -This is considered as the default mapping method and is applied unless a different method is specified through the VtlMappingScheme and VtlDataflowMapping classes. 1371 +This is considered as the default mapping method and is applied unless a different method is specified through the VtlMappingScheme and VtlDataflowMapping classes. 1469 1469 1470 1470 The method consists in leaving the components unchanged and maintaining their names and roles in SDMX, according to the following mapping table, which is the same as the basic mapping from SDMX to VTL, only seen in the opposite direction. 1471 1471 1472 -This mapping method cannot be applied for SDMX 2.1 if the VTL data structure has more than one measure component, given that the SDMX 2.1 DataStructureDefinition allows just one measure component (the 1375 +This mapping method cannot be applied for SDMX 2.1 if the VTL data structure has more than one measure component, given that the SDMX 2.1 DataStructureDefinition allows just one measure component (the PrimaryMeasure). In this case it becomes mandatory to specify a different mapping method through the VtlMappingScheme and VtlDataflowMapping classes.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[24~]^^>>path:#_ftn24]](%%) 1473 1473 1474 -P rimaryMeasure).In this case itbecomesmandatoryto specify adifferent1958 mappingmethodthroughtheVtlMappingSchemeandVtlDataflowMapping1959 classes.[[(%class="wikiinternallinkwikiinternallinkwikiinternallinkwikiinternallinkwikiinternallink"%)^^~[24~]^^>>path:#_ftn24]](%%)1377 +Please note that the VTL measures can have any name while in SDMX 2.1 the MeasureComponent has the mandatory name “obs_value”, therefore the name of the VTL measure name must become “obs_value” in SDMX 2.1. 1475 1475 1476 -1960 Please note that the VTL measures can have any name while in SDMX 2.1 the 1961 MeasureComponent has the mandatory name “obs_value”, therefore the name of the VTL measure name must become “obs_value” in SDMX 2.1. 1477 - 1478 1478 Mapping table: 1479 1479 1480 -|VTL|SDMX 1481 -|(Simple) Identifier|Dimension 1482 -|(Time) Identifier|TimeDimension 1483 -|(Measure) Identifier|MeasureDimension 1484 -|Measure|PrimaryMeasure 1485 -|Attribute|DataAttribute 1381 +(% style="width:592.294px" %) 1382 +|(% style="width:253px" %)**VTL**|(% style="width:336px" %)**SDMX** 1383 +|(% style="width:253px" %)(Simple) Identifier|(% style="width:336px" %)Dimension 1384 +|(% style="width:253px" %)(Time) Identifier|(% style="width:336px" %)TimeDimension 1385 +|(% style="width:253px" %)(Measure) Identifier|(% style="width:336px" %)MeasureDimension 1386 +|(% style="width:253px" %)Measure|(% style="width:336px" %)PrimaryMeasure 1387 +|(% style="width:253px" %)Attribute|(% style="width:336px" %)DataAttribute 1486 1486 1487 1487 If the distinction between simple identifier, time identifier and measure identifier is not maintained in the VTL environment, the classification between Dimension, TimeDimension and MeasureDimension exists only in SDMX, as declared in the relevant DataStructureDefinition. 1488 1488 ... ... @@ -1490,16 +1490,14 @@ 1490 1490 1491 1491 Note that the basic mappings in the two directions (from SDMX 2.1 to VTL 2.0 and vice-versa) are (almost completely) reversible. In fact, if a SDMX 2.1 structure is mapped to a VTL structure and then the latter is mapped back to SDMX 2.1, the resulting data structure is like the original one (apart for the AttributeRelationship, that can be different if the original SDMX 2.1 structure contains DataAttributes that are not at observation level). In reverse order, if a VTL 2.0 mono-measure structure is mapped to SDMX 2.1 and then the latter is mapped back to VTL 2.0, the original data structure is obtained (apart from the name of the VTL measure, that in SDMX 2.1 must become “obs_value”). 1492 1492 1493 -As said, the resulting SDMX definitions must be compliant with the SDMX consistency rules. For example, the SDMX DSD must have the assignmentStatus,which does not exist in VTL, the AttributeRelationship for the DataAttributes and so on.1395 +As said, the resulting SDMX definitions must be compliant with the SDMX consistency rules. For example, the SDMX DSD must have the assignmentStatus, which does not exist in VTL, the AttributeRelationship for the DataAttributes and so on. 1494 1494 1495 - **10.3.4.2 Unpivot Mapping**1397 +==== 10.3.4.2 Unpivot Mapping ==== 1496 1496 1497 -An alternative mapping method from VTL to SDMX is the **Unpivot **mapping. 1399 +An alternative mapping method from VTL to SDMX is the **Unpivot **mapping. 1498 1498 1499 -Although this mapping method can be used in any case, it makes major sense in case the VTL data structure has more than one measure component (multi-measures VTL structure). For such VTL structures, in fact, the basic method cannot be applied, given that by maintaining the data structure unchanged the resulting SDMX data structure would have more than one measure component, which is not allowed by SDMX 2.1 (it allows just one measure component, the PrimaryMeasure, called 1401 +Although this mapping method can be used in any case, it makes major sense in case the VTL data structure has more than one measure component (multi-measures VTL structure). For such VTL structures, in fact, the basic method cannot be applied, given that by maintaining the data structure unchanged the resulting SDMX data structure would have more than one measure component, which is not allowed by SDMX 2.1 (it allows just one measure component, the PrimaryMeasure, called “obs_value”). 1500 1500 1501 -“obs_value”). 1502 - 1503 1503 The multi-measures VTL structures have not a Measure Identifier (because the Measures are separate components) and need to be converted to SDMX dataflows having an added MeasureDimension which disambiguates the multiple measures, and an added PrimaryMeasure, in which the measures’ values are maintained. 1504 1504 1505 1505 The **unpivot** mapping behaves like follows: ... ... @@ -1506,43 +1506,34 @@ 1506 1506 1507 1507 * like in the basic mapping, a VTL (simple) identifier becomes a SDMX 1508 1508 1509 -Dimension and a VTL (time) identifier becomes a SDMX TimeDimension (as said, a measure identifier cannot exist in multi-measure VTL structures);1409 +Dimension and a VTL (time) identifier becomes a SDMX TimeDimension (as said, a measure identifier cannot exist in multi-measure VTL structures); 1510 1510 1511 1511 * a MeasureDimension component called “measure_name” is added to the SDMX DataStructure; 1512 -* a PrimaryMeasure component called “obs_value” is added to the SDMX DataStructure;1513 -* each VTL Measure is mapped to a Concept of the SDMX MeasureDimension having the same name as the VTL Measure (therefore all the VTL Measure Components do not originate Components in the SDMX DataStructure);1514 -* a VTL Attribute becomes a SDMX DataAttribute having AttributeRelationship referred to all the SDMX DimensionComponents including the TimeDimensionand except the MeasureDimension.1412 +* a PrimaryMeasure component called “obs_value” is added to the SDMX DataStructure; 1413 +* each VTL Measure is mapped to a Concept of the SDMX MeasureDimension having the same name as the VTL Measure (therefore all the VTL Measure Components do not originate Components in the SDMX DataStructure); 1414 +* a VTL Attribute becomes a SDMX DataAttribute having AttributeRelationship referred to all the SDMX DimensionComponents including the TimeDimension and except the MeasureDimension. 1515 1515 1516 1516 The summary mapping table of the **unpivot** mapping method is the following: 1517 1517 1518 - 1519 -|VTL|SDMX 1520 -|(Simple) Identifier|Dimension 1521 -|(Time) Identifier|TimeDimension 1522 -|All Measure Components|((( 1523 -MeasureDimension (having one Measure Concept for each VTL measure component) & 1524 - 1525 -PrimaryMeasure 1418 +(% style="width:904.294px" %) 1419 +|(% style="width:291px" %)**VTL**|(% style="width:611px" %)**SDMX** 1420 +|(% style="width:291px" %)(Simple) Identifier|(% style="width:611px" %)Dimension 1421 +|(% style="width:291px" %)(Time) Identifier|(% style="width:611px" %)TimeDimension 1422 +|(% style="width:291px" %)All Measure Components|(% style="width:611px" %)((( 1423 +MeasureDimension (having one Measure Concept for each VTL measure component) & PrimaryMeasure 1526 1526 ))) 1527 -|Attribute |((( 1528 -DataAttribute depending on all 1529 - 1530 -SDMX Dimensions including the 1531 - 1532 -TimeDimension and except the MeasureDimension 1425 +|(% style="width:291px" %)Attribute |(% style="width:611px" %)((( 1426 +DataAttribute depending on all SDMX Dimensions including the TimeDimension and except the MeasureDimension 1533 1533 ))) 1534 1534 1535 1535 At observation / data point level: 1536 1536 1537 - a multi-measure VTL Data Point becomes a set of SDMX observations, one for each VTL measure 1431 +* a multi-measure VTL Data Point becomes a set of SDMX observations, one for each VTL measure 1432 +* the values of the VTL identifiers become the values of the corresponding SDMX Dimensions, for all the observations of the set above 1433 +* the name of the j^^th^^ VTL measure (e.g. “Cj”) becomes the value of the SDMX MeasureDimension of the j^^th^^ observation of the set (i.e. the Concept Cj) 1434 +* the value of the j^^th^^ VTL measure becomes the value of the SDMX PrimaryMeasure of the j^^th^^ observation of the set 1435 +* the values of the VTL Attributes become the values of the corresponding SDMX DataAttributes (in principle for all the observations of the set above) 1538 1538 1539 - the values of the VTL identifiers become the values of the corresponding SDMX Dimensions, for all the observations of the set above 1540 - 1541 -* 1542 -** the name of the j^^th^^ VTL measure (e.g. “Cj”) becomes the value of the SDMX MeasureDimension of the j^^th^^ observation of the set (i.e. the Concept Cj) 1543 -** the value of the j^^th^^ VTL measure becomes the value of the SDMX PrimaryMeasure of the j^^th^^ observation of the set 1544 -** the values of the VTL Attributes become the values of the corresponding SDMX DataAttributes (in principle for all the observations of the set above) 1545 - 1546 1546 If desired, this method can be applied also to mono-measure VTL structures, provided that none of the VTL components has already the role of measure identifier. 1547 1547 1548 1548 Like in the general case, a MeasureDimension component called “measure_name” would be added to the SDMX DataStructure and would have just one possible measure concept, corresponding to the unique VTL measure. The original VTL measure component would not become a Component in the SDMX data structure. The value of the VTL measure would be assigned to the SDMX PrimaryMeasure called “obs_value”. ... ... @@ -1549,219 +1549,150 @@ 1549 1549 1550 1550 In any case, the resulting SDMX definitions must be compliant with the SDMX consistency rules. For example, the possible Concepts of the SDMX MeasureDimension need to be listed in a SDMX ConceptScheme, with proper id, agency and version; moreover, the SDMX DSD must have the assignmentStatus, which does not exist in VTL, the attributeRelationship for the DataAttributes and so on. 1551 1551 1552 - **10.3.4.3 From VTL Measures to SDMX Data Attributes **1443 +==== 10.3.4.3 From VTL Measures to SDMX Data Attributes** ** ==== 1553 1553 1554 1554 For the multi-measure VTL structures (having more than one Measure Component), it may happen that the Measures of the VTL Data Structure need to be managed as DataAttributes in SDMX. Therefore a third mapping method consists in transforming one VTL measure in the SDMX primaryMeasure and all the other VTL Measures in SDMX DataAttributes. This method is called M2A (“M2A” stands for “Measures to DataAttributes”). 1555 1555 1556 1556 When applied to mono-measure VTL structures (having one Measure component), the M2A method behaves like the Basic mapping (the VTL Measure component becomes the SDMX primary measure “obs_value”, there is no additional VTL measure to be converted to SDMX DataAttribute). Therefore the mapping table is the same as for the Basic method: 1557 1557 1558 -|VTL|SDMX 1559 -|(Simple) Identifier|Dimension 1560 -|(Time) Identifier|TimeDimension 1561 -|(Measure) Identifier (if any)|MeasureDimension 1562 -|Measure|PrimaryMeasure 1563 -|Attribute|DataAttribute 1449 +(% style="width:591.294px" %) 1450 +|(% style="width:252px" %)**VTL**|(% style="width:336px" %)**SDMX** 1451 +|(% style="width:252px" %)(Simple) Identifier|(% style="width:336px" %)Dimension 1452 +|(% style="width:252px" %)(Time) Identifier|(% style="width:336px" %)TimeDimension 1453 +|(% style="width:252px" %)(Measure) Identifier (if any)|(% style="width:336px" %)MeasureDimension 1454 +|(% style="width:252px" %)Measure|(% style="width:336px" %)PrimaryMeasure 1455 +|(% style="width:252px" %)Attribute|(% style="width:336px" %)DataAttribute 1564 1564 1565 -For multi-measure VTL structures (having more than one Measure component), one VTL Measure becomes the SDMX PrimaryMeasure while the other VTL Measures maintain their names and values but assume the role of DataAttribute in SDMX. The choice of the VTL Measure that correspond to the SDMX PrimaryMeasure is left to the definer of the SDMX data structure definition.1457 +For multi-measure VTL structures (having more than one Measure component), one VTL Measure becomes the SDMX PrimaryMeasure while the other VTL Measures maintain their names and values but assume the role of DataAttribute in SDMX. The choice of the VTL Measure that correspond to the SDMX PrimaryMeasure is left to the definer of the SDMX data structure definition. 1566 1566 1567 - 2Taking into account that the multi-measure VTL structures do not have a measure2073identifier, the mapping table is the following:1459 +Taking into account that the multi-measure VTL structures do not have a measure identifier, the mapping table is the following: 1568 1568 1569 -|VTL|SDMX 1570 -|(Simple) Identifier|Dimension 1571 -|(Time) Identifier|TimeDimension 1572 -|One of the Measures|PrimaryMeasure 1573 -|Other Measures|DataAttribute 1574 -|Attribute|DataAttribute 1461 +(% style="width:588.294px" %) 1462 +|(% style="width:259px" %)**VTL**|(% style="width:326px" %)**SDMX** 1463 +|(% style="width:259px" %)(Simple) Identifier|(% style="width:326px" %)Dimension 1464 +|(% style="width:259px" %)(Time) Identifier|(% style="width:326px" %)TimeDimension 1465 +|(% style="width:259px" %)One of the Measures|(% style="width:326px" %)PrimaryMeasure 1466 +|(% style="width:259px" %)Other Measures|(% style="width:326px" %)DataAttribute 1467 +|(% style="width:259px" %)Attribute|(% style="width:326px" %)DataAttribute 1575 1575 1576 -Even in this case, the resulting SDMX definitions must be compliant with the SDMX consistency rules. For example, the SDMX DSD must have the assignmentStatus, which does not exist in VTL, the attributeRelationship for the DataAttributes and so on. In particular, the primaryMeasure of the SDMX 2.1 DSD must be called “obs_value” and must be one of the VTL Measures, chosen by the DSD definer.1469 +Even in this case, the resulting SDMX definitions must be compliant with the SDMX consistency rules. For example, the SDMX DSD must have the assignmentStatus, which does not exist in VTL, the attributeRelationship for the DataAttributes and so on. In particular, the primaryMeasure of the SDMX 2.1 DSD must be called “obs_value” and must be one of the VTL Measures, chosen by the DSD definer. 1577 1577 1578 1578 === 10.3.5 Declaration of the mapping methods between data structures === 1579 1579 1580 1580 In order to define and understand properly VTL transformations, the applied mapping methods must be specified in the SDMX structural metadata. If the default mapping method (Basic) is applied, no specification is needed. 1581 1581 1582 - 1583 1583 A customized mapping can be defined through the VtlMappingScheme and VtlDataflowMapping classes (see the section of the SDMX IM relevant to the VTL). A VtlDataflowMapping allows specifying the mapping methods to be used for a specific dataflow, both in the direction from SDMX to VTL (toVtlMappingMethod) and from VTL to SDMX (fromVtlMappingMethod); in fact a VtlDataflowMapping associates the structured URN that identifies a SDMX dataflow to its VTL alias and its mapping methods. 1584 1584 1585 -It is possible to specify the toVtlMappingMethod and fromVtlMappingMethod also for the conventional dataflow called “generic_dataflow”: in this case the specified mapping methods are intended to become the default ones, overriding the 1477 +It is possible to specify the toVtlMappingMethod and fromVtlMappingMethod also for the conventional dataflow called “generic_dataflow”: in this case the specified mapping methods are intended to become the default ones, overriding the “Basic” methods. In turn, the toVtlMappingMethod and fromVtlMappingMethod declared for a specific Dataflow are intended to override the default ones for such a Dataflow. 1586 1586 1587 -“Basic” methods. In turn, the toVtlMappingMethod and fromVtlMappingMethod declared for a specific Dataflow are intended to override the default ones for such a Dataflow. 1588 - 1589 1589 The VtlMappingScheme is a container for zero or more VtlDataflowMapping (besides possible mappings to artefacts other than dataflows). 1590 1590 1591 -=== 10.3.6 Mapping dataflow subsets to distinct VTL data sets[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^**~[25~]**^^>>path:#_ftn25]](%%) === 1481 +=== 10.3.6 Mapping dataflow subsets to distinct VTL data sets[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^**~[25~]**^^>>path:#_ftn25]](%%) === 1592 1592 1593 -Until now it as been assumed to map one SMDX Dataflow to one VTL dataset and vice-versa. This mapping one-to-one is not mandatory according to VTL because a VTL data set is meant to be a set of observations (data points) on a logical plane, having the same logical data structure and the same general meaning, independently of the possible physical representation or storage (see VTL 2.0 User Manual page 1483 +Until now it as been assumed to map one SMDX Dataflow to one VTL dataset and vice-versa. This mapping one-to-one is not mandatory according to VTL because a VTL data set is meant to be a set of observations (data points) on a logical plane, having the same logical data structure and the same general meaning, independently of the possible physical representation or storage (see VTL 2.0 User Manual page 24), therefore a SDMX Dataflow can be seen either as a unique set of data observations (corresponding to one VTL data set) or as the union of many sets of data observations (each one corresponding to a distinct VTL data set). 1594 1594 1595 - 24),thereforeaSDMX Dataflowcanbe seeneitheras a unique setofdataobservations(correspondingtooneVTLdata set)orastheunionof manysetsof dataobservations(eachonecorrespondingtoadistinctVTL dataset).1485 +As a matter of fact, in some cases it can be useful to define VTL operations involving definite parts of a SDMX Dataflow instead than the whole.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[26~]^^>>path:#_ftn26]](%%) 1596 1596 1597 - As a matteroffact, insomecases itcan beusefultodefineVTL operations involvingdefinite parts of a SDMX Dataflow instead than thewhole.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[26~]^^>>path:#_ftn26]](%%)1487 +Therefore, in order to make the coding of VTL operations simpler when applied on parts of SDMX Dataflows, it is allowed to map distinct parts of a SDMX Dataflow to distinct VTL data sets according to the following rules and conventions. This kind of mapping is possible both from SDMX to VTL and from VTL to SDMX, as better explained below.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[27~]^^>>path:#_ftn27]](%%) 1598 1598 1599 - Therefore,inordertomakethe codingofVTL operationssimpler whenappliedonparts ofSDMXDataflows, it is allowed to mapdistinctparts ofa SDMX Dataflow to distinctVTL datasetsaccordingto thefollowing rulesandconventions.This kindofmapping is possiblebothfromSDMXtoVTL andfrom VTLtoSDMX, as betterexplainedbelow.[[(% class="wikiinternallinkwikiinternallinkwikiinternallink wikiinternallink wikiinternallink" %)^^~[27~]^^>>path:#_ftn27]](%%)1489 +Given a SDMX Dataflow and some predefined Dimensions of its DataStructure, it is allowed to map the subsets of observations that have the same combination of values for such Dimensions to correspondent VTL datasets. 1600 1600 1601 - GivenaSDMXDataflow and somepredefinedDimensionsofits1491 +For example, assuming that the SDMX dataflow DF1(1.0) has the Dimensions INDICATOR, TIME_PERIOD and COUNTRY, and that the user declares the Dimensions INDICATOR and COUNTRY as basis for the mapping (i.e. the mapping dimensions): the observations that have the same values for INDICATOR and COUNTRY would be mapped to the same VTL dataset (and vice-versa). 1602 1602 1603 -DataStructure, it is allowed to map the subsets of observations that have the same combination of values for such Dimensions to correspondent VTL datasets. 1604 - 1605 -For example, assuming that the SDMX dataflow DF1(1.0) has the Dimensions INDICATOR, TIME_PERIOD and COUNTRY, and that the user declares the 1606 - 1607 -Dimensions INDICATOR and COUNTRY as basis for the mapping (i.e. the mapping dimensions): the observations that have the same values for INDICATOR and COUNTRY would be mapped to the same VTL dataset (and vice-versa). 1608 - 1609 1609 In practice, this kind mapping is obtained like follows: 1610 1610 1611 -* For a given SDMX dataflow, the user (VTL definer) declares the dimension components on which the mapping will be based, in a given order.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[28~]^^>>path:#_ftn28]](%%) Following the example above, imagine that the user declares the dimensions INDICATOR and COUNTRY.1495 +* For a given SDMX dataflow, the user (VTL definer) declares the dimension components on which the mapping will be based, in a given order.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[28~]^^>>path:#_ftn28]](%%) Following the example above, imagine that the user declares the dimensions INDICATOR and COUNTRY. 1612 1612 * The VTL dataset is given a name using a special notation also called “ordered concatenation” and composed of the following parts: 1613 -** The reference to the SDMX dataflow (expressed according to the rules described in the previous paragraphs, i.e. URN, abbreviated 1497 +** The reference to the SDMX dataflow (expressed according to the rules described in the previous paragraphs, i.e. URN, abbreviated URN or another alias); for example DF(1.0); 1498 +** a slash (“/”) as a separator; [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[29~]^^>>path:#_ftn29]] 1499 +** The reference to a specific part of the SDMX dataflow above, expressed as the concatenation of the values that the SDMX dimensions declared above must have, separated by dots (“.”) and written in the order in which these dimensions are defined[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[30~]^^>>path:#_ftn30]](%%). For example POPULATION.USA would mean that such a VTL dataset is mapped to the SDMX observations for which the dimension //INDICATOR// is equal to POPULATION and the dimension //COUNTRY// is equal to USA. 1614 1614 1615 -URN or another alias); for example DF(1.0); o a slash (“/”) as a separator; [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[29~]^^>>path:#_ftn29]] 1616 - 1617 -* 1618 -** The reference to a specific part of the SDMX dataflow above, expressed as the concatenation of the values that the SDMX dimensions declared above must have, separated by dots (“.”) and written in the order in which these dimensions are defined[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[30~]^^>>path:#_ftn30]](%%) . For example POPULATION.USA would mean that such a VTL dataset is mapped to the SDMX observations for which the dimension //INDICATOR// is equal to POPULATION and the dimension //COUNTRY// is equal to USA. 1619 - 1620 1620 In the VTL transformations, this kind of dataset name must be referenced between single quotes because the slash (“/”) is not a regular character according to the VTL rules. 1621 1621 1622 1622 Therefore, the generic name of this kind of VTL datasets would be: 1623 1623 1624 -‘DF(1.0)///INDICATORvalue//.//COUNTRYvalue//’ 1505 +> ‘DF(1.0)///INDICATORvalue//.//COUNTRYvalue//’ 1625 1625 1626 1626 Where DF(1.0) is the Dataflow and //INDICATORvalue// and //COUNTRYvalue //are placeholders for one value of the INDICATOR and // //COUNTRY dimensions. 1627 1627 1628 1628 Instead the specific name of one of these VTL datasets would be: 1629 1629 1630 -‘DF(1.0)/POPULATION.USA’ 1511 +> ‘DF(1.0)/POPULATION.USA’ 1631 1631 1632 -In particular, this is the VTL dataset that contains all the observations of the dataflow DF(1.0) for which //INDICATOR// = POPULATION and //COUNTRY// = USA.1513 +In particular, this is the VTL dataset that contains all the observations of the dataflow DF(1.0) for which //INDICATOR// = POPULATION and //COUNTRY// = USA. 1633 1633 1634 1634 Let us now analyse the different meaning of this kind of mapping in the two mapping directions, i.e. from SDMX to VTL and from VTL to SDMX. 1635 1635 1636 -As already said, the mapping from SDMX to VTL happens when the VTL datasets are operand of VTL transformations, instead the mapping from VTL to SDMX happens when the VTL datasets are result of VTL transformations[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[31~]^^>>path:#_ftn31]](%%) and need to be treated as SDMX objects. This kind of mapping can be applied independently in the two directions and the Dimensions on which the mapping is based can be different in the two directions: these Dimensions are defined in the ToVtlSpaceKey and in the FromVtlSpaceKey classes respectively. 1517 +As already said, the mapping from SDMX to VTL happens when the VTL datasets are operand of VTL transformations, instead the mapping from VTL to SDMX happens when the VTL datasets are result of VTL transformations[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[31~]^^>>path:#_ftn31]](%%) and need to be treated as SDMX objects. This kind of mapping can be applied independently in the two directions and the Dimensions on which the mapping is based can be different in the two directions: these Dimensions are defined in the ToVtlSpaceKey and in the FromVtlSpaceKey classes respectively. 1637 1637 1638 -First, let us see what happens in the mapping direction from SDMX to VTL, i.e. when parts of a SDMX dataflow (e.g. DF1(1.0)) need to be mapped to distinct VTL datasets that are operand of some VTL transformations.1519 +First, let us see what happens in the__ mapping direction from SDMX to VTL__, i.e. when parts of a SDMX dataflow (e.g. DF1(1.0)) need to be mapped to distinct VTL datasets that are operand of some VTL transformations. 1639 1639 1640 -As already said, each VTL dataset is assumed to contain all the observations of the 1521 +As already said, each VTL dataset is assumed to contain all the observations of the SDMX dataflow having INDICATOR=//INDICATORvalue //and COUNTRY=//COUNTRYvalue//. For example, the VTL dataset ‘DF1(1.0)/POPULATION.USA’ would contain all the observations of DF1(1.0) having INDICATOR = POPULATION and COUNTRY = USA. 1641 1641 1642 -SDMX dataflow havingINDICATOR=//INDICATORvalue//andCOUNTRY=1523 +In order to obtain the data structure of these VTL datasets from the SDMX one, it is assumed that the SDMX dimensions on which the mapping is based are dropped, i.e. not maintained in the VTL data structure; this is possible because their values are fixed for each one of the invoked VTL datasets[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[32~]^^>>path:#_ftn32]](%%). After that, the mapping method from SDMX to VTL specified for the dataflow DF1(1.0) is applied (i.e. basic, pivot …). 1643 1643 1644 - //COUNTRYvalue//.Forexample, theVTLdataset ‘DF1(1.0)/POPULATION.USA’ wouldcontainall theobservations ofDF1(1.0)havingINDICATOR =POPULATIONand COUNTRY = USA.1525 +In the example above, for all the datasets of the kind ‘DF1(1.0)///INDICATORvalue//.//COUNTRYvalue//’, the dimensions INDICATOR and COUNTRY would be dropped so that the data structure of all the resulting VTL data sets would have the identifier TIME_PERIOD only. 1645 1645 1646 -In order to obtain the data structure of these VTL datasets from the SDMX one, it is assumed that the SDMX dimensions on which the mapping is based are dropped, i.e. not maintained in the VTL data structure; this is possible because their values are fixed for each one of the invoked VTL datasets[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[32~]^^>>path:#_ftn32]](%%). After that, the mapping method from SDMX to VTL specified for the dataflow DF1(1.0) is applied (i.e. basic, pivot …). 1647 - 1648 -In the example above, for all the datasets of the kind 1649 - 1650 -‘DF1(1.0)///INDICATORvalue//.//COUNTRYvalue//’, the dimensions INDICATOR and COUNTRY would be dropped so that the data structure of all the resulting VTL data sets would have the identifier TIME_PERIOD only. 1651 - 1652 1652 It should be noted that the desired VTL datasets (i.e. of the kind ‘DF1(1.0)/// INDICATORvalue//.//COUNTRYvalue//’) can be obtained also by applying the VTL operator “**sub**” (subspace) to the dataflow DF1(1.0), like in the following VTL expression: 1653 1653 1654 -‘DF1(1.0)/POPULATION.USA’ := 1529 +> ‘DF1(1.0)/POPULATION.USA’ := 1530 +> DF1(1.0) [ sub INDICATOR=“POPULATION”, COUNTRY=“USA” ]; 1531 +> ‘DF1(1.0)/POPULATION.CANADA’ := 1532 +> DF1(1.0) [ sub INDICATOR=“POPULATION”, COUNTRY=“CANADA” ]; 1533 +> … … … 1655 1655 1656 - DF1(1.0)[subINDICATOR=“POPULATION”,COUNTRY=“USA” ];1535 +In fact the VTL operator “sub” has exactly the same behaviour. Therefore, mapping different parts of a SDMX dataflow to different VTL datasets in the direction from SDMX to VTL through the ordered concatenation notation is equivalent to a proper use of the operator “**sub**” on such a dataflow. [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[33~]^^>>path:#_ftn33]] 1657 1657 1658 - 1659 -‘DF1(1.0)/POPULATION.CANADA’ := 1660 - 1661 -DF1(1.0) [ sub INDICATOR=“POPULATION”, COUNTRY=“CANADA” ]; 1662 - 1663 - 1664 -… … … 1665 - 1666 -In fact the VTL operator “sub” has exactly the same behaviour. Therefore, mapping different parts of a SDMX dataflow to different VTL datasets in the direction from SDMX to VTL through the ordered concatenation notation is equivalent to a proper use of the operator “**sub**” on such a dataflow. [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[33~]^^>>path:#_ftn33]] 1667 - 1668 1668 In the direction from SDMX to VTL it is allowed to omit the value of one or more Dimensions on which the mapping is based, but maintaining all the separating dots (therefore it may happen to find two or more consecutive dots and dots in the beginning or in the end). The absence of value means that for the corresponding Dimension all the values are kept and the Dimension is not dropped. 1669 1669 1670 -For example, ‘DF(1.0)/POPULATION.’ (note the dot in the end of the name) is the VTL dataset that contains all the observations of the dataflow DF(1.0) for which //INDICATOR// = POPULATION and COUNTRY = any value.1539 +For example, ‘DF(1.0)/POPULATION.’ (note the dot in the end of the name) is the VTL dataset that contains all the observations of the dataflow DF(1.0) for which //INDICATOR// = POPULATION and COUNTRY = any value. 1671 1671 1672 1672 This is equivalent to the application of the VTL “sub” operator only to the identifier //INDICATOR//: 1673 1673 1674 -‘DF1(1.0)/POPULATION.’ := 1543 +> ‘DF1(1.0)/POPULATION.’ := 1544 +> DF1(1.0) [sub INDICATOR=“POPULATION” ]; 1675 1675 1676 -DF1(1.0) [ sub INDICATOR=“POPULATION” ]; 1677 - 1678 - 1679 1679 Therefore the VTL dataset ‘DF1(1.0)/POPULATION.’ would have the identifiers COUNTRY and TIME_PERIOD. 1680 1680 1681 1681 Heterogeneous invocations of the same Dataflow are allowed, i.e. omitting different Dimensions in different invocations. 1682 1682 1683 -Let us now analyse the mapping direction from VTL to SDMX. 1550 +Let us now analyse the __mapping direction from VTL to SDMX__. 1684 1684 1685 1685 In this situation, distinct parts of a SDMX dataflow are calculated as distinct VTL datasets, under the constraint that they must have the same VTL data structure. 1686 1686 1687 1687 For example, let us assume that the VTL programmer wants to calculate the SDMX dataflow DF2(1.0) having the Dimensions TIME_PERIOD, INDICATOR, and COUNTRY and that such a programmer finds it convenient to calculate separately the parts of DF2(1.0) that have different combinations of values for INDICATOR and COUNTRY: 1688 1688 1689 -* each part is calculated as a VTL derived dataset, result of a dedicated VTL transformation; [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[34~]^^>>path:#_ftn34]](%%)1690 -* the data structure of all these VTL datasets has the TIME_PERIOD identifier and does not have the INDICATOR and COUNTRY identifiers.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[35~]^^>>path:#_ftn35]] 1556 +* each part is calculated as a VTL derived dataset, result of a dedicated VTL transformation; [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[34~]^^>>path:#_ftn34]](%%) 1557 +* the data structure of all these VTL datasets has the TIME_PERIOD identifier and does not have the INDICATOR and COUNTRY identifiers.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[35~]^^>>path:#_ftn35]] 1691 1691 1692 -Under these hypothesis, such derived VTL datasets can be mapped to DF2(1.0) by declaring the Dimensions INDICATOR and COUNTRY as mapping dimensions[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[36~]^^>>path:#_ftn36]](%%). 1559 +Under these hypothesis, such derived VTL datasets can be mapped to DF2(1.0) by declaring the Dimensions INDICATOR and COUNTRY as mapping dimensions[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[36~]^^>>path:#_ftn36]](%%). 1693 1693 1694 -The corresponding VTL transformations, assuming that the result needs to be persistent, would be of this kind:^^ ^^[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[37~]^^>>path:#_ftn37]] 1561 +The corresponding VTL transformations, assuming that the result needs to be persistent, would be of this kind:^^ ^^[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[37~]^^>>path:#_ftn37]] 1695 1695 1696 1696 ‘DF2(1.0)///INDICATORvalue//.//COUNTRYvalue//’ <- expression 1697 1697 1698 1698 Some examples follow, for some specific values of INDICATOR and COUNTRY: 1699 1699 1700 - ‘DF2(1.0)/GDPPERCAPITA.USA’ <- expression11; 1701 - 1567 +‘DF2(1.0)/GDPPERCAPITA.USA’ <- expression11; 1702 1702 ‘DF2(1.0)/GDPPERCAPITA.CANADA’ <- expression12; 1703 - 1704 1704 … … … 1570 +‘DF2(1.0)/POPGROWTH.USA’ <- expression21; 1571 +‘DF2(1.0)/POPGROWTH.CANADA’ <- expression22; 1705 1705 1706 - ‘DF2(1.0)/POPGROWTH.USA’ <- expression21; 1707 - 1708 - ‘DF2(1.0)/POPGROWTH.CANADA’ <- expression22; 1709 - 1710 1710 … … … 1711 1711 1575 +As said, it is assumed that these VTL derived datasets have the TIME_PERIOD as the only identifier. In the mapping from VTL to SMDX, the Dimensions INDICATOR and COUNTRY are added to the VTL data structure on order to obtain the SDMX one, with the following values respectively: 1712 1712 1713 - As said, it is assumed that these VTL derived datasets have the TIME_PERIOD as the only identifier.In the mappingfrom VTL to SMDX, theDimensions INDICATOR and COUNTRY are added to the VTL datastructure on order to obtain the SDMX one,withthe following values respectively:1577 +[[image:1747859458410-183.png||height="170" width="663"]] 1714 1714 1715 -|((( 1716 - //VTL dataset // 1579 +It should be noted that the application of this many-to-one mapping from VTL to SDMX is equivalent to an appropriate sequence of VTL Transformations. These use the VTL operator “calc” to add the proper VTL identifiers (in the example, INDICATOR and COUNTRY) and to assign to them the proper values and the operator “union” in order to obtain the final VTL dataset (in the example DF2(1.0)), that can be mapped one-to-one to the homonymous SDMX Dataflow. Following the same example, these VTL transformations would be: 1717 1717 1718 - 1719 -)))|(% colspan="2" %)//INDICATOR value //|(% colspan="2" %)//COUNTRY value// 1720 -|‘DF2(1.0)/GDPPERCAPITA.USA’ |GDPPERCAPITA| | |USA 1721 -|((( 1722 -‘DF2(1.0)/GDPPERCAPITA.CANADA’ 1581 +[[image:1747859612718-454.png||height="451" width="602"]] 1723 1723 1724 -… … … 1725 -)))|GDPPERCAPITA| | |CANADA 1726 -|‘DF2(1.0)/POPGROWTH.USA’ |POPGROWTH | | |USA 1727 -|((( 1728 -‘DF2(1.0)/POPGROWTH.CANADA’ 1583 +In other words, starting from the datasets explicitly calculated through VTL (in the example ‘DF2(1.0)/GDPPERCAPITA.USA’ and so on), the first step consists in calculating other (non-persistent) VTL datasets (in the example DF2bis_GDPPERCAPITA_USA and so on) by adding the identifiers INDICATOR and COUNTRY with the desired values (//INDICATORvalue// and //COUNTRYvalue)//. Finally, all these non-persistent data sets are united and give the final result DF2(1.0)[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[38~]^^>>path:#_ftn38]](%%), which can be mapped one-to-one to the homonymous SDMX dataflow having the dimension components TIME_PERIOD, INDICATOR and COUNTRY. 1729 1729 1730 -… … … 1731 -)))|POPGROWTH | | |CANADA 1585 +Therefore, mapping different VTL datasets having the same data structure to different parts of a SDMX dataflow, i.e. in the direction from VTL to SDMX, through the ordered concatenation notation is equivalent to a proper use of the operators “calc” and “union” on such datasets. [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[39~]^^>>path:#_ftn39]](%%)[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[40~]^^>>path:#_ftn40]] 1732 1732 1733 -It should be noted that the application of this many-to-one mapping from VTL to SDMX is equivalent to an appropriate sequence of VTL Transformations. These use the VTL operator “calc” to add the proper VTL identifiers (in the example, INDICATOR and COUNTRY) and to assign to them the proper values and the operator “union” in order to obtain the final VTL dataset (in the example DF2(1.0)), that can be mapped one-to-one to the homonymous SDMX Dataflow. Following the same example, these VTL transformations would be: 1734 - 1735 -DF2bis_GDPPERCAPITA_USA := ‘DF2(1.0)/GDPPERCAPITA.USA’ 1736 - 1737 -[calc identifier INDICATOR := ”GDPPERCAPITA”, identifier COUNTRY := ”USA”]; 1738 - 1739 -DF2bis_GDPPERCAPITA_CANADA := ‘DF2(1.0)/GDPPERCAPITA.CANADA’ [calc identifier INDICATOR:=”GDPPERCAPITA”, identifier COUNTRY:=”CANADA”]; … … … 1740 - 1741 -DF2bis_POPGROWTH_USA := ‘DF2(1.0)/POPGROWTH.USA’ 1742 - 1743 -[calc identifier INDICATOR := ”POPGROWTH”, identifier COUNTRY :=”USA”]; 1744 - 1745 -DF2bis_POPGROWTH_CANADA’ := ‘DF2(1.0)/POPGROWTH.CANADA’ 1746 - 1747 -[calc identifier INDICATOR := ”POPGROWTH”, identifier COUNTRY := ”CANADA”]; … … … 1748 - 1749 -DF2(1.0) <- UNION (DF2bis_GDPPERCAPITA_USA’, 1750 - 1751 -DF2bis_GDPPERCAPITA_CANADA’, 1752 - 1753 -… , 1754 - 1755 -DF2bis_POPGROWTH_USA’, 1756 - 1757 -DF2bis_POPGROWTH_CANADA’ 1758 - 1759 -…); 1760 - 1761 -In other words, starting from the datasets explicitly calculated through VTL (in the example ‘DF2(1.0)/GDPPERCAPITA.USA’ and so on), the first step consists in calculating other (non-persistent) VTL datasets (in the example DF2bis_GDPPERCAPITA_USA and so on) by adding the identifiers INDICATOR and COUNTRY with the desired values (//INDICATORvalue// and //COUNTRYvalue)//. Finally, all these non-persistent data sets are united and give the final result DF2(1.0)[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[38~]^^>>path:#_ftn38]](%%), which can be mapped one-to-one to the homonymous SDMX dataflow having the dimension components TIME_PERIOD, INDICATOR and COUNTRY. 1762 - 1763 -Therefore, mapping different VTL datasets having the same data structure to different parts of a SDMX dataflow, i.e. in the direction from VTL to SDMX, through the ordered concatenation notation is equivalent to a proper use of the operators “calc” and “union” on such datasets. [[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[39~]^^>>path:#_ftn39]](%%)[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[40~]^^>>path:#_ftn40]] 1764 - 1765 1765 It is worth noting that in the direction from VTL to SDMX it is mandatory to specify the value for every Dimension on which the mapping is based (in other word, in the name of the calculated VTL dataset is not possible to omit the value of some of the Dimensions). 1766 1766 1767 1767 === 10.3.7 Mapping variables and value domains between VTL and SDMX === ... ... @@ -1768,58 +1768,41 @@ 1768 1768 1769 1769 With reference to the VTL “model for Variables and Value domains”, the following additional mappings have to be considered: 1770 1770 1771 -|VTL|SDMX 1772 -|**Data Set Component**|Although this abstraction exists in SDMX, it does not have an explicit definition and correspond to a Component (either a Dimension or a PrimaryMeasure or a DataAttribute) belonging to one specific Dataflow^^42^^ 1773 -|**Represented Variable**|**Concept** with a definite Representation 1774 -|**Value Domain**|**Representation** (see the Structure Pattern in the Base Package) 1775 -|**Enumerated Value Domain / Code List**|((( 1776 -**Codelist** (for enumerated 1777 - 1778 -Dimension, PrimaryMeasure, 1779 - 1780 -DataAttribute) or **ConceptScheme** 1781 - 1782 -(for MeasureDimension) 1593 +(% style="width:890.835px" %) 1594 +|(% style="width:314px" %)VTL|(% style="width:574px" %)SDMX 1595 +|(% style="width:314px" %)**Data Set Component**|(% style="width:574px" %)Although this abstraction exists in SDMX, it does not have an explicit definition and correspond to a Component (either a Dimension or a PrimaryMeasure or a DataAttribute) belonging to one specific Dataflow^^42^^ 1596 +|(% style="width:314px" %)**Represented Variable**|(% style="width:574px" %)**Concept** with a definite Representation 1597 +|(% style="width:314px" %)**Value Domain**|(% style="width:574px" %)**Representation** (see the Structure Pattern in the Base Package) 1598 +|(% style="width:314px" %)**Enumerated Value Domain / Code List**|(% style="width:574px" %)((( 1599 +**Codelist** (for enumerated Dimension, PrimaryMeasure, DataAttribute) or **ConceptScheme **(for MeasureDimension) 1783 1783 ))) 1784 -|**Code**|**Code** (for enumerated Dimension, PrimaryMeasure, DataAttribute) or **Concept** (for MeasureDimension) 1785 -|**Described Value Domain**|((( 1786 -non-enumerated** Representation** 1787 - 1788 -(having Facets / ExtendedFacets, see the Structure Pattern in the Base Package) 1601 +|(% style="width:314px" %)**Code**|(% style="width:574px" %)**Code** (for enumerated Dimension, PrimaryMeasure, DataAttribute) or **Concept** (for MeasureDimension) 1602 +|(% style="width:314px" %)**Described Value Domain**|(% style="width:574px" %)((( 1603 +non-enumerated** Representation **(having Facets / ExtendedFacets, see the Structure Pattern in the Base Package) 1789 1789 ))) 1790 -|**Value**|((( 1791 -Although this abstraction exists in SDMX, it does not have an explicit definition and correspond to a **Code** of a 1792 - 1793 -Codelist (for enumerated 1794 - 1795 -Representations) or to a valid **value **(for non-enumerated** ** 1796 - 1797 -Representations) or to a **Concept** 1798 - 1799 -(for MeasureDimension) 1605 +|(% style="width:314px" %)**Value**|(% style="width:574px" %)((( 1606 +Although this abstraction exists in SDMX, it does not have an explicit definition and correspond to a **Code** of a Codelist (for enumerated Representations) or to a valid **value **(for non-enumerated** **Representations) or to a **Concept **(for MeasureDimension) 1800 1800 ))) 1801 -|**Value Domain Subset / Set**|This abstraction does not exist in SDMX 1802 -|**Enumerated Value Domain Subset / Enumerated Set**|This abstraction does not exist in SDMX 1803 -|**Described Value Domain Subset / Described Set**|This abstraction does not exist in SDMX 1804 -|**Set list**|This abstraction does not exist in SDMX 1608 +|(% style="width:314px" %)**Value Domain Subset / Set**|(% style="width:574px" %)This abstraction does not exist in SDMX 1609 +|(% style="width:314px" %)**Enumerated Value Domain Subset / Enumerated Set**|(% style="width:574px" %)This abstraction does not exist in SDMX 1610 +|(% style="width:314px" %)**Described Value Domain Subset / Described Set**|(% style="width:574px" %)This abstraction does not exist in SDMX 1611 +|(% style="width:314px" %)**Set list**|(% style="width:574px" %)This abstraction does not exist in SDMX 1805 1805 1806 1806 The main difference between VTL and SDMX relies on the fact that the VTL artefacts for defining subsets of Value Domains do not exist in SDMX, therefore the VTL features for referring to predefined subsets are not available in SDMX. These artefacts are the Value Domain Subset (or Set), either enumerated or described, the Set List (list of values belonging to enumerated subsets) and the Data Set Component (aimed at defining the set of values that the Component of a Data Set can take, possibly a subset of the codes of Value Domain). 1807 1807 1808 -Another difference consists in the fact that all Value Domains are considered as identifiable objects in VTL either if enumerated or not, while in SDMX the Codelist (corresponding to a VTL enumerated Value Domain) is identifiable, while the SDMX non-enumerated Representation (corresponding to a VTL non-enumerated Value1615 +Another difference consists in the fact that all Value Domains are considered as identifiable objects in VTL either if enumerated or not, while in SDMX the Codelist (corresponding to a VTL enumerated Value Domain) is identifiable, while the SDMX non-enumerated Representation (corresponding to a VTL non-enumerated Value Domain) is not identifiable. As a consequence, the definition of the VTL rulesets, which in VTL can refer either to enumerated or non-enumerated value domains, in SDMX can refer only to enumerated Value Domains (i.e. to SDMX Codelists). 1809 1809 1810 - Domain)is not identifiable.As a consequence, the definition of theVTLrulesets,which inVTLcan refer either toenumeratedor non-enumeratedvaluedomains, inSDMX canrefer onlytoenumeratedValueDomains(i.e.to SDMX Codelists).1617 +As for the mapping between VTL variables and SDMX Concepts, it should be noted that these artefacts do not coincide perfectly. In fact, the VTL variables are represented variables, defined always on the same Value Domain (“Representation” in SDMX) independently of the data set / data structure in which they appear[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[41~]^^>>path:#_ftn41]](%%), while the SDMX Concepts can have different Representations in different DataStructures.[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[42~]^^>>path:#_ftn42]](%%) This means that one SDMX Concept can correspond to many VTL Variables, one for each representation the Concept has. 1811 1811 1812 - Asforthemapping betweenVTL variables and SDMX Concepts,itshouldbenotedthattheseartefacts donotcoincideperfectly.In fact, theVTL variables arerepresented variables, definedalwaysonthesameValueDomain (“Representation”inSDMX) independentlyofthedataset/ data structure inwhichtheyappear[[(% class="wikiinternallinkwikiinternallinkwikiinternallink wikiinternallinkwikiinternallink" %)^^~[41~]^^>>path:#_ftn41]](%%),while theSDMX Conceptscan havedifferent RepresentationsindifferentDataStructures.[[(%class="wikiinternallinkwikiinternallinkwikiinternallinkwikiinternallinkwikiinternallink"%)^^~[42~]^^>>path:#_ftn42]](%%) Thismeans thatoneSDMX Conceptcan correspondtomany VTL Variables,oneforeachrepresentationthe Concept has.1619 +Therefore, it is important to be aware that some VTL operations (for example the binary operations at data set level) are consistent only if the components having the same names in the operated VTL data sets have also the same representation (i.e. the same Value Domain as for VTL). For example, it is possible to obtain correct results from the VTL expression 1813 1813 1814 - Therefore, it is importanttobe aware that someVTL operations (forexamplethebinaryoperations at data set level) areconsistent only if the components having the same names in the operatedVTLdatasetshave also the same representation (i.e. the same Value Domain as for VTL).For example, it is possible to obtain correct results from the VTL expression1621 +DS_c := DS_a + DS_b (where DS_a, DS_b, DS_c are VTL Data Sets) 1815 1815 1816 - DS_c := DS_a+DS_b(whereDS_a,DS_b,DS_careVTLDataSets)1623 +if the matching components in DS_a and DS_b (e.g. ref_date, geo_area, sector …) refer to the same general representation. In simpler words, DS_a and DS_b must use the same values/codes (for ref_date, geo_area, sector … ), otherwise the relevant values would not match and the result of the operation would be wrong. 1817 1817 1818 -if the matching components in DS_a and DS_b (e.g. ref_date, geo_area, sector …) refer to the same general representation. In simpler words, DS_a and DS_b must use the same values/codes (for ref_date, geo_area, sector … ), otherwise the relevant values would not match and the result of the operation would be wrong. 1819 - 1820 1820 As mentioned, the property above is not enforced by construction in SDMX, and different representations of the same Concept can be not compatible one another (for example, it may happen that geo_area is represented by ISO-alpha-3 codes in DS_a and by ISO alpha-2 codes in DS_b). Therefore, it will be up to the definer of VTL transformations to ensure that the VTL expressions are consistent with the actual representations of the correspondent SDMX Concepts. 1821 1821 1822 -It remains up to the SDMX-VTL definer also the assurance of the consistency between a VTL Ruleset defined on Variables and the SDMX Components on which the Ruleset is applied.In fact, a VTL Ruleset is expressed by means of the values of the Variables (i.e. SDMX Concepts), i.e. assuming definite representations for them (e.g. ISO-alpha-3 for country). If the Ruleset is applied to SDMX Components that have the same name of the Concept they refer to but different representations (e.g. ISO-alpha-2 for country), the Ruleset cannot work properly.1627 +It remains up to the SDMX-VTL definer also the assurance of the consistency between a VTL Ruleset defined on Variables and the SDMX Components on which the Ruleset is applied. In fact, a VTL Ruleset is expressed by means of the values of the Variables (i.e. SDMX Concepts), i.e. assuming definite representations for them (e.g. ISO-alpha-3 for country). If the Ruleset is applied to SDMX Components that have the same name of the Concept they refer to but different representations (e.g. ISO-alpha-2 for country), the Ruleset cannot work properly. 1823 1823 1824 1824 == 10.4 Mapping between SDMX and VTL Data Types == 1825 1825 ... ... @@ -1837,6 +1837,7 @@ 1837 1837 1838 1838 The VTL basic scalar types are listed below and follow a hierarchical structure in terms of supersets/subsets (e.g. “scalar” is the superset of all the basic scalar types): 1839 1839 1645 +[[image:1747859722732-549.png||height="283" width="224"]] 1840 1840 1841 1841 **Figure 13 – VTL Basic Scalar Types** 1842 1842 ... ... @@ -1862,208 +1862,162 @@ 1862 1862 1863 1863 The following table describes the default mapping for converting from the SDMX data types to the VTL basic scalar types. 1864 1864 1865 - |**SDMX data type(BasicComponentDataType)**|**Default VTL basic scalartype**1866 -|((( 1867 - **String**1868 - 1671 +(% style="width:653.835px" %) 1672 +|(% style="width:366px" %)**SDMX data type (BasicComponentDataType)**|(% style="width:284px" %)**Default VTL basic scalar type** 1673 +|(% style="width:366px" %)((( 1674 +**String** 1869 1869 (string allowing any character) 1870 -)))|**string** 1871 -|((( 1872 -**Alpha ** 1873 - 1676 +)))|(% style="width:284px" %)**string** 1677 +|(% style="width:366px" %)((( 1678 +**Alpha** 1874 1874 (string which only allows A-z) 1875 -)))|**string** 1876 -|((( 1877 -**AlphaNumeric ** 1878 - 1680 +)))|(% style="width:284px" %)**string** 1681 +|(% style="width:366px" %)((( 1682 +**AlphaNumeric** 1879 1879 (string which only allows A-z and 0-9) 1880 -)))|**string** 1881 -|((( 1882 -**Numeric ** 1883 - 1684 +)))|(% style="width:284px" %)**string** 1685 +|(% style="width:366px" %)((( 1686 +**Numeric** 1884 1884 (string which only allows 0-9, but is not numeric so that is can having leading zeros) 1885 -)))|**string** 1886 -|((( 1887 -**BigInteger ** 1888 - 1688 +)))|(% style="width:284px" %)**string** 1689 +|(% style="width:366px" %)((( 1690 +**BigInteger** 1889 1889 (corresponds to XML Schema xs:integer datatype; infinite set of integer values) 1890 -)))|**integer** 1891 -|((( 1892 -**Integer ** 1893 - 1894 -(corresponds to XML Schema xs:int datatype; between 1895 - 1896 --2147483648 and +2147483647 (inclusive)) 1897 -)))|**integer** 1898 -|((( 1899 -**Long ** 1900 - 1901 -(corresponds to XML Schema xs:long datatype; 1902 - 1903 -between -9223372036854775808 and +9223372036854775807 (inclusive)) 1904 -)))|**integer** 1905 -|((( 1906 -**Short ** 1907 - 1692 +)))|(% style="width:284px" %)**integer** 1693 +|(% style="width:366px" %)((( 1694 +**Integer** 1695 +(corresponds to XML Schema xs:int datatype; between -2147483648 and +2147483647 (inclusive)) 1696 +)))|(% style="width:284px" %)**integer** 1697 +|(% style="width:366px" %)((( 1698 +**Long** 1699 +(corresponds to XML Schema xs:long datatype; between -9223372036854775808 and +9223372036854775807 (inclusive)) 1700 +)))|(% style="width:284px" %)**integer** 1701 +|(% style="width:366px" %)((( 1702 +**Short** 1908 1908 (corresponds to XML Schema xs:short datatype; between -32768 and -32767 (inclusive)) 1909 -)))|**integer** 1910 -|((( 1704 +)))|(% style="width:284px" %)**integer** 1705 +|(% style="width:366px" %)((( 1911 1911 **Decimal** 1912 - 1913 1913 (corresponds to XML Schema xs:decimal datatype; subset of real numbers that can be represented as decimals) 1914 -)))|**number** 1915 -|((( 1916 -**Float ** 1917 - 1708 +)))|(% style="width:284px" %)**number** 1709 +|(% style="width:366px" %)((( 1710 +**Float** 1918 1918 (corresponds to XML Schema xs:float datatype; patterned after the IEEE single-precision 32-bit floating point type) 1919 -)))|**number** 1920 -|((( 1921 -**Double ** 1922 - 1712 +)))|(% style="width:284px" %)**number** 1713 +|(% style="width:366px" %)((( 1714 +**Double** 1923 1923 (corresponds to XML Schema xs:double datatype; patterned after the IEEE double-precision 64-bit floating point type) 1924 -)))|**number** 1925 -|((( 1926 -**Boolean ** 1927 - 1928 -(corresponds to the XML Schema xs:boolean datatype; support the mathematical concept of binary-valued logic: {true, false}) 1929 -)))|**boolean** 1930 -|((( 1931 -**URI ** 1932 - 1716 +)))|(% style="width:284px" %)**number** 1717 +|(% style="width:366px" %)((( 1718 +**Boolean** 1719 +(corresponds to the XML Schema xs:boolean datatype; support the mathematical concept of binary-valued logic: {true, false}) 1720 +)))|(% style="width:284px" %)**boolean** 1721 +|(% style="width:366px" %)((( 1722 +**URI** 1933 1933 (corresponds to the XML Schema xs:anyURI; absolute or relative Uniform Resource Identifier Reference) 1934 -)))|**string** 1935 -|((( 1936 -**Count ** 1937 - 1724 +)))|(% style="width:284px" %)**string** 1725 +|(% style="width:366px" %)((( 1726 +**Count** 1938 1938 (an integer following a sequential pattern, increasing by 1 for each occurrence) 1939 -)))|**integer** 1940 -|((( 1941 -**InclusiveValueRange ** 1942 - 1728 +)))|(% style="width:284px" %)**integer** 1729 +|(% style="width:366px" %)((( 1730 +**InclusiveValueRange** 1943 1943 (decimal number within a closed interval, whose bounds are specified in the SDMX representation by the facets minValue and maxValue) 1944 -)))|**number** 1945 -|((( 1946 -**ExclusiveValueRange ** 1947 - 1732 +)))|(% style="width:284px" %)**number** 1733 +|(% style="width:366px" %)((( 1734 +**ExclusiveValueRange** 1948 1948 (decimal number within an open interval, whose bounds are specified in the SDMX representation by the facets minValue and maxValue) 1949 -)))|**number** 1950 -|((( 1951 -**Incremental ** 1952 - 1736 +)))|(% style="width:284px" %)**number** 1737 +|(% style="width:366px" %)((( 1738 +**Incremental ** 1953 1953 (decimal number the increased by a specific interval (defined by the interval facet), which is typically enforced outside of the XML validation) 1954 -)))|**number** 1955 -|((( 1956 -**ObservationalTimePeriod ** 1957 - 1740 +)))|(% style="width:284px" %)**number** 1741 +|(% style="width:366px" %)((( 1742 +**ObservationalTimePeriod** 1958 1958 (superset of StandardTimePeriod and TimeRange) 1959 -)))|**time** 1960 -|((( 1961 -**StandardTimePeriod ** 1962 - 1744 +)))|(% style="width:284px" %)**time** 1745 +|(% style="width:366px" %)((( 1746 +**StandardTimePeriod** 1963 1963 (superset of BasicTimePeriod and ReportingTimePeriod) 1964 -)))|**time** 1965 -|((( 1966 -**BasicTimePeriod ** 1967 - 1748 +)))|(% style="width:284px" %)**time** 1749 +|(% style="width:366px" %)((( 1750 +**BasicTimePeriod** 1968 1968 (superset of GregorianTimePeriod and DateTime) 1969 -)))|**date** 1970 -|((( 1971 -**GregorianTimePeriod ** 1972 - 1752 +)))|(% style="width:284px" %)**date** 1753 +|(% style="width:366px" %)((( 1754 +**GregorianTimePeriod** 1973 1973 (superset of GregorianYear, GregorianYearMonth, and GregorianDay) 1974 -)))|**date** 1975 -|**GregorianYear **(YYYY)|**date**1976 -|**GregorianYearMonth** / **GregorianMonth** (YYYY-MM)|**date**1977 -|**GregorianDay **(YYYY-MM-DD)|**date**1978 -|((( 1756 +)))|(% style="width:284px" %)**date** 1757 +|(% style="width:366px" %)**GregorianYear **(YYYY)|(% style="width:284px" %)**date** 1758 +|(% style="width:366px" %)**GregorianYearMonth** / **GregorianMonth** (YYYY-MM)|(% style="width:284px" %)**date** 1759 +|(% style="width:366px" %)**GregorianDay **(YYYY-MM-DD)|(% style="width:284px" %)**date** 1760 +|(% style="width:366px" %)((( 1979 1979 **ReportingTimePeriod ** 1980 - 1981 -(superset of RepostingYear, ReportingSemester, 1982 - 1983 -ReportingTrimester, ReportingQuarter, ReportingMonth, 1984 - 1985 -ReportingWeek, ReportingDay) 1986 -)))|**time_period** 1987 -|((( 1988 -**ReportingYear ** 1989 - 1762 +(superset of RepostingYear, ReportingSemester, ReportingTrimester, ReportingQuarter, ReportingMonth, ReportingWeek, ReportingDay) 1763 +)))|(% style="width:284px" %)**time_period** 1764 +|(% style="width:366px" %)((( 1765 +**ReportingYear** 1990 1990 (YYYY-A1 – 1 year period) 1991 -)))|**time_period** 1992 -|((( 1993 -**ReportingSemester ** 1994 - 1767 +)))|(% style="width:284px" %)**time_period** 1768 +|(% style="width:366px" %)((( 1769 +**ReportingSemester** 1995 1995 (YYYY-Ss – 6 month period) 1996 -)))|**time_period** 1997 -|((( 1998 -**ReportingTrimester ** 1999 - 1771 +)))|(% style="width:284px" %)**time_period** 1772 +|(% style="width:366px" %)((( 1773 +**ReportingTrimester** 2000 2000 (YYYY-Tt – 4 month period) 2001 -)))|**time_period** 2002 -|((( 2003 -**ReportingQuarter ** 2004 - 1775 +)))|(% style="width:284px" %)**time_period** 1776 +|(% style="width:366px" %)((( 1777 +**ReportingQuarter** 2005 2005 (YYYY-Qq – 3 month period) 2006 -)))|**time_period** 2007 -|((( 2008 -**ReportingMonth ** 2009 - 1779 +)))|(% style="width:284px" %)**time_period** 1780 +|(% style="width:366px" %)((( 1781 +**ReportingMonth** 2010 2010 (YYYY-Mmm – 1 month period) 2011 -)))|**time_period** 2012 -|((( 2013 -**ReportingWeek ** 2014 - 1783 +)))|(% style="width:284px" %)**time_period** 1784 +|(% style="width:366px" %)((( 1785 +**ReportingWeek** 2015 2015 (YYYY-Www – 7 day period; following ISO 8601 definition of a week in a year) 2016 -)))|**time_period** 2017 -|((( 2018 -**ReportingDay ** 2019 - 1787 +)))|(% style="width:284px" %)**time_period** 1788 +|(% style="width:366px" %)((( 1789 +**ReportingDay** 2020 2020 (YYYY-Dddd – 1 day period) 2021 -)))|**time_period** 2022 -|((( 2023 -**DateTime ** 2024 - 1791 +)))|(% style="width:284px" %)**time_period** 1792 +|(% style="width:366px" %)((( 1793 +**DateTime** 2025 2025 (YYYY-MM-DDThh:mm:ss) 2026 -)))|**date** 2027 -|((( 2028 -**TimeRange **1795 +)))|(% style="width:284px" %)**date** 1796 +|(% style="width:366px" %)((( 1797 +**TimeRange** 2029 2029 2030 2030 (YYYY-MM-DD(Thh:mm:ss)?/<duration>) 2031 -)))|**time** 2032 -|((( 2033 -**Month ** 2034 - 2035 -(~-~-MM; speicifies a month independent of a year; e.g. 2036 - 2037 -February is black history month in the United States) 2038 -)))|**string** 2039 -|((( 2040 -**MonthDay ** 2041 - 2042 -(~-~-MM-DD; specifies a day within a month independent of a year; e.g. Christmas is December 25^^th^^; used to specify reporting year start day) 2043 -)))|**string** 2044 -|((( 2045 -**Day ** 2046 - 1800 +)))|(% style="width:284px" %)**time** 1801 +|(% style="width:366px" %)((( 1802 +**Month** 1803 +(~-~-MM; speicifies a month independent of a year; e.g. February is black history month in the United States) 1804 +)))|(% style="width:284px" %)**string** 1805 +|(% style="width:366px" %)((( 1806 +**MonthDay** 1807 +(~-~-MM-DD; specifies a day within a month independent of a year; e.g. Christmas is December 25^^th^^; used to specify reporting year start day) 1808 +)))|(% style="width:284px" %)**string** 1809 +|(% style="width:366px" %)((( 1810 +**Day** 2047 2047 (~-~--DD; specifies a day independent of a month or year; e.g. the 15^^th^^ is payday) 2048 -)))|**string** 2049 -|((( 2050 -**Time ** 2051 - 1812 +)))|(% style="width:284px" %)**string** 1813 +|(% style="width:366px" %)((( 1814 +**Time** 2052 2052 (hh:mm:ss; time independent of a date; e.g. coffee break is at 10:00 AM) 2053 -)))|**string** 2054 -|((( 2055 -**Duration ** 2056 - 1816 +)))|(% style="width:284px" %)**string** 1817 +|(% style="width:366px" %)((( 1818 +**Duration** 2057 2057 (corresponds to XML Schema xs:duration datatype) 2058 -)))|**duration** 2059 -|XHTML|Metadata type – not applicable 2060 -|KeyValues|Metadata type – not applicable 2061 -|IdentifiableReference|Metadata type – not applicable 2062 -|DataSetReference|Metadata type – not applicable 2063 -|AttachmentConstraintReference|Metadata type – not applicable 1820 +)))|(% style="width:284px" %)**duration** 1821 +|(% style="width:366px" %)XHTML|(% style="width:284px" %)Metadata type – not applicable 1822 +|(% style="width:366px" %)KeyValues|(% style="width:284px" %)Metadata type – not applicable 1823 +|(% style="width:366px" %)IdentifiableReference|(% style="width:284px" %)Metadata type – not applicable 1824 +|(% style="width:366px" %)DataSetReference|(% style="width:284px" %)Metadata type – not applicable 1825 +|(% style="width:366px" %)AttachmentConstraintReference|(% style="width:284px" %)Metadata type – not applicable 2064 2064 2065 - 2066 - 2067 2067 **Figure 14 – Mappings from SDMX data types to VTL Basic Scalar Types** 2068 2068 2069 2069 When VTL takes in input SDMX artefacts, it is assumed that a type conversion according to the table above always happens. In case a different VTL basic scalar type is desired, it can be achieved in the VTL program taking in input the default VTL basic scalar type above and applying to it the VTL type conversion features (see the implicit and explicit type conversion and the “cast” operator in the VTL Reference Manual). ... ... @@ -2072,89 +2072,84 @@ 2072 2072 2073 2073 The following table describes the default conversion from the VTL basic scalar types to the SDMX data types . 2074 2074 2075 - |**VTLbasic scalartype**|**Default SDMX data type(BasicComponentDataType)**|**Defaultoutput format**2076 -| **String**|**String**|LikeXML(xs:string)2077 -|** Number**|**Float **|Like XML (xs:float)2078 -|** Integer**|**Integer**|Like XML (xs:int)2079 -|** Date**|**DateTime**|YYYY-MM-DDT00:00:00Z2080 -|** Time**|**StandardTimePeriod**|<date>/<date>(asdefinedabove)2081 -|** time_period**|(((2082 - **ReportingTimePeriod**2083 - 2084 - **(StandardReportingPeriod)**2085 -)))|((( 1835 +(% style="width:923.835px" %) 1836 +|(% style="width:191px" %)**VTL basic scalar type**|(% style="width:419px" %)**Default SDMX data type (BasicComponentDataType)**|(% style="width:311px" %)**Default output format** 1837 +|(% style="width:191px" %)**String**|(% style="width:419px" %)**String **|(% style="width:311px" %)Like XML (xs:string) 1838 +|(% style="width:191px" %)**Number**|(% style="width:419px" %)**Float **|(% style="width:311px" %)Like XML (xs:float) 1839 +|(% style="width:191px" %)**Integer**|(% style="width:419px" %)**Integer **|(% style="width:311px" %)Like XML (xs:int) 1840 +|(% style="width:191px" %)**Date**|(% style="width:419px" %)**DateTime**|(% style="width:311px" %)YYYY-MM-DDT00:00:00Z 1841 +|(% style="width:191px" %)**Time**|(% style="width:419px" %)**StandardTimePeriod**|(% style="width:311px" %)<date>/<date> (as defined above) 1842 +|(% style="width:191px" %)**time_period**|(% style="width:419px" %)((( 1843 +**ReportingTimePeriod 1844 +(StandardReportingPeriod)** 1845 +)))|(% style="width:311px" %)((( 2086 2086 YYYY-Pppp 2087 - 2088 2088 (according to SDMX ) 2089 2089 ))) 2090 -|**Duration**|**Duration **|((( 1849 +|(% style="width:191px" %)**Duration**|(% style="width:419px" %)**Duration **|(% style="width:311px" %)((( 2091 2091 Like XML (xs:duration) 2092 - 2093 2093 PnYnMnDTnHnMnS 2094 2094 ))) 2095 -|**Boolean**|**Boolean **|((( 2096 -Like XML (xs:boolean) with the values 2097 - 2098 -“true” or “false” 1853 +|(% style="width:191px" %)**Boolean**|(% style="width:419px" %)**Boolean **|(% style="width:311px" %)((( 1854 +Like XML (xs:boolean) with the values “true” or “false” 2099 2099 ))) 2100 2100 2101 2101 **Figure 14 – Mappings from SDMX data types to VTL Basic Scalar Types** 2102 2102 2103 -In case a different default conversion is desired, it can be achieved through the 1859 +In case a different default conversion is desired, it can be achieved through the CustomTypeScheme and CustomType artefacts (see also the section Transformations and Expressions of the SDMX information model). 2104 2104 2105 -CustomTypeScheme and CustomType artefacts (see also the section Transformations and Expressions of the SDMX information model). 2106 - 2107 2107 The custom output formats can be specified by means of the VTL formatting mask described in the section “Type Conversion and Formatting Mask” of the VTL Reference Manual. Such a section describes the masks for the VTL basic scalar types “number”, “integer”, “date”, “time”, “time_period” and “duration” and gives examples. As for the types “string” and “boolean” the VTL conventions are extended with some other special characters as described in the following table. 2108 2108 2109 -|(% colspan="2" %)**VTL special characters for the formatting masks** 2110 -|(% colspan="2" %)** ** 2111 -|(% colspan="2" %)**Number ** 2112 -|D|one numeric digit (if the scientific notation is adopted, D is only for the mantissa) 2113 -|E|one numeric digit (for the exponent of the scientific notation) 2114 -|. (dot)|possible separator between the integer and the decimal parts. 2115 -|, (comma)|possible separator between the integer and the decimal parts. 2116 -| | 2117 -|(% colspan="2" %)**Time and duration** 2118 -|C |century 2119 -|Y|year 2120 -|S|semester 2121 -|Q|quarter 2122 -|M|month 2123 -|W|week 2124 -|D|day 2125 -|h |hour digit (by default on 24 hours) 2126 -|M|minute 2127 -|S|second 2128 -|D|decimal of second 2129 -|P|period indicator (representation in one digit for the duration) 2130 -|P|number of the periods specified in the period indicator 2131 -|AM/PM |indicator of AM / PM (e.g. am/pm for “am” or “pm”) 2132 -|MONTH|uppercase textual representation of the month (e.g., JANUARY for January) 2133 -|DAY|uppercase textual representation of the day (e.g., MONDAY for Monday) 2134 -|Month|lowercase textual representation of the month (e.g., january) 2135 -|Day|lowercase textual representation of the month (e.g., monday) 2136 -|Month|First character uppercase, then lowercase textual representation of the month (e.g., January) 2137 -|Day|First character uppercase, then lowercase textual representation of the day using (e.g. Monday) 2138 -| | 2139 -|(% colspan="2" %)**String ** 2140 -|X|any string character 2141 -|Z|any string character from “A” to “z” 2142 -|9|any string character from “0” to “9” 2143 -| | 2144 -|(% colspan="2" %)**Boolean ** 2145 -|B|Boolean using “true” for True and “false” for False 2146 -|1|Boolean using “1” for True and “0” for False 2147 -|0|Boolean using “0” for True and “1” for False 2148 -| | 2149 -|(% colspan="2" %)Other qualifiers 2150 -|*|an arbitrary number of digits (of the preceding type) 2151 -|+|at least one digit (of the preceding type) 2152 -|( )|optional digits (specified within the brackets) 2153 -|\|prefix for the special characters that must appear in the mask 2154 -|N|fixed number of digits used in the preceding textual representation of the month or the day 2155 -| | 1863 +(% style="width:671.835px" %) 1864 +|(% colspan="2" style="width:669px" %)**VTL special characters for the formatting masks** 1865 +|(% colspan="2" style="width:669px" %)** ** 1866 +|(% colspan="2" style="width:669px" %)**Number ** 1867 +|(% style="width:141px" %)D|(% style="width:528px" %)one numeric digit (if the scientific notation is adopted, D is only for the mantissa) 1868 +|(% style="width:141px" %)E|(% style="width:528px" %)one numeric digit (for the exponent of the scientific notation) 1869 +|(% style="width:141px" %).(dot)|(% style="width:528px" %)possible separator between the integer and the decimal parts. 1870 +|(% style="width:141px" %),(comma)|(% style="width:528px" %)possible separator between the integer and the decimal parts. 1871 +|(% style="width:141px" %) |(% style="width:528px" %) 1872 +|(% colspan="2" style="width:669px" %)**Time and duration** 1873 +|(% style="width:141px" %)C |(% style="width:528px" %)century 1874 +|(% style="width:141px" %)Y|(% style="width:528px" %)year 1875 +|(% style="width:141px" %)S|(% style="width:528px" %)semester 1876 +|(% style="width:141px" %)Q|(% style="width:528px" %)quarter 1877 +|(% style="width:141px" %)M|(% style="width:528px" %)month 1878 +|(% style="width:141px" %)W|(% style="width:528px" %)week 1879 +|(% style="width:141px" %)D|(% style="width:528px" %)day 1880 +|(% style="width:141px" %)h |(% style="width:528px" %)hour digit (by default on 24 hours) 1881 +|(% style="width:141px" %)M|(% style="width:528px" %)minute 1882 +|(% style="width:141px" %)S|(% style="width:528px" %)second 1883 +|(% style="width:141px" %)D|(% style="width:528px" %)decimal of second 1884 +|(% style="width:141px" %)P|(% style="width:528px" %)period indicator (representation in one digit for the duration) 1885 +|(% style="width:141px" %)P|(% style="width:528px" %)number of the periods specified in the period indicator 1886 +|(% style="width:141px" %)AM/PM |(% style="width:528px" %)indicator of AM / PM (e.g. am/pm for “am” or “pm”) 1887 +|(% style="width:141px" %)MONTH|(% style="width:528px" %)uppercase textual representation of the month (e.g., JANUARY for January) 1888 +|(% style="width:141px" %)DAY|(% style="width:528px" %)uppercase textual representation of the day (e.g., MONDAY for Monday) 1889 +|(% style="width:141px" %)Month|(% style="width:528px" %)lowercase textual representation of the month (e.g., january) 1890 +|(% style="width:141px" %)Day|(% style="width:528px" %)lowercase textual representation of the month (e.g., monday) 1891 +|(% style="width:141px" %)Month|(% style="width:528px" %)First character uppercase, then lowercase textual representation of the month (e.g., January) 1892 +|(% style="width:141px" %)Day|(% style="width:528px" %)First character uppercase, then lowercase textual representation of the day using (e.g. Monday) 1893 +|(% style="width:141px" %) |(% style="width:528px" %) 1894 +|(% colspan="2" style="width:669px" %)**String** 1895 +|(% style="width:141px" %)X|(% style="width:528px" %)any string character 1896 +|(% style="width:141px" %)Z|(% style="width:528px" %)any string character from “A” to “z” 1897 +|(% style="width:141px" %)9|(% style="width:528px" %)any string character from “0” to “9” 1898 +|(% style="width:141px" %) |(% style="width:528px" %) 1899 +|(% colspan="2" style="width:669px" %)**Boolean ** 1900 +|(% style="width:141px" %)B|(% style="width:528px" %)Boolean using “true” for True and “false” for False 1901 +|(% style="width:141px" %)1|(% style="width:528px" %)Boolean using “1” for True and “0” for False 1902 +|(% style="width:141px" %)0|(% style="width:528px" %)Boolean using “0” for True and “1” for False 1903 +|(% style="width:141px" %) |(% style="width:528px" %) 1904 +|(% colspan="2" style="width:669px" %)Other qualifiers 1905 +|(% style="width:141px" %)*|(% style="width:528px" %)an arbitrary number of digits (of the preceding type) 1906 +|(% style="width:141px" %)+|(% style="width:528px" %)at least one digit (of the preceding type) 1907 +|(% style="width:141px" %)( )|(% style="width:528px" %)optional digits (specified within the brackets) 1908 +|(% style="width:141px" %)\|(% style="width:528px" %)prefix for the special characters that must appear in the mask 1909 +|(% style="width:141px" %)N|(% style="width:528px" %)fixed number of digits used in the preceding textual representation of the month or the day 1910 +|(% style="width:141px" %) |(% style="width:528px" %) 2156 2156 2157 -The default conversion, either standard or customized, can be used to deduce automatically the representation of the components of the result of a VTL transformation. In alternative, the representation of the resulting SDMX Dataflow can be given explicitly by providing its DataStructureDefinition. In other words, the representation specified in the DSD, if available, overrides any default conversion[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[43~]^^>>path:#_ftn43]](%%). 1912 +The default conversion, either standard or customized, can be used to deduce automatically the representation of the components of the result of a VTL transformation. In alternative, the representation of the resulting SDMX Dataflow can be given explicitly by providing its DataStructureDefinition. In other words, the representation specified in the DSD, if available, overrides any default conversion[[(% class="wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink wikiinternallink" %)^^~[43~]^^>>path:#_ftn43]](%%). 2158 2158 2159 2159 === 10.4.5 Null Values === 2160 2160 ... ... @@ -2162,22 +2162,20 @@ 2162 2162 2163 2163 On the other side, the VTL programs can produce in output NULL values for Measures and Attributes (Null values are not allowed in the Identifiers). In the conversion from VTL to SDMX, it is assumed that a NULL in VTL becomes a missing value in SDMX. 2164 2164 2165 -In the conversion from VTL to SDMX, the default assumption can be overridden, separately for each VTL basic scalar type, by specifying which the value that represents the NULL in SDMX is. This can be specified in the attribute “nullValue” of the CustomType artefact (see also the section Transformations and Expressions of the SDMX information model). A CustomType belongs to a CustomTypeScheme, which can be referenced by one or more TransformationScheme (i.e. VTL programs). The overriding assumption is applied for all the SDMX Dataflows calculated in the TransformationScheme.1920 +In the conversion from VTL to SDMX, the default assumption can be overridden, separately for each VTL basic scalar type, by specifying which the value that represents the NULL in SDMX is. This can be specified in the attribute “nullValue” of the CustomType artefact (see also the section Transformations and Expressions of the SDMX information model). A CustomType belongs to a CustomTypeScheme, which can be referenced by one or more TransformationScheme (i.e. VTL programs). The overriding assumption is applied for all the SDMX Dataflows calculated in the TransformationScheme. 2166 2166 2167 2167 === 10.4.6 Format of the literals used in VTL transformations === 2168 2168 2169 2169 The VTL programs can contain literals, i.e. specific values of certain data types written directly in the VTL definitions or expressions. The VTL does not prescribe a specific format for the literals and leave the specific VTL systems and the definers of VTL transformations free of using their preferred formats. 2170 2170 2171 -Given this discretion, it is essential to know which are the external representations adopted for the literals in a VTL program, in order to interpret them correctly. For example, if the external format for the dates is YYYY-MM-DD the date literal 201001-02 has the meaning of 2^^nd^^ January 2010, instead if the external format for the dates is YYYY-DD-MM the same literal has the meaning of 1^^st^^ February 2010.1926 +Given this discretion, it is essential to know which are the external representations adopted for the literals in a VTL program, in order to interpret them correctly. For example, if the external format for the dates is YYYY-MM-DD the date literal 201001-02 has the meaning of 2^^nd^^ January 2010, instead if the external format for the dates is YYYY-DD-MM the same literal has the meaning of 1^^st^^ February 2010. 2172 2172 2173 2173 Hereinafter, i.e. in the SDMX implementation of the VTL, it is assumed that the literals are expressed according to the “default output format” of the table of the previous paragraph (“Mapping VTL basic scalar types to SDMX data types”) unless otherwise specified. 2174 2174 2175 2175 A different format can be specified in the attribute “vtlLiteralFormat” of the CustomType artefact (see also the section Transformations and Expressions of the SDMX information model). 2176 2176 2177 -Like in the case of the conversion of NULLs described in the previous paragraph, the overriding assumption is applied, for a certain VTL basic scalar type, if a value is found for the vtlLiteralFormat attribute of the CustomType of such VTL basic scalar type. The overriding assumption is applied for all the literals of a related VTL 1932 +Like in the case of the conversion of NULLs described in the previous paragraph, the overriding assumption is applied, for a certain VTL basic scalar type, if a value is found for the vtlLiteralFormat attribute of the CustomType of such VTL basic scalar type. The overriding assumption is applied for all the literals of a related VTL TransformationScheme. 2178 2178 2179 -TransformationScheme. 2180 - 2181 2181 In case a literal is operand of a VTL Cast operation, the format specified in the Cast overrides all the possible otherwise specified formats. 2182 2182 2183 2183 = 11 Annex I: How to eliminate extra element in the .NET SDMX Web Service = ... ... @@ -2186,12 +2186,18 @@ 2186 2186 2187 2187 For implementing an SDMX compliant Web Service the standardised WSDL file should be used that describes the expected request/response structure. The request message of the operation contains a wrapper element (e.g. “GetGenericData”) that wraps a tag called “GenericDataQuery”, which is the actual SDMX query XML message that contains the query to be processed by the Web Service. In the same way the response is formulated in a wrapper element “GetGenericDataResponse”. 2188 2188 2189 -As defined in the SOAP specification, the root element of a SOAP message is the Envelope, which contains an optional Header and a mandatory Body. These are illustrated below along with the Body contents according to the WSDL: 1942 +As defined in the SOAP specification, the root element of a SOAP message is the Envelope, which contains an optional Header and a mandatory Body. These are illustrated below along with the Body contents according to the WSDL: 2190 2190 1944 +[[image:1747854006117-843.png]] 1945 + 2191 2191 The problem that initiated the present analysis refers to the difference in the way SOAP requests are when trying to implement the aforementioned Web Service in .NET framework. 2192 2192 2193 2193 Building such a Web Service using the .NET framework is done by exposing a method (i.e. the getGenericData in the example) with an XML document argument (lets name it “Query”). **The difference that appears in Microsoft .Net implementations is that there is a need for an extra XML container around the SDMX GenericDataQuery.** This is the expected behavior since the framework is let to publish automatically the Web Service as a remote procedure call, thus wraps each parameter into an extra element. The .NET request is illustrated below: 2194 2194 1950 +[[image:1747854039499-443.png]] 1951 + 1952 +[[image:1747854067769-691.png]] 1953 + 2195 2195 Furthermore this extra element is also inserted in the automatically generated WSDL from the framework. Therefore this particularity requires custom clients for the .NET Web Services that is not an interoperable solution. 2196 2196 2197 2197 == 11.2 Solution == ... ... @@ -2212,20 +2212,30 @@ 2212 2212 2213 2213 To understand how the **XmlAnyElement** attribute works we present the following two web methods: 2214 2214 2215 - In thismethod the **input** parameter is decorated with the **XmlAnyElement** parameter. This is a hint that this parameter will be de-serialized from an **xsd:any** element.Since the attribute is notpassed any parameters, it means that the entire XML element for this parameter in the SOAP message will be in the Infoset that is represented by this **XmlElement** parameter.1974 +[[image:1747854096778-844.png]] 2216 2216 2217 - Thedifferencebetween the two is that for thefirst method,**SubmitXml**,the1976 +In this method the **input** parameter is decorated with the **XmlAnyElement** parameter. This is a hint that this parameter will be de-serialized from an **xsd:any** element. Since the attribute is not passed any parameters, it means that the entire XML element for this parameter in the SOAP message will be in the Infoset that is represented by this **XmlElement** parameter. 2218 2218 2219 - XmlSerializer will expect an element named **input** to be an immediate child of the **SubmitXml** element in the SOAP body. The second method, **SubmitXmlAny**, will not care what the name of the child of the **SubmitXmlAny** element is. It will plugwhatever XML is included into the input parameter.The message style from ASP.NET Helpfor the two methods is shownbelow. First we look at the message for the method without the **XmlAnyElement** attribute.1978 +[[image:1747854127303-270.png]] 2220 2220 1980 +The difference between the two is that for the first method, **SubmitXml**, the XmlSerializer will expect an element named **input** to be an immediate child of the **SubmitXml** element in the SOAP body. The second method, **SubmitXmlAny**, will not care what the name of the child of the **SubmitXmlAny** element is. It will plug whatever XML is included into the input parameter. The message style from ASP.NET Help for the two methods is shown below. First we look at the message for the method without the **XmlAnyElement** attribute. 1981 + 1982 +[[image:1747854163928-581.png]] 1983 + 2221 2221 Now we look at the message for the method that uses the **XmlAnyElement** attribute. 2222 2222 1986 +[[image:1747854190641-364.png]] 1987 + 1988 +[[image:1747854236732-512.png]] 1989 + 2223 2223 The method decorated with the **XmlAnyElement** attribute has one fewer wrapping elements. Only an element with the name of the method wraps what is passed to the **input** parameter. 2224 2224 2225 -For more information please consult: [[http:~~/~~/msdn.microsoft.com/en>>url:http://msdn.microsoft.com/en-us/library/aa480498.aspx]][[->>url:http://msdn.microsoft.com/en-us/library/aa480498.aspx]][[us/library/aa480498.aspx>>url:http://msdn.microsoft.com/en-us/library/aa480498.aspx]][[url:http://msdn.microsoft.com/en-us/library/aa480498.aspx]]1992 +For more information please consult: [[http:~~/~~/msdn.microsoft.com/en-us/library/aa480498.aspx>>http://msdn.microsoft.com/en-us/library/aa480498.aspx]] 2226 2226 2227 2227 Furthermore at this point the problem with the different requests has been solved. However there is still the difference in the produced WSDL that has to be taken care. The automatic generated WSDL now doesn’t insert the extra element, but defines the content of the operation wrapper element as “xsd:any” type. 2228 2228 1996 +[[image:1747854286398-614.png]] 1997 + 2229 2229 Without a common WSDL still the solution doesn’t enforce interoperability. In order to 2230 2230 2231 2231 “fix” the WSDL, there two approaches. The first is to intervene in the generation process. This is a complicated approach, compared to the second approach, which overrides the generation process and returns the envisioned WSDL for the SDMX Web Service. ... ... @@ -2238,16 +2238,27 @@ 2238 2238 2239 2239 In the context of the SDMX Web Service, applying the above solution translates into the following: 2240 2240 2010 +[[image:1747854385465-132.png]] 2011 + 2241 2241 The SOAP request/response will then be as follows: 2242 2242 2243 2243 **GenericData Request** 2244 2244 2016 +[[image:1747854406014-782.png]] 2017 + 2245 2245 **GenericData Response** 2246 2246 2020 +[[image:1747854424488-855.png]] 2021 + 2247 2247 For overriding the automatically produced WSDL, in the solution explorer right click the project and select “Add” -> “New item…”. Then select the “Global Application Class”. This will create “.asax” class file in which the following code should replace the existing empty method: 2248 2248 2024 +[[image:1747854453895-524.png]] 2025 + 2026 +[[image:1747854476631-125.png]] 2027 + 2249 2249 The SDMX_WSDL.wsdl should reside in the in the root directory of the application. After applying this solution the returned WSDL is the envisioned. Thus in the request message definition contains: 2250 2250 2030 +[[image:1747854493363-776.png]] 2251 2251 2252 2252 ---- 2253 2253 ... ... @@ -2275,15 +2275,15 @@ 2275 2275 2276 2276 [[~[12~]>>path:#_ftnref12]] In case the invoked artefact is a VTL component, which can be invoked only within the invocation of a 2277 2277 2278 -VTL data set (SDMX dataflow), the specific SDMX class-name (e.g. Dimension, MeasureDimension, TimeDimension, PrimaryMeasure or DataAttribute) can be deduced from the data structure of the SDMX Dataflow which the component belongs to. 2058 +VTL data set (SDMX dataflow), the specific SDMX class-name (e.g. Dimension, MeasureDimension, TimeDimension, PrimaryMeasure or DataAttribute) can be deduced from the data structure of the SDMX Dataflow which the component belongs to. 2279 2279 2280 -[[~[13~]>>path:#_ftnref13]] If the Agency is composite (for example AgencyA.Dept1.Unit2), the agency is considered different even if only part of the composite name is different (for example AgencyA.Dept1.Unit3 is a different Agency than the previous one). Moreover the agency-id cannot be omitted in part (i.e., if a TransformationScheme owned by AgencyA.Dept1.Unit2 references an artefact coming from AgencyA.Dept1.Unit3, the specification of the agency-id becomes mandatory and must be complete, without omitting the possibly equal parts like AgencyA.Dept1)2060 +[[~[13~]>>path:#_ftnref13]] If the Agency is composite (for example AgencyA.Dept1.Unit2), the agency is considered different even if only part of the composite name is different (for example AgencyA.Dept1.Unit3 is a different Agency than the previous one). Moreover the agency-id cannot be omitted in part (i.e., if a TransformationScheme owned by AgencyA.Dept1.Unit2 references an artefact coming from AgencyA.Dept1.Unit3, the specification of the agency-id becomes mandatory and must be complete, without omitting the possibly equal parts like AgencyA.Dept1) 2281 2281 2282 2282 [[~[14~]>>path:#_ftnref14]] Single quotes are needed because this reference is not a VTL regular name. 2283 2283 2284 2284 [[~[15~]>>path:#_ftnref15]] Single quotes are not needed in this case because CL_FREQ is a VTL regular name. 2285 2285 2286 -[[~[16~]>>path:#_ftnref16]] The result DFR(1.0) is be equal to DF1(1.0) save that the component SECTOR is called SEC2066 +[[~[16~]>>path:#_ftnref16]] The result DFR(1.0) is be equal to DF1(1.0) save that the component SECTOR is called SEC 2287 2287 2288 2288 [[~[17~]>>path:#_ftnref17]] Rulesets of this kind cannot be reused when the referenced Concept has a different representation. 2289 2289 ... ... @@ -2299,7 +2299,7 @@ 2299 2299 2300 2300 [[~[23~]>>path:#_ftnref23]] The SDMX community is evaluating the opportunity of allowing more than one measure component in a DataStructureDefinition in the next SDMX major version. 2301 2301 2302 -[[~[24~]>>path:#_ftnref24]] If future SDMX major versions will allow multi-measures data structures, this method is expected to become applicable even if the VTL data structure has more than one measure2082 +[[~[24~]>>path:#_ftnref24]] If future SDMX major versions will allow multi-measures data structures, this method is expected to become applicable even if the VTL data structure has more than one measure 2303 2303 2304 2304 [[~[25~]>>path:#_ftnref25]] The kind of mapping explained here works in combination with a SDMX specific naming convention that requires pre-processing before parsing the VTL expressions. As highlighted below, the identifiers of the VTL datasets are a shortcut of some specific VTL operators applied to the SDMX Dataflows. This is not safe to use outside an SDMX context, as the naming convention may have no meaning there. 2305 2305 ... ... @@ -2307,7 +2307,7 @@ 2307 2307 2308 2308 [[~[27~]>>path:#_ftnref27]] Please note that this kind of mapping is only an option at disposal of the definer of VTL Transformations; in fact it remains always possible to manipulate the needed parts of SDMX Dataflows by means of VTL operators (e.g. “sub”, “filter”, “calc”, “union” …), maintaining a mapping one-to-one between SDMX Dataflows and VTL datasets. 2309 2309 2310 -[[~[28~]>>path:#_ftnref28]] This definition is made through the ToVtlSubspace and ToVtlSpaceKey classes and/or the FromVtlSuperspace and FromVtlSpaceKey classes, depending on the direction of the mapping (“key” means “dimension”). The mapping of Dataflow subsets can be applied independently in the two directions, also according to different Dimensions.When no Dimension is declared for a given direction, it is assumed that the option of mapping different parts of a SDMX Dataflow to different VTL datasets is not used.2090 +[[~[28~]>>path:#_ftnref28]] This definition is made through the ToVtlSubspace and ToVtlSpaceKey classes and/or the FromVtlSuperspace and FromVtlSpaceKey classes, depending on the direction of the mapping (“key” means “dimension”). The mapping of Dataflow subsets can be applied independently in the two directions, also according to different Dimensions. When no Dimension is declared for a given direction, it is assumed that the option of mapping different parts of a SDMX Dataflow to different VTL datasets is not used. 2311 2311 2312 2312 [[~[29~]>>path:#_ftnref29]] As a consequence of this formalism, a slash in the name of the VTL dataset assumes the specific meaning of separator between the name of the Dataflow and the values of some of its Dimensions. 2313 2313 ... ... @@ -2315,13 +2315,13 @@ 2315 2315 2316 2316 [[~[31~]>>path:#_ftnref31]] It should be remembered that, according to the VTL consistency rules, a given VTL dataset cannot be the result of more than one VTL transformation. 2317 2317 2318 -[[~[32~]>>path:#_ftnref32]] If these dimensions would not be dropped, taking into account that the typical binary VTL operations at dataset level (+, -, *, / and so on) are executed on the observations having matching identifiers, the VTL datasets resulting from this kind of mapping would have non-matching values for the mapping dimensions (e.g. POPULATION and COUNTRY), therefore it would not be possible to compose the resulting VTL datasets one another (e.g. it would not be possible to calculate the population ratio between USA and CANADA). ^^ ^^2098 +[[~[32~]>>path:#_ftnref32]] If these dimensions would not be dropped, taking into account that the typical binary VTL operations at dataset level (+, -, *, / and so on) are executed on the observations having matching identifiers, the VTL datasets resulting from this kind of mapping would have non-matching values for the mapping dimensions (e.g. POPULATION and COUNTRY), therefore it would not be possible to compose the resulting VTL datasets one another (e.g. it would not be possible to calculate the population ratio between USA and CANADA). ^^ ^^ 2319 2319 2320 -[[~[33~]>>path:#_ftnref33]] In case the ordered concatenation notation is used, the VTL Transformation described above, e.g.2100 +[[~[33~]>>path:#_ftnref33]] In case the ordered concatenation notation is used, the VTL Transformation described above, e.g. 2321 2321 2322 -‘DF1(1.0)/POPULATION.USA’ := DF1(1.0) [ subINDICATOR=“POPULATION”, COUNTRY=“USA”], is implicitly executed and, in order to test the overall compliance of the VTL program to the VTL consistency rules, it has to be considered as part of the VTL program even if it is not explicitly coded.2102 +‘DF1(1.0)/POPULATION.USA’ := DF1(1.0) [ sub INDICATOR=“POPULATION”, COUNTRY=“USA”], is implicitly executed and, in order to test the overall compliance of the VTL program to the VTL consistency rules, it has to be considered as part of the VTL program even if it is not explicitly coded. 2323 2323 2324 -[[~[34~]>>path:#_ftnref34]] If the whole DF2(1.0) is calculated by means of just one VTL transformation, then the mapping between the SDMX dataflow and the corresponding VTL dataset is one-to-one and this kind of mapping (one SDMX Dataflow to many VTL datasets) does not apply..2104 +[[~[34~]>>path:#_ftnref34]] If the whole DF2(1.0) is calculated by means of just one VTL transformation, then the mapping between the SDMX dataflow and the corresponding VTL dataset is one-to-one and this kind of mapping (one SDMX Dataflow to many VTL datasets) does not apply.. 2325 2325 2326 2326 [[~[35~]>>path:#_ftnref35]] This is possible as each VTL dataset corresponds to one particular combination of values of INDICATOR and COUNTRY 2327 2327 ... ... @@ -2340,3 +2340,5 @@ 2340 2340 [[~[42~]>>path:#_ftnref42]] A Concept becomes a Component in a DataStructureDefinition, and Components can have different LocalRepresentations in different DataStructureDefinitions, also overriding the (possible) base representation of the Concept. 2341 2341 2342 2342 [[~[43~]>>path:#_ftnref43]] The representation given in the DSD should obviously be compatible with the VTL data type. 2123 + 2124 +{{putFootnotes/}}
- 1747854006117-843.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +18.7 KB - Content
- 1747854039499-443.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +3.0 KB - Content
- 1747854067769-691.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +21.4 KB - Content
- 1747854096778-844.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +10.6 KB - Content
- 1747854127303-270.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +12.1 KB - Content
- 1747854163928-581.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +29.8 KB - Content
- 1747854190641-364.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +31.5 KB - Content
- 1747854236732-512.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +2.0 KB - Content
- 1747854286398-614.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747854385465-132.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747854406014-782.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747854424488-855.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747854453895-524.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747854476631-125.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747854493363-776.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747855024745-946.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747855054559-410.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747855075263-887.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747855402867-579.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747855462293-368.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747855493531-357.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747856459132-767.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747859398930-848.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747859458410-183.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747859612718-454.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +55.0 KB - Content
- 1747859722732-549.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +xwiki:XWiki.helena - Size
-
... ... @@ -1,0 +1,1 @@ 1 +18.8 KB - Content