Changes for page Part VI. Samples
Last modified by Helena K. on 2026/06/09 17:26
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -19,14 +19,14 @@ 19 19 == Codelist == 20 20 21 21 (% class="wikigeneratedid" id="Hcodelist.xml" %) 22 -** [[codelist>>doc:sdmx:Glossary 2\.1.Code list.WebHome]].xml**22 +**codelist.xml** 23 23 24 -A simple enumerated [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]] directly equivalent to those in (% style="color:#e74c3c" %)version(%%)2.1 and earlier.24 +A simple enumerated [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]] directly equivalent to those in version 2.1 and earlier. 25 25 26 26 This example shows the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]:CL_AGE '[[Age>>doc:sdmx:Glossary 2\.1.Age.WebHome]]' cross domain [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]]. 27 27 28 28 (% class="wikigeneratedid" id="Hcodelist-extended.xml" %) 29 -** [[codelist>>doc:sdmx:Glossary2\.1.Code list.WebHome]]- extended.xml**29 +**codelist - extended.xml** 30 30 31 31 Extended [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]]. 32 32 ... ... @@ -42,7 +42,7 @@ 42 42 In addition, the ExclusiveCodeSelection option to exclude the "Y" [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] from the CL_AGE [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]]. The result is CL_AGE, minus "Y", plus "I" and "S". The InclusiveCodeSelection option could have been used if a specific set of [[codes>>doc:sdmx:Glossary 2\.1.Code.WebHome]] were needed from CL_AGE. 43 43 44 44 (% class="wikigeneratedid" id="Hcodelist-discriminatedunion.xml" %) 45 -** [[codelist>>doc:sdmx:Glossary2\.1.Code list.WebHome]]- discriminated union.xml**45 +**codelist - discriminated union.xml** 46 46 47 47 Discriminated union of [[code lists>>doc:sdmx:Glossary 2\.1.Code list.WebHome]]. 48 48 ... ... @@ -55,9 +55,9 @@ 55 55 * [[Code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]] extension is used to create a new EXAMPLE:CL_ACTIVITY [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]] consisting of both the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]:CL_ACTIVITY_NACE2 and [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]]:CL_ACTIVITY_ISIC4 [[codelists>>doc:sdmx:Glossary 2\.1.Code list.WebHome]]. 56 56 * The [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]] extension prefix feature has been used to prefix the NACE [[codes>>doc:sdmx:Glossary 2\.1.Code.WebHome]] with "NACE2_", and similarly the ISIC [[codes>>doc:sdmx:Glossary 2\.1.Code.WebHome]] with "ISIC4_". This ensures there is no ambiguity where the same [[code>>doc:sdmx:Glossary 2\.1.Code.WebHome]] appear in both NACE and ISIC [[code lists>>doc:sdmx:Glossary 2\.1.Code list.WebHome]]. 57 57 * A [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] has been created with an enumerated ACTIVITY [[dimension>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]] using the EXAMPLE:CL_ACTIVITY [[code list>>doc:sdmx:Glossary 2\.1.Code list.WebHome]]. 58 -* Two [[data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] are created referencing the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]. One [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] has a data (%style="color:#e74c3c"%)constraint(%%)attached with a CubeRegion for ACTIVITY and Value = "NACE2_%". The other has a similar data(%style="color:#e74c3c"%)constraint(%%)with Value = "ISIC4_%". The "%" is the wildcard character for(%style="color:#e74c3c"%)constraints(%%)introduced in(% style="color:#e74c3c"%)version(%%)3.0.58 +* Two [[data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] are created referencing the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]. One [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] has a data [[constraint>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] attached with a CubeRegion for ACTIVITY and Value = "NACE2_%". The other has a similar data [[constraint>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] with Value = "ISIC4_%". The "%" is the wildcard character for [[constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] introduced in [[version>>doc:sdmx:Glossary 2\.1.Version.WebHome]] 3.0. 59 59 60 -The discriminated unions are achieved by requesting either of the [[data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] with references="all" and detail="referencepartial". The result being CL_ACTIVITY with the extensions resolved and the relevant data (%style="color:#e74c3c"%)constraint(%%)applied. Thus CL_ACTIVITY will only contain [[codes>>doc:sdmx:Glossary 2\.1.Code.WebHome]] prefixed according to the [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]: either beginning "NACE2_" or "ISIC4_"60 +The discriminated unions are achieved by requesting either of the [[data flows>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] with references="all" and detail="referencepartial". The result being CL_ACTIVITY with the extensions resolved and the relevant data [[constraint>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] applied. Thus CL_ACTIVITY will only contain [[codes>>doc:sdmx:Glossary 2\.1.Code.WebHome]] prefixed according to the [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]: either beginning "NACE2_" or "ISIC4_" 61 61 62 62 (% class="wikigeneratedid" id="Hvaluelist.xml" %) 63 63 **valuelist.xml** ... ... @@ -64,7 +64,7 @@ 64 64 65 65 A simple enumerated value list. 66 66 67 -Value lists were introduced in (% style="color:#e74c3c" %)version(%%)3.0 to allow the definition of enumerations where the [[codes>>doc:sdmx:Glossary 2\.1.Code.WebHome]] do not need to comply with the strict [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] rules for identifiers. Thus a "value" can be any string of characters.67 +Value lists were introduced in version 3.0 to allow the definition of enumerations where the [[codes>>doc:sdmx:Glossary 2\.1.Code.WebHome]] do not need to comply with the strict [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] rules for identifiers. Thus a "value" can be any string of characters. 68 68 69 69 In [[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] valuelists are treated as a class of enumeration so appear in the structure message under [[Codelists>>doc:sdmx:Glossary 2\.1.Code list.WebHome]] alongside simple and extended [[codelists>>doc:sdmx:Glossary 2\.1.Code list.WebHome]], and specialised geospatial [[codelist>>doc:sdmx:Glossary 2\.1.Code list.WebHome]] variants. 70 70 ... ... @@ -75,17 +75,17 @@ 75 75 (% class="wikigeneratedid" id="Hconceptscheme.xml" %) 76 76 **conceptscheme.xml** 77 77 78 -The example illustrates a single [[concept scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] ECB:ECB_CONCEPTS containing multiple individual (% style="color:#e74c3c" %)concepts(%%).78 +The example illustrates a single [[concept scheme>>doc:sdmx:Glossary 2\.1.Concept scheme.WebHome]] ECB:ECB_CONCEPTS containing multiple individual concepts. 79 79 80 80 == Data Structure Definition == 81 81 82 82 **ECB EXR.xml** 83 83 84 -The example illustrates a [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] ([[DSD>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]) for ECB:EXR exchange rates. The (% style="color:#e74c3c"%)concept(%%)of primary [[measure>>doc:sdmx:Glossary 2\.1.Measure.WebHome]] has been deprecated in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0 and the [[DSD>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]'s MeasureList can contain multiple [[measures>>doc:sdmx:Glossary 2\.1.Measure.WebHome]]. In this case, a single [[measure>>doc:sdmx:Glossary 2\.1.Measure.WebHome]] OBS_VALUE is defined.84 +The example illustrates a [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] ([[DSD>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]) for ECB:EXR exchange rates. The [[concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] of primary [[measure>>doc:sdmx:Glossary 2\.1.Measure.WebHome]] has been deprecated in [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] 3.0 and the [[DSD>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]]'s MeasureList can contain multiple [[measures>>doc:sdmx:Glossary 2\.1.Measure.WebHome]]. In this case, a single [[measure>>doc:sdmx:Glossary 2\.1.Measure.WebHome]] OBS_VALUE is defined. 85 85 86 86 == Dataflow == 87 87 88 -** [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]].xml**88 +**dataflow.xml** 89 89 90 90 A simple [[data flow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] for the ECB:EXR [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]. 91 91 ... ... @@ -98,7 +98,7 @@ 98 98 In the sample: 99 99 100 100 * A simple illustrative [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] has been defined with IDENTIFIER and TIME_PERIOD [[dimensions>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]], plus a [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] [[attribute>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] AREA. 101 -* The AREA [[attribute>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] has the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] (% style="color:#e74c3c"%)Concept(%%)Role "GEO" defined identifying it generally as a geospatial [[component>>doc:sdmx:Glossary 2\.1.Component.WebHome]] following guidelines.101 +* The AREA [[attribute>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] has the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[Concept>>doc:sdmx:Glossary 2\.1.Concept.WebHome]] Role "GEO" defined identifying it generally as a geospatial [[component>>doc:sdmx:Glossary 2\.1.Component.WebHome]] following guidelines. 102 102 * The AREA [[attribute>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] also carries a LocalRepresentation with textType="GeospatialInformation". 103 103 104 104 **geospatial geographiccodelist.xml** ... ... @@ -126,30 +126,30 @@ 126 126 127 127 == VTL Transformations == 128 128 129 -** [[VTL>>doc:sdmx:Glossary2\.1.Validation and transformation language.WebHome]]Sample 1.xml**129 +**VTL Sample 1.xml** 130 130 131 131 Illustrates the use of [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] Rulesets to validate an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]. The validation process adds additional identifiers and [[measures>>doc:sdmx:Glossary 2\.1.Measure.WebHome]] to the resulting [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] [[dataset>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] indicating, on a row by row basis the validation rule applied and the outcome in terms of a valid / invalid. If invalid, details of the error found and its severity are added. 132 132 133 133 A second transformation takes the resulting [[dataset>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] filtering out high-severity validation errors and persists the result back to a [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] using [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] mappings. 134 134 135 -** [[VTL>>doc:sdmx:Glossary2\.1.Validation and transformation language.WebHome]]Sample 2.xml**135 +**VTL Sample 2.xml** 136 136 137 137 Illustrates aggregation of an [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] using [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] hierarchical rulesets, filtering and user defined operators. 138 138 139 -After the initial aggregation, unaggregated observations removed are removed from the result [[dataset>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]. A user defined operator is subsequently applied to calculate a percentage [[measure>>doc:sdmx:Glossary 2\.1.Measure.WebHome]] with the final persistent result (% style="color:#e74c3c" %)mapped(%%)from [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] to a [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]].139 +After the initial aggregation, unaggregated observations removed are removed from the result [[dataset>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]. A user defined operator is subsequently applied to calculate a percentage [[measure>>doc:sdmx:Glossary 2\.1.Measure.WebHome]] with the final persistent result mapped from [[VTL>>doc:sdmx:Glossary 2\.1.Validation and transformation language.WebHome]] to a [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]. 140 140 141 -** [[VTL>>doc:sdmx:Glossary2\.1.Validation and transformation language.WebHome]]Sample 3.xml**141 +**VTL Sample 3.xml** 142 142 143 -Illustrates the calculation of a GDP per capita [[dataset>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] from an input (% style="color:#e74c3c" %)mapped(%%)[[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] containing GDP and population [[indicators>>doc:sdmx:Glossary 2\.1.Statistical indicator.WebHome]] on a country by country basis.143 +Illustrates the calculation of a GDP per capita [[dataset>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] from an input mapped [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]] containing GDP and population [[indicators>>doc:sdmx:Glossary 2\.1.Statistical indicator.WebHome]] on a country by country basis. 144 144 145 145 = 3 Data Samples = 146 146 147 -[[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] 3.0 has a single format for data transmission - the Structure Specific Data message. Alternative formats from (% style="color:#e74c3c" %)version(%%)2.1 and earlier such as Generic, Utility and Cross Sectional are deprecated.147 +[[SDMX-ML>>doc:sdmx:Glossary 2\.1.SDMX-ML.WebHome]] 3.0 has a single format for data transmission - the Structure Specific Data message. Alternative formats from version 2.1 and earlier such as Generic, Utility and Cross Sectional are deprecated. 148 148 149 149 The Structure Specific Data message is characterised by the XML elements and [[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] being derived from the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] of the [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]. This provides two main benefits: 150 150 151 151 1. The message content is relatively compact. 152 -1. It is possible to use an XML schema to validate that the [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] contains the correct values as defined by the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and any (%style="color:#e74c3c"%)constraints(%%)attached to the [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]], [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] or data [[provision agreement>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]].152 +1. It is possible to use an XML schema to validate that the [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] contains the correct values as defined by the [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and any [[constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]] attached to the [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]], [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] or data [[provision agreement>>doc:sdmx:Glossary 2\.1.Provision agreement.WebHome]]. 153 153 154 154 The samples therefore include both the Structure Specific Data XML, and a corresponding example validation schema XSD. Successful schema validation confirms that the XML is both a valid Structure Specific Data message, and the content is valid according to the [[SDMX>>doc:sdmx:Glossary 2\.1.Statistical data and metadata exchange.WebHome]] [[structural metadata>>doc:sdmx:Glossary 2\.1.Structural metadata.WebHome]]. 155 155 ... ... @@ -163,15 +163,15 @@ 163 163 164 164 In this example which is representative of aggregated time-[[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] [[datasets>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] with a single [[measure>>doc:sdmx:Glossary 2\.1.Measure.WebHome]], observations are grouped together under [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]], which in turn are grouped under the [[dataset>>doc:sdmx:Glossary 2\.1.Data set.WebHome]] element. 165 165 166 -The [[dimension>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]] values and those of [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]]-(% style="color:#e74c3c" %)level(%%)[[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] are expressed as XML [[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] on each [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] element. Similarly, the TIME_PERIOD, OBS_VALUE and any observation-(% style="color:#e74c3c" %)level(%%)[[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] are expressed as XML [[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] on each obs element.166 +The [[dimension>>doc:sdmx:Glossary 2\.1.Dimension.WebHome]] values and those of series-level [[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] are expressed as XML [[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] on each [[series>>doc:sdmx:Glossary 2\.1.Series.WebHome]] element. Similarly, the TIME_PERIOD, OBS_VALUE and any observation-level [[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] are expressed as XML [[attributes>>doc:sdmx:Glossary 2\.1.Attribute.WebHome]] on each obs element. 167 167 168 168 Note that a structure specific namespace ns1 is defined using xsi:schemalocation to reference the validation schema location, in this case ECB_EXR_Dataflow.xsd. 169 169 170 -**ECB EXR [[Dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]].xsd**170 +**ECB EXR Dataflow.xsd** 171 171 172 172 Structure-specific schema for validating the [[dataset>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]. 173 173 174 -The schema defines a complex type called DataSetType derived from the [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]'s [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and (%style="color:#e74c3c"%)constraints(%%), in this case those attached to the [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]].174 +The schema defines a complex type called DataSetType derived from the [[data set>>doc:sdmx:Glossary 2\.1.Data set.WebHome]]'s [[data structure definition>>doc:sdmx:Glossary 2\.1.Data structure definition.WebHome]] and [[constraints>>doc:sdmx:Glossary 2\.1.Constraint.WebHome]], in this case those attached to the [[dataflow>>doc:sdmx:Glossary 2\.1.Dataflow.WebHome]]. 175 175 176 176 == Aggregated Time Series with Complex Data Attributes == 177 177