Skip to Content

Changes for page Part VII. Samples

Last modified by Artur on 2025/09/10 11:19
From version 9.1
edited by Helena
on 2025/07/03 14:54
Change comment: There is no comment for this version
To version 3.1
edited by Helena
on 2025/06/23 16:30
Change comment: There is no comment for this version

Summary

Details

Page properties
Tags
... ... @@ -1,1 +1,0 @@
1 -Attribute|Attribute relationship|Category|Code|Code list|Comment|Component|Data structure definition|Dataflow|Dimension|Hierarchy|Measure|Reference metadata|Representation|Sibling group|Statistical data and metadata exchange|Structural metadata
Content
... ... @@ -1,63 +1,0 @@
1 -{{box title="**Contents**"}}
2 -{{toc/}}
3 -{{/box}}
4 -
5 -= 1. Introduction =
6 -
7 -This document provides a brief overview of the currently available set of sample files. It is intended that more samples will be added over time, and the explanations in this document updated. Eventually, this entire document will be migrated to a complete user guide which details the various aspects of [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]], focusing on specific use cases and beginning to end uses of the standard.
8 -
9 -= 2. Structure Samples =
10 -
11 -The structure samples that are available serve to describe the structure of the data and [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] samples.
12 -
13 -The directory common contains [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]] based on the content oriented guidelines, and this is used across all samples.
14 -
15 -For all samples, there is a common sample file which contains a subset of standard [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] [[components>>doc:sdmx:Glossary.Component.WebHome]]. Tese are contained in common/common.xml. Other files may make external references to this file.
16 -
17 -The directory exr contains 3 similar [[data structure definitions>>doc:sdmx:Glossary.Data structure definition.WebHome]], each with very slight modifications. These data structures are all based on the ECB exchange rates and serve to demonstrate that the newly introduced [[attribute relationship>>doc:sdmx:Glossary.Attribute relationship.WebHome]] construct. A summary of the files is as follows:
18 -
19 -* exr/common/exr_common.xml: this contains the [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]] that is used across the various data structures. Each of the subsequent structure message provide external references to this file
20 -* exr/ecb_exr_ng/ecb_exr_ng.xml: this contains an exchange rate data structure with no groups defined. All [[attribute relationships>>doc:sdmx:Glossary.Attribute relationship.WebHome]] are to specific [[dimensions>>doc:sdmx:Glossary.Dimension.WebHome]]. The file ecb_exr_ng_full.xml represents the same structure, but does not use external referencing to make the file easier to load into tools which cannot resolve local file references
21 -* exr/ecb_exr_sg/ ecb_exr_sg.xml: this contains an exchange rate data structure with a [[sibling group>>doc:sdmx:Glossary.Sibling group.WebHome]] defined. In this sample, only on [[attribute>>doc:sdmx:Glossary.Attribute.WebHome]] references the [[sibling group>>doc:sdmx:Glossary.Sibling group.WebHome]], and the rest maintain the relationships defined in the data structure without groups. The file ecb_exr_sg_full.xml represents the same structure, but does not use external referencing to make the file easier to load into tools which cannot resolve local file references
22 -* exr/ecb_exr_rg/ ecb_exr_rg.xml: this contains an exchange rate data structure with an addition group defined. In this sample only one [[attribute>>doc:sdmx:Glossary.Attribute.WebHome]] specifies a relationship with the new group, but the [[dimensions>>doc:sdmx:Glossary.Dimension.WebHome]] from the previous sample now declare the [[sibling group>>doc:sdmx:Glossary.Sibling group.WebHome]] as an attachment group. The file ecb_exr_rg_full.xml represents the same structure, but does not use external referencing to make the file easier to load into tools which cannot resolve local file references
23 -
24 -The directory demography contains a data structure and metadata structure. The summary of the [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]] files are as follows:
25 -
26 -* demography.xml: this contains the demography [[data structure definition>>doc:sdmx:Glossary.Data structure definition.WebHome]]. This [[data structure definition>>doc:sdmx:Glossary.Data structure definition.WebHome]] declares [[measure>>doc:sdmx:Glossary.Measure.WebHome]] [[dimension>>doc:sdmx:Glossary.Dimension.WebHome]]. It is also worth noting that the [[measure>>doc:sdmx:Glossary.Measure.WebHome]] (% style="color:#e74c3c" %)concepts(%%) have different core [[representations>>doc:sdmx:Glossary.Representation.WebHome]]. This is important when the sample data is discussed.
27 -* esms.xml: this contains a much simplified variation of the Eurostat [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] Metadata Structure. It feature all of the new features of the metadata structure including the various target objects, the ability to reference multiple possible targets from a report structure and the ability to have more complex structures with repeating [[attributes>>doc:sdmx:Glossary.Attribute.WebHome]], [[attributes>>doc:sdmx:Glossary.Attribute.WebHome]] with both sub content and values, and [[attributes>>doc:sdmx:Glossary.Attribute.WebHome]] with structured text as it content
28 -
29 -= 3. Data Samples =
30 -
31 -The exchange rate sample data files all contains the same set of data, and each variation of the key family has 8 corresponding sample files intended to demonstrate the effects of the various orientations. The difference in the data structures is discussed in the previous section. For any given data structure, the following samples files exist (note the names vary based on the data structure used and the format, but follow the same structure (note [format] is generic or structured and ~[[[dsd>>doc:sdmx:Glossary.Data structure definition.WebHome]]] is ecb_exr_ng, ecb_exr_sg, or ecb_exr_rg.:
32 -
33 -* [format]/~[[[dsd>>doc:sdmx:Glossary.Data structure definition.WebHome]]]_flat.xml: this represents ungrouped observations, where every observation contains a full key. It is worth noting how the use of groups changes change the verbosity of the message
34 -* [format]/[ ~[[[dsd>>doc:sdmx:Glossary.Data structure definition.WebHome]]]_ts.xml: this represents the data organised as time series, using the time series only message
35 -* [format]/~[[[dsd>>doc:sdmx:Glossary.Data structure definition.WebHome]]]_ts.xml: this represents the same orientation as the previous file, but uses the general format. It is worth noting that this file is exactly that same as the previous file with the exception of the root element
36 -* [format]/[ ~[[[dsd>>doc:sdmx:Glossary.Data structure definition.WebHome]]]_xs.xml: this file shows the data represented with another [[dimension>>doc:sdmx:Glossary.Dimension.WebHome]] at the observation (% style="color:#e74c3c" %)level(%%). Because of the [[attribute relationships>>doc:sdmx:Glossary.Attribute relationship.WebHome]], this results in the duplication of values. But as the data structures introduce groups, this impact is reduced
37 -
38 -Note that for all structured data, the data structure specific schemas have same file name, but with a .xsd extension.
39 -
40 -The demography data has only on instance associated with it, and that is a cross sectional format with explicit [[measures>>doc:sdmx:Glossary.Measure.WebHome]] being used. It is important to examine the [[data structure definition>>doc:sdmx:Glossary.Data structure definition.WebHome]] schema (demography_xs_ex.xsd) to note how the various [[measure>>doc:sdmx:Glossary.Measure.WebHome]] have different [[representations>>doc:sdmx:Glossary.Representation.WebHome]] for the observed value (OBS_VALUE). By modifying the sample, you can see where this provides extra validation.
41 -
42 -= 4. Metadata Sample =
43 -
44 -There is a single set of [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] samples based on the ESMS metadata structure in the demography folder. This is meant to represent a very simplified metadata report that is attached to the demography data via a [[category>>doc:sdmx:Glossary.Category.WebHome]] in which the [[data flow>>doc:sdmx:Glossary.Dataflow.WebHome]] is defined. These files are:
45 -
46 -* esms_generic.xml: this the [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] in the generic format
47 -* esms_structured.xml: this is the same data in the metadata structure specific format (note that esms.xsd is the schema for this)
48 -
49 -By comparing the files, you can see the similarities between the two formats. In fact, the only difference you will notice (outside of the namespace) is that the metadata structure specific format has element names based on the metadata [[attribute>>doc:sdmx:Glossary.Attribute.WebHome]] identifiers where as the generic structure has this information in a ReportedAttribute element.
50 -
51 -An examination of the metadata structure specific schema will help in understanding the rules for creating these schemas, as the schema is annotated with [[comments>>doc:sdmx:Glossary.Comment.WebHome]] explaining the various features. It is also worth noticing how the [[representation>>doc:sdmx:Glossary.Representation.WebHome]] scheme for the target object which references a [[category>>doc:sdmx:Glossary.Category.WebHome]] resulted in a reference which only allows the [[categories>>doc:sdmx:Glossary.Category.WebHome]] from that scheme to be referenced.
52 -
53 -Note that the xhtml folder contains the xhtml schemas so that the structure text content can be validated.
54 -
55 -= 5. Query Samples =
56 -
57 -The query directory contains a set of query and response documents that highlight some of the new features in the query. Each query is paired with it response by the file name (e.g. query_esms.xml is the query and response.esms.xml is the response). The purpose of the queries is as follows:
58 -
59 -* query_demo_stub.xml: this is a simple query which demonstrates how one can check for the existence of an object by simply requesting that no references be resolved and only the stub be returned. The intention of this query is to simply find out what is the (% style="color:#e74c3c" %)version(%%) of the currently active demography data structure.
60 -* query_esms_shallow.xml: this is a query for the ESMS metadata structure, which is returned in full detail. Only the object referenced directly from the metadata structure are requested and returned, and only the stubs of the objects.
61 -* query_esms_deep.xml: this is an example of a where used query. The intention is to query for any objects which are used directly or indirectly by the ESMS metadata structure. You will notice that the metadata structure is requested to not be returned. Instead, only the stubs of all objects referenced form the metadata structure and the object which they reference (and so on) are returned.
62 -* query_cl_all.xml: this a query for a subset of the very large area [[codelist>>doc:sdmx:Glossary.Code list.WebHome]]. Notices that the return details specify that the matched item should be cascaded down the [[hierarchy>>doc:sdmx:Glossary.Hierarchy.WebHome]], meaning all of its child [[codes>>doc:sdmx:Glossary.Code.WebHome]] should be returned. In this example, this results in all regions and sub-regions for Greece.
63 -* query_cl_regions.xml: this is query for only the regions that are direct children of Greece. The query uses the parent property of the [[code>>doc:sdmx:Glossary.Code.WebHome]] to find the administrative regions within the country. Notice that the results are not cascaded, so only one (% style="color:#e74c3c" %)level(%%) is returned.
SUZ.Methodology.Code.MethodologyClass[0]
index
... ... @@ -1,0 +1,1 @@
1 +7