Skip to Content
Version 5.1 by Artur on 2025/05/27 15:51
Show last authors
1 {{box title="**Contents**"}}
2 {{toc/}}
3 {{/box}}
4
5 == 7.1 Scope of this Chapter ==
6
7 [[image:SDMX_2-1_User_Guide_draft_0-1_html_fa163c2f118092e0.jpg||data-xwiki-image-style-alignment="center" height="417" width="343"]]
8
9 The storage, retrieval and linkage to data of [[Reference Metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] (often known as “footnote” metadata) is becoming more and more important in the dissemination of statistics. All organizations that compile statistical data have [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] and it is often useful to [[data consumers>>doc:sdmx:Glossary.Data consumer.WebHome]] for the [[data providers>>doc:sdmx:Glossary.Data provider.WebHome]] to disseminate this with the data. This can be done in a simple way by disseminating all such metadata regardless of whether it pertains to the data, or it can be done in a more intelligent way, and therefore more useful to the [[data consumer>>doc:sdmx:Glossary.Data consumer.WebHome]], by disseminating only that metadata which pertains to the data being viewed or downloaded.
10
11 This Chapter discusses the role of the [[metadata repository>>doc:sdmx:Glossary.Metadata repository.WebHome]] in the context of:
12
13 * its logical structure
14 * loading metadata
15 * retrieving metadata
16
17 == 7.2 Structure of the Metadata Repository ==
18
19 In [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] all metadata is characterized as:
20
21 * Metadata [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]] o Attached to a ([[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]]) object
22
23 Examples are shown below. The “Metadata [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]]” is taken from the [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] Cross Domain (% style="color:#e74c3c" %)Concepts(%%) and the “Attached to” is a typical object to which it would be attached in a data dissemination scenario.
24
25 (% style="width:1213.45px" %)
26 |**Metadata Attribute**|(% style="width:395px" %)**Description**|(% style="width:633px" %)**Attached To**
27 |COMPILING_ORG|(% style="width:395px" %)The organisation compiling the data being reported|(% style="width:633px" %)Data Key – this can be a full or partial key. In thie specific example presented here it would probably be attached to the [[Reference Area>>doc:sdmx:Glossary.Reference area.WebHome]] [[dimension>>doc:sdmx:Glossary.Dimension.WebHome]].
28 |COVERAGE_SECTOR|(% style="width:395px" %)Main economic or other sectors covered by the statistics|(% style="width:633px" %)[[CODE>>doc:sdmx:Glossary.Code.WebHome]]
29 |SOURCE_TYPE|(% style="width:395px" %)Characteristics and [[components>>doc:sdmx:Glossary.Component.WebHome]] of the raw statistical data used for compiling statistical aggregates|(% style="width:633px" %)[[DATAFLOW>>doc:sdmx:Glossary.Dataflow.WebHome]]
30 |UNIT_MEASURE|(% style="width:395px" %) |(% style="width:633px" %)SERIES KEY
31 |COMMENT|(% style="width:395px" %)Supplementary descriptive text which can be attached to data or metadata|(% style="width:633px" %)(% style="color:#e74c3c" %)CONCEPT(%%) ( if applicable to all uses of the (% style="color:#e74c3c" %)Concept(%%)) or [[DIMENSION>>doc:sdmx:Glossary.Dimension.WebHome]] (if applicable to the use of a (% style="color:#e74c3c" %)Concept(%%) in a specific [[DSD>>doc:sdmx:Glossary.Data structure definition.WebHome]])
32 |OBS_STATUS|(% style="width:395px" %)Information on the quality of a value or an unusual or missing value|(% style="width:633px" %)OBSERVATION
33
34 Therefore the conceptual structure of a [[Metadata Repository>>doc:sdmx:Glossary.Metadata repository.WebHome]] is:
35
36 [[image:SDMX_2-1_User_Guide_draft_0-1_html_80254bb4443a6ba5.jpg||data-xwiki-image-style-alignment="center" height="176" width="576"]]
37
38 (% style="text-align: center;" %)
39 **{{id name="image_14"/}}Figure 14: Conceptual Structure of a Metadata Repository**
40
41 This is only a conceptual structure and is purposefully over-simplistic as it is drawn to show conceptually how such a [[metadata repository>>doc:sdmx:Glossary.Metadata repository.WebHome]] may work.
42
43 The Metadata Key is comprised of one or more Object Type/Object Id. For instance, for a [[Code>>doc:sdmx:Glossary.Code.WebHome]] or a (% style="color:#e74c3c" %)Concept(%%) it would be the Id of the [[Code>>doc:sdmx:Glossary.Code.WebHome]] or (% style="color:#e74c3c" %)Concept(%%) such as the URN. For a specific key or partial key there would be two Objects, the [[DSD>>doc:sdmx:Glossary.Data structure definition.WebHome]] and the Data Key. Clearly, this is a conceptual structure as it is probable that the Metadata Key would combine the value of all of the individual Object Ids, as this would be necessary in order to find metadata quickly.
44
45 The Metadata [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]] Table may, of course, contain additional information depending on the actual requirements. For instance, it may not be necessary to reference the [[Metadata Structure Definition>>doc:sdmx:Glossary.Metadata structure definition.WebHome]] ([[MSD>>doc:sdmx:Glossary.Metadata structure definition.WebHome]]) providing the (% style="color:#e74c3c" %)Concept(%%) name and Description are contained in the table. Also, it may be useful to add a “Short Name” to be used by applications such as web sites. Note that the metadata [[attribute>>doc:sdmx:Glossary.Attribute.WebHome]] structure can be hierarchical (i.e. a Metadata [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]] can have child Metadata [[Attributes>>doc:sdmx:Glossary.Attribute.WebHome]]). As each Metadata [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]] can have only one parent this structure is achieved by the Parent [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]] Id.
46
47 The way such a repository would support the linking of data to metadata is shown below.
48
49 == 7.3 Linking Data to Metadata ==
50
51 === 7.3.1 Examples ===
52
53 [[image:SDMX_2-1_User_Guide_draft_0-1_html_52419152fb71038.png||data-xwiki-image-style-alignment="center" height="361" width="699"]]
54
55 [[image:SDMX_2-1_User_Guide_draft_0-1_html_1a7bc7f4af53ef18.png||data-xwiki-image-style-alignment="center" height="424" width="699"]]
56
57 [[image:SDMX_2-1_User_Guide_draft_0-1_html_c0dbd61fc2de1d2d.png||data-xwiki-image-style-alignment="center" height="417" width="699"]]
58
59 === 7.3.2 Metadata Structure Definition ===
60
61 ==== 7.3.2.1 MSD Visualised in a Tool ====
62
63 [[image:SDMX_2-1_User_Guide_draft_0-1_html_c395b26f603554fc.png||data-xwiki-image-style-alignment="center" height="478" width="680"]]
64
65 (% style="text-align: center;" %)
66 **{{id name="image_15"/}}Figure 15: MSD - Metadata Targets**
67
68 (% class="wikigeneratedid" id="HNotes" %)
69 **Notes**
70
71 The DATA_KEY_TARGET comprises two [[components>>doc:sdmx:Glossary.Component.WebHome]]:
72
73 1. A **Key Descriptor** ([[dimension>>doc:sdmx:Glossary.Dimension.WebHome]] descriptor) – this specifies that a key (one or more [[dimension>>doc:sdmx:Glossary.Dimension.WebHome]] values) must be specified in the [[Metadata Set>>doc:sdmx:Glossary.Metadata set.WebHome]]
74 1. An **Identifiable Object** which must be a [[Dataflow>>doc:sdmx:Glossary.Dataflow.WebHome]] – this specifies that a [[Dataflow>>doc:sdmx:Glossary.Dataflow.WebHome]] must be specified in the [[Metadata Set>>doc:sdmx:Glossary.Metadata set.WebHome]]. If required, the valid list of [[Dataflows>>doc:sdmx:Glossary.Dataflow.WebHome]] can be specified in an [[Item Scheme>>doc:sdmx:Glossary.Item scheme.WebHome]] such as a [[Category>>doc:sdmx:Glossary.Category.WebHome]] Scheme.
75
76 The combination of these two [[components>>doc:sdmx:Glossary.Component.WebHome]] specifies a data key in the context of a specific [[Dataflow>>doc:sdmx:Glossary.Dataflow.WebHome]].
77
78 The DATAFLOW_TARGET comprises just one component:
79
80 ~1. An **Identifiable Object** which must be a [[Dataflow>>doc:sdmx:Glossary.Dataflow.WebHome]]
81
82 [[image:SDMX_2-1_User_Guide_draft_0-1_html_1f7507712781fc80.jpg||data-xwiki-image-style-alignment="center" height="293" width="576"]]
83
84 (% style="text-align: center;" %)
85 **{{id name="image_16"/}}Figure 16: MSD - Report Structure**
86
87 (% class="wikigeneratedid" id="HNotes-1" %)
88 **Notes**
89
90 1. There is only one Report Structure. The same structure is used for both Metadata Targets ([[Dataflow>>doc:sdmx:Glossary.Dataflow.WebHome]] and Data Key).
91 1. It is possible to have many Report Structure in an [[MSD>>doc:sdmx:Glossary.Metadata structure definition.WebHome]], each referencing a different Metadata Target.
92
93 ==== 7.3.2.2 MSD SDMX-ML ====
94
95 [[image:SDMX_2-1_User_Guide_draft_0-1_html_c33453af365398ed.jpg||data-xwiki-image-style-alignment="center" height="452" width="518"]]
96
97 (% style="text-align: center;" %)
98 **{{id name="image_17"/}}Figure 17: [[MSD>>doc:sdmx:Glossary.Metadata structure definition.WebHome]] - Metadata Targets**
99
100 [[image:SDMX_2-1_User_Guide_draft_0-1_html_20c6a0fb93ba4785.jpg||data-xwiki-image-style-alignment="center" height="538" width="576"]]
101
102 (% style="text-align: center;" %)
103 **{{id name="image_18"/}}Figure 18: MSD - Metadata Report**
104
105 Note that the reasons of brevity content of many of the Metadata [[Attributes>>doc:sdmx:Glossary.Attribute.WebHome]] has been collapsed e.g. each has a (% style="color:#e74c3c" %)Concept(%%) identity and Local [[Representation>>doc:sdmx:Glossary.Representation.WebHome]].
106
107 === 7.3.3 Metadata Set ===
108
109 [[image:SDMX_2-1_User_Guide_draft_0-1_html_78c50612303a7fec.gif||alt="Shape1" data-xwiki-image-style-alignment="center" height="626" width="485"]]
110
111 [[image:SDMX_2-1_User_Guide_draft_0-1_html_56dabe85f0ea1c96.jpg||data-xwiki-image-style-alignment="center" height="526" width="576"]]