Changes for page 7 Metadata Repository and Linking Data to Metadata
Last modified by Helena on 2025/09/10 11:19
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Parent
-
... ... @@ -1,1 +1,1 @@ 1 - Methodology.SDMX 2\.1 User Guide.WebHome1 +WebHome - Content
-
... ... @@ -4,12 +4,11 @@ 4 4 5 5 == 7.1 Scope of this Chapter == 6 6 7 -(% style="text-align: center;" %) 8 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_fa163c2f118092e0.jpg||height="417" width="343"]] 7 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_fa163c2f118092e0.jpg||data-xwiki-image-style-alignment="center" height="417" width="343"]] 9 9 10 -The storage, retrieval and linkage to data of Reference Metadata (often known as “footnote” metadata) is becoming more and more important in the dissemination of statistics. All organizations that compile statistical data have reference metadata and it is often useful to data consumers for the data providers to disseminate this with the data. This can be done in a simple way by disseminating all such metadata regardless of whether it pertains to the data, or it can be done in a more intelligent way, and therefore more useful to the data consumer, by disseminating only that metadata which pertains to the data being viewed or downloaded. 9 +The storage, retrieval and linkage to data of [[Reference Metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] (often known as “footnote” metadata) is becoming more and more important in the dissemination of statistics. All organizations that compile statistical data have [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] and it is often useful to [[data consumers>>doc:sdmx:Glossary.Data consumer.WebHome]] for the [[data providers>>doc:sdmx:Glossary.Data provider.WebHome]] to disseminate this with the data. This can be done in a simple way by disseminating all such metadata regardless of whether it pertains to the data, or it can be done in a more intelligent way, and therefore more useful to the [[data consumer>>doc:sdmx:Glossary.Data consumer.WebHome]], by disseminating only that metadata which pertains to the data being viewed or downloaded. 11 11 12 -This Chapter discusses the role of the metadata repository in the context of: 11 +This Chapter discusses the role of the [[metadata repository>>doc:sdmx:Glossary.Metadata repository.WebHome]] in the context of: 13 13 14 14 * its logical structure 15 15 * loading metadata ... ... @@ -17,34 +17,33 @@ 17 17 18 18 == 7.2 Structure of the Metadata Repository == 19 19 20 -In SDMX all metadata is characterized as: 19 +In [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] all metadata is characterized as: 21 21 22 -* Metadata Attribute o Attached to a (SDMX) object 21 +* Metadata [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]] o Attached to a ([[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]]) object 23 23 24 -Examples are shown below. The “Metadata Attribute” is taken from the SDMX Cross Domain Concepts and the “Attached to” is a typical object to which it would be attached in a data dissemination scenario. 23 +Examples are shown below. The “Metadata [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]]” is taken from the [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] Cross Domain (% style="color:#e74c3c" %)Concepts(%%) and the “Attached to” is a typical object to which it would be attached in a data dissemination scenario. 25 25 26 26 (% style="width:1213.45px" %) 27 27 |**Metadata Attribute**|(% style="width:395px" %)**Description**|(% style="width:633px" %)**Attached To** 28 -|COMPILING_ORG|(% style="width:395px" %)The organisation compiling the data being reported|(% style="width:633px" %)Data Key – this can be a full or partial key. In thie specific example presented here it would probably be attached to the Reference Area dimension. 29 -|COVERAGE_SECTOR|(% style="width:395px" %)Main economic or other sectors covered by the statistics|(% style="width:633px" %)CODE 30 -|SOURCE_TYPE|(% style="width:395px" %)Characteristics and components of the raw statistical data used for compiling statistical aggregates|(% style="width:633px" %)DATAFLOW 27 +|COMPILING_ORG|(% style="width:395px" %)The organisation compiling the data being reported|(% style="width:633px" %)Data Key – this can be a full or partial key. In thie specific example presented here it would probably be attached to the [[Reference Area>>doc:sdmx:Glossary.Reference area.WebHome]] [[dimension>>doc:sdmx:Glossary.Dimension.WebHome]]. 28 +|COVERAGE_SECTOR|(% style="width:395px" %)Main economic or other sectors covered by the statistics|(% style="width:633px" %)[[CODE>>doc:sdmx:Glossary.Code.WebHome]] 29 +|SOURCE_TYPE|(% style="width:395px" %)Characteristics and [[components>>doc:sdmx:Glossary.Component.WebHome]] of the raw statistical data used for compiling statistical aggregates|(% style="width:633px" %)[[DATAFLOW>>doc:sdmx:Glossary.Dataflow.WebHome]] 31 31 |UNIT_MEASURE|(% style="width:395px" %) |(% style="width:633px" %)SERIES KEY 32 -|COMMENT|(% style="width:395px" %)Supplementary descriptive text which can be attached to data or metadata|(% style="width:633px" %)CONCEPT ( if applicable to all uses of the Concept) or DIMENSION (if applicable to the use of a Concept in a specific DSD) 31 +|COMMENT|(% style="width:395px" %)Supplementary descriptive text which can be attached to data or metadata|(% style="width:633px" %)(% style="color:#e74c3c" %)CONCEPT(%%) ( if applicable to all uses of the (% style="color:#e74c3c" %)Concept(%%)) or [[DIMENSION>>doc:sdmx:Glossary.Dimension.WebHome]] (if applicable to the use of a (% style="color:#e74c3c" %)Concept(%%) in a specific [[DSD>>doc:sdmx:Glossary.Data structure definition.WebHome]]) 33 33 |OBS_STATUS|(% style="width:395px" %)Information on the quality of a value or an unusual or missing value|(% style="width:633px" %)OBSERVATION 34 34 35 -Therefore the conceptual structure of a Metadata Repository is: 34 +Therefore the conceptual structure of a [[Metadata Repository>>doc:sdmx:Glossary.Metadata repository.WebHome]] is: 36 36 37 -(% style="text-align: center;" %) 38 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_80254bb4443a6ba5.jpg||height="176" width="576"]] 36 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_80254bb4443a6ba5.jpg||data-xwiki-image-style-alignment="center" height="176" width="576"]] 39 39 40 40 (% style="text-align: center;" %) 41 41 **{{id name="image_14"/}}Figure 14: Conceptual Structure of a Metadata Repository** 42 42 43 -This is only a conceptual structure and is purposefully over-simplistic as it is drawn to show conceptually how such a metadata repository may work. 41 +This is only a conceptual structure and is purposefully over-simplistic as it is drawn to show conceptually how such a [[metadata repository>>doc:sdmx:Glossary.Metadata repository.WebHome]] may work. 44 44 45 -The Metadata Key is comprised of one or more Object Type/Object Id. For instance, for a Code or a Concept it would be the Id of the Code or Concept such as the URN. For a specific key or partial key there would be two Objects, the DSD and the Data Key. Clearly, this is a conceptual structure as it is probable that the Metadata Key would combine the value of all of the individual Object Ids, as this would be necessary in order to find metadata quickly. 43 +The Metadata Key is comprised of one or more Object Type/Object Id. For instance, for a [[Code>>doc:sdmx:Glossary.Code.WebHome]] or a (% style="color:#e74c3c" %)Concept(%%) it would be the Id of the [[Code>>doc:sdmx:Glossary.Code.WebHome]] or (% style="color:#e74c3c" %)Concept(%%) such as the URN. For a specific key or partial key there would be two Objects, the [[DSD>>doc:sdmx:Glossary.Data structure definition.WebHome]] and the Data Key. Clearly, this is a conceptual structure as it is probable that the Metadata Key would combine the value of all of the individual Object Ids, as this would be necessary in order to find metadata quickly. 46 46 47 -The Metadata Attribute Table may, of course, contain additional information depending on the actual requirements. For instance, it may not be necessary to reference the Metadata Structure Definition (MSD) providing the Concept name and Description are contained in the table. Also, it may be useful to add a “Short Name” to be used by applications such as web sites. Note that the metadata attribute structure can be hierarchical (i.e. a Metadata Attribute can have child Metadata Attributes). As each Metadata Attribute can have only one parent this structure is achieved by the Parent Attribute Id. 45 +The Metadata [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]] Table may, of course, contain additional information depending on the actual requirements. For instance, it may not be necessary to reference the [[Metadata Structure Definition>>doc:sdmx:Glossary.Metadata structure definition.WebHome]] ([[MSD>>doc:sdmx:Glossary.Metadata structure definition.WebHome]]) providing the (% style="color:#e74c3c" %)Concept(%%) name and Description are contained in the table. Also, it may be useful to add a “Short Name” to be used by applications such as web sites. Note that the metadata [[attribute>>doc:sdmx:Glossary.Attribute.WebHome]] structure can be hierarchical (i.e. a Metadata [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]] can have child Metadata [[Attributes>>doc:sdmx:Glossary.Attribute.WebHome]]). As each Metadata [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]] can have only one parent this structure is achieved by the Parent [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]] Id. 48 48 49 49 The way such a repository would support the linking of data to metadata is shown below. 50 50 ... ... @@ -52,69 +52,62 @@ 52 52 53 53 === 7.3.1 Examples === 54 54 55 -(% style="text-align: center;" %) 56 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_52419152fb71038.png||height="361" width="699"]] 53 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_52419152fb71038.png||data-xwiki-image-style-alignment="center" height="361" width="699"]] 57 57 58 -(% style="text-align: center;" %) 59 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_1a7bc7f4af53ef18.png||height="424" width="699"]] 55 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_1a7bc7f4af53ef18.png||data-xwiki-image-style-alignment="center" height="424" width="699"]] 60 60 61 -(% style="text-align: center;" %) 62 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_c0dbd61fc2de1d2d.png||height="417" width="699"]] 57 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_c0dbd61fc2de1d2d.png||data-xwiki-image-style-alignment="center" height="417" width="699"]] 63 63 64 64 === 7.3.2 Metadata Structure Definition === 65 65 66 66 ==== 7.3.2.1 MSD Visualised in a Tool ==== 67 67 68 -(% style="text-align: center;" %) 69 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_c395b26f603554fc.png||height="478" width="680"]] 63 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_c395b26f603554fc.png||data-xwiki-image-style-alignment="center" height="478" width="680"]] 70 70 71 71 (% style="text-align: center;" %) 72 72 **{{id name="image_15"/}}Figure 15: MSD - Metadata Targets** 73 73 74 -===== **Notes** ===== 68 +(% class="wikigeneratedid" id="HNotes" %) 69 +**Notes** 75 75 76 -The DATA_KEY_TARGET comprises two components: 71 +The DATA_KEY_TARGET comprises two [[components>>doc:sdmx:Glossary.Component.WebHome]]: 77 77 78 -1. A **Key Descriptor** (dimension descriptor) – this specifies that a key (one or more dimension values) must be specified in the Metadata Set 79 -1. An **Identifiable Object** which must be a Dataflow – this specifies that a Dataflow must be specified in the Metadata Set. If required, the valid list of Dataflows can be specified in an Item Scheme such as a Category Scheme. 73 +1. A **Key Descriptor** ([[dimension>>doc:sdmx:Glossary.Dimension.WebHome]] descriptor) – this specifies that a key (one or more [[dimension>>doc:sdmx:Glossary.Dimension.WebHome]] values) must be specified in the [[Metadata Set>>doc:sdmx:Glossary.Metadata set.WebHome]] 74 +1. An **Identifiable Object** which must be a [[Dataflow>>doc:sdmx:Glossary.Dataflow.WebHome]] – this specifies that a [[Dataflow>>doc:sdmx:Glossary.Dataflow.WebHome]] must be specified in the [[Metadata Set>>doc:sdmx:Glossary.Metadata set.WebHome]]. If required, the valid list of [[Dataflows>>doc:sdmx:Glossary.Dataflow.WebHome]] can be specified in an [[Item Scheme>>doc:sdmx:Glossary.Item scheme.WebHome]] such as a [[Category>>doc:sdmx:Glossary.Category.WebHome]] Scheme. 80 80 81 -The combination of these two components specifies a data key in the context of a specific Dataflow. 76 +The combination of these two [[components>>doc:sdmx:Glossary.Component.WebHome]] specifies a data key in the context of a specific [[Dataflow>>doc:sdmx:Glossary.Dataflow.WebHome]]. 82 82 83 83 The DATAFLOW_TARGET comprises just one component: 84 84 85 -~1. An **Identifiable Object** which must be a Dataflow 80 +~1. An **Identifiable Object** which must be a [[Dataflow>>doc:sdmx:Glossary.Dataflow.WebHome]] 86 86 87 -(% style="text-align: center;" %) 88 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_1f7507712781fc80.jpg||height="293" width="576"]] 82 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_1f7507712781fc80.jpg||data-xwiki-image-style-alignment="center" height="293" width="576"]] 89 89 90 90 (% style="text-align: center;" %) 91 91 **{{id name="image_16"/}}Figure 16: MSD - Report Structure** 92 92 93 -===== Notes ===== 87 +(% class="wikigeneratedid" id="HNotes-1" %) 88 +**Notes** 94 94 95 -1. There is only one Report Structure. The same structure is used for both Metadata Targets (Dataflow and Data Key). 96 -1. It is possible to have many Report Structure in an MSD, each referencing a different Metadata Target. 90 +1. There is only one Report Structure. The same structure is used for both Metadata Targets ([[Dataflow>>doc:sdmx:Glossary.Dataflow.WebHome]] and Data Key). 91 +1. It is possible to have many Report Structure in an [[MSD>>doc:sdmx:Glossary.Metadata structure definition.WebHome]], each referencing a different Metadata Target. 97 97 98 98 ==== 7.3.2.2 MSD SDMX-ML ==== 99 99 100 -(% style="text-align: center;" %) 101 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_c33453af365398ed.jpg||height="452" width="518"]] 95 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_c33453af365398ed.jpg||data-xwiki-image-style-alignment="center" height="452" width="518"]] 102 102 103 103 (% style="text-align: center;" %) 104 -**{{id name="image_17"/}}Figure 17: MSD - Metadata Targets** 98 +**{{id name="image_17"/}}Figure 17: [[MSD>>doc:sdmx:Glossary.Metadata structure definition.WebHome]] - Metadata Targets** 105 105 106 -(% style="text-align: center;" %) 107 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_20c6a0fb93ba4785.jpg||height="538" width="576"]] 100 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_20c6a0fb93ba4785.jpg||data-xwiki-image-style-alignment="center" height="538" width="576"]] 108 108 109 109 (% style="text-align: center;" %) 110 110 **{{id name="image_18"/}}Figure 18: MSD - Metadata Report** 111 111 112 -Note that the reasons of brevity content of many of the Metadata Attributes has been collapsed e.g. each has a Concept identity and Local Representation. 105 +Note that the reasons of brevity content of many of the Metadata [[Attributes>>doc:sdmx:Glossary.Attribute.WebHome]] has been collapsed e.g. each has a (% style="color:#e74c3c" %)Concept(%%) identity and Local [[Representation>>doc:sdmx:Glossary.Representation.WebHome]]. 113 113 114 114 === 7.3.3 Metadata Set === 115 115 116 -(% style="text-align: center;" %) 117 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_78c50612303a7fec.gif||alt="Shape1" height="626" width="485"]] 109 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_78c50612303a7fec.gif||alt="Shape1" data-xwiki-image-style-alignment="center" height="626" width="485"]] 118 118 119 -(% style="text-align: center;" %) 120 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_56dabe85f0ea1c96.jpg||height="526" width="576"]] 111 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_56dabe85f0ea1c96.jpg||data-xwiki-image-style-alignment="center" height="526" width="576"]]