Last modified by Helena on 2025/09/10 11:19
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Tags
-
... ... @@ -1,1 +1,0 @@ 1 -Artefact|Attribute|Category scheme|Code list|Component|Data set|Data structure definition|Dataflow|Dimension|Maintenance agency|Measure|Metadata repository|Metadata set|Metadata structure definition|Metadataflow|Notification|Provision agreement|Reference metadata|SDMX Information Model|SDMX Registry|SDMX-JSON|SDMX-ML|Statistical data and metadata exchange|Structural metadata - Content
-
... ... @@ -2,8 +2,7 @@ 2 2 {{toc/}} 3 3 {{/box}} 4 4 5 -(% class="wikigeneratedid" id="HRevisionHistory" %) 6 -**Revision History** 5 += Revision History = 7 7 8 8 ((( 9 9 (% style="width:838.294px" %) ... ... @@ -14,69 +14,69 @@ 14 14 15 15 = 1 Introduction = 16 16 17 -The business vision for [[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]] envisages the promotion of a “data sharing” model to facilitate low-cost, high-quality[[statistical data and metadata exchange>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]].Data sharing reduces the reporting burden of organisations by allowing them to publish data once and let their counterparties “pull” data and related metadata as required. The scenario is based on:16 +The business vision for SDMX envisages the promotion of a “data sharing” model to facilitate low-cost, high-quality statistical data and metadata exchange. Data sharing reduces the reporting burden of organisations by allowing them to publish data once and let their counterparties “pull” data and related metadata as required. The scenario is based on: 18 18 19 -* the availability of an abstract information model capable of supporting time series and cross-sectional data, [[structural metadata>>doc:xwiki:Glossary.Structural metadata.WebHome]], and[[reference metadata>>doc:xwiki:Glossary.Referencemetadata.WebHome]]([[SDMX-IM>>doc:xwiki:Glossary.SDMX Information Model.WebHome]])20 -* standardised XML and JSON schemas for the [[SDMX-ML>>doc:xwiki:Glossary.SDMX-ML.WebHome]]and[[SDMX-JSON>>doc:xwiki:Glossary.SDMX-JSON.WebHome]]formats derived from the model (XSD, JSON)18 +* the availability of an abstract information model capable of supporting time series and cross-sectional data, structural metadata, and reference metadata (SDMX-IM) 19 +* standardised XML and JSON schemas for the SDMX-ML and SDMX-JSON formats derived from the model (XSD, JSON) 21 21 * the use of web-services technology (XML, JSON, Open API) 22 22 23 -Such an architecture needs to be well organised, and the [[SDMX Registry>>doc:xwiki:Glossary.SDMX Registry.WebHome]]/Repository (SDMXRR) is tasked with providing structure, organisation, and maintenance and query interfaces for most of the[[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]] [[components>>doc:xwiki:Glossary.Component.WebHome]]required to support the data sharing vision.22 +Such an architecture needs to be well organised, and the SDMX Registry/Repository (SDMXRR) is tasked with providing structure, organisation, and maintenance and query interfaces for most of the SDMX components required to support the data sharing vision. 24 24 25 -However, it is important to emphasise that the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]-RR provides support for the submission and retrieval of all[[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]] [[structural metadata>>doc:xwiki:Glossary.Structuralmetadata.WebHome]] and provisioning metadata. Therefore, the Registry not only supports the data-sharing scenario, but this metadata is also vital in order to provide support for data and metadata reporting/collection, and dissemination scenarios.24 +However, it is important to emphasise that the SDMX-RR provides support for the submission and retrieval of all SDMX structural metadata and provisioning metadata. Therefore, the Registry not only supports the data-sharing scenario, but this metadata is also vital in order to provide support for data and metadata reporting/collection, and dissemination scenarios. 26 26 27 -Standard formats for the exchange of aggregated statistical data and metadata as prescribed in [[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]]v3.0 are envisaged to bring benefits to the statistical community because data reporting and dissemination processes can be made more efficient.26 +Standard formats for the exchange of aggregated statistical data and metadata as prescribed in SDMX v3.0 are envisaged to bring benefits to the statistical community because data reporting and dissemination processes can be made more efficient. 28 28 29 -As organisations migrate to [[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]] enabled systems, many XML, JSON (and conventional)[[artefacts>>doc:xwiki:Glossary.Artefact.WebHome]]will be produced (e.g., Data Structure, Metadata Structure,[[Code List>>doc:xwiki:Glossary.Codelist.WebHome]]and(% style="color:#2ecc71" %)Concept(%%)definitions – often collectively called[[structural metadata>>doc:xwiki:Glossary.Structuralmetadata.WebHome]]– XML schemas generated from[[data structure definitions>>doc:xwiki:Glossary.Data structure definition.WebHome]], XSLT stylesheets for transformation and display of data and metadata, terminology references, etc.). The[[SDMX>>doc:xwiki:Glossary.Statisticaldata andmetadata exchange.WebHome]] model supports interoperability, and it is important to be able to discover and share these[[artefacts>>doc:xwiki:Glossary.Artefact.WebHome]]between parties in a controlled and organized way.28 +As organisations migrate to SDMX enabled systems, many XML, JSON (and conventional) artefacts will be produced (e.g., Data Structure, Metadata Structure, Code List and Concept definitions – often collectively called structural metadata – XML schemas generated from data structure definitions, XSLT stylesheets for transformation and display of data and metadata, terminology references, etc.). The SDMX model supports interoperability, and it is important to be able to discover and share these artefacts between parties in a controlled and organized way. 30 30 31 31 This is the role of the registry. 32 32 33 -With the fundamental [[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]]standards in place, a set of architectural standards are needed to address some of the processes involved in[[statistical data and metadata exchange>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]], with an emphasis on maintenance, retrieval and sharing of the[[structural metadata>>doc:xwiki:Glossary.Structuralmetadata.WebHome]].In addition, the architectural standards support the registration and discovery of data and referential metadata.32 +With the fundamental SDMX standards in place, a set of architectural standards are needed to address some of the processes involved in statistical data and metadata exchange, with an emphasis on maintenance, retrieval and sharing of the structural metadata. In addition, the architectural standards support the registration and discovery of data and referential metadata. 34 34 35 -These architectural standards address the ‘how’, rather than the ‘what’, and are aimed at enabling existing [[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]]standards to achieve their mission. The architectural standards address registry services, which initially comprise:34 +These architectural standards address the ‘how’, rather than the ‘what’, and are aimed at enabling existing SDMX standards to achieve their mission. The architectural standards address registry services, which initially comprise: 36 36 37 -* [[structural metadata>>doc:xwiki:Glossary.Structuralmetadata.WebHome]]repository36 +* structural metadata repository 38 38 * data and metadata registration 39 39 * query 40 40 41 -The registry services outlined in this specification are designed to help the [[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]] community manage the proliferation of[[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]] assets and to support data sharing for reporting and dissemination.40 +The registry services outlined in this specification are designed to help the SDMX community manage the proliferation of SDMX assets and to support data sharing for reporting and dissemination. 42 42 43 43 = {{id name="_Toc93832"/}}2 Scope and Normative Status = 44 44 45 -The scope of this document is to specify the logical interfaces for the [[SDMX registry>>doc:xwiki:Glossary.SDMXRegistry.WebHome]] in terms of the functions required and the data that may be present in the function call, and the behaviour expected of the registry.44 +The scope of this document is to specify the logical interfaces for the SDMX registry in terms of the functions required and the data that may be present in the function call, and the behaviour expected of the registry. 46 46 47 47 In this document, functions and behaviours of the Registry Interfaces are described in four ways: 48 48 49 49 * in text 50 50 * with tables 51 -* with UML diagrams excerpted from the [[SDMX Information Model>>doc:xwiki:Glossary.SDMXInformation Model.WebHome]]([[SDMX-IM>>doc:xwiki:Glossary.SDMX Information Model.WebHome]])52 -* with UML diagrams that are not a part of the [[SDMX-IM>>doc:xwiki:Glossary.SDMXInformation Model.WebHome]] but are included here for clarity and to aid implementations (these diagrams are clearly marked as “Logical Class Diagram ...”)50 +* with UML diagrams excerpted from the SDMX Information Model (SDMX-IM) 51 +* with UML diagrams that are not a part of the SDMX-IM but are included here for clarity and to aid implementations (these diagrams are clearly marked as “Logical Class Diagram ...”) 53 53 54 54 Whilst the introductory section contains some information on the role of the registry, it is assumed that the reader is familiar with the uses of a registry in providing shared metadata across a community of counterparties. 55 55 56 -Note that chapters 5 and 6 below contain normative rules regarding the Registry Interface and the identification of registry objects. Further, the minimum standard for access to the registry is via a REST interface (HTTP or HTTPS), as described in the appropriate sections. The [[notification>>doc:xwiki:Glossary.Notification.WebHome]]mechanism must support e-mail and HTTP/HTTPS protocols as described. Normative registry interfaces are specified in the[[SDMX-ML>>doc:xwiki:Glossary.SDMX-ML.WebHome]]specification (Section 3 of the[[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]]Standard). All other sections of this document are informative.55 +Note that chapters 5 and 6 below contain normative rules regarding the Registry Interface and the identification of registry objects. Further, the minimum standard for access to the registry is via a REST interface (HTTP or HTTPS), as described in the appropriate sections. The notification mechanism must support e-mail and HTTP/HTTPS protocols as described. Normative registry interfaces are specified in the SDMX-ML specification (Section 3 of the SDMX Standard). All other sections of this document are informative. 57 57 58 -Note that although the term “authorised user” is used in this document, the [[SDMX>>doc:xwiki:Glossary.Statisticaldata and metadata exchange.WebHome]]standards do not define an access control mechanism. Such a mechanism, if required, must be chosen and implemented by the registry software provider.57 +Note that although the term “authorised user” is used in this document, the SDMX standards do not define an access control mechanism. Such a mechanism, if required, must be chosen and implemented by the registry software provider. 59 59 60 60 = {{id name="_Toc93833"/}}3 Scope of the SDMX Registry/Repository = 61 61 62 62 == {{id name="_Toc93834"/}}3.1 Objective == 63 63 64 -The objective of the [[SDMX registry>>doc:xwiki:Glossary.SDMX Registry.WebHome]]/repository is, in broad terms, to allow organisations to publish statistical data and[[reference metadata>>doc:xwiki:Glossary.Referencemetadata.WebHome]]in known formats such that interested third parties can discover these data and interpret them accurately and correctly. The mechanism for doing this is twofold:63 +The objective of the SDMX registry/repository is, in broad terms, to allow organisations to publish statistical data and reference metadata in known formats such that interested third parties can discover these data and interpret them accurately and correctly. The mechanism for doing this is twofold: 65 65 66 -1. To maintain and publish [[structural metadata>>doc:xwiki:Glossary.Structuralmetadata.WebHome]] that describes the structure and valid content of data and[[reference metadata>>doc:xwiki:Glossary.Referencemetadata.WebHome]]sources such as databases,[[metadata repositories>>doc:xwiki:Glossary.Metadata repository.WebHome]],[[data sets>>doc:xwiki:Glossary.Data set.WebHome]],[[metadata sets>>doc:xwiki:Glossary.Metadataset.WebHome]].This[[structural metadata>>doc:xwiki:Glossary.Structuralmetadata.WebHome]] enables software applications to understand and to interpret the data and[[reference metadata>>doc:xwiki:Glossary.Referencemetadata.WebHome]]in these sources.67 -1. To enable applications, organisations, and individuals to share and to discover data and [[reference metadata>>doc:xwiki:Glossary.Referencemetadata.WebHome]].This facilitates data and[[reference metadata>>doc:xwiki:Glossary.Referencemetadata.WebHome]] dissemination by implementing the data sharing vision of[[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]].65 +1. To maintain and publish structural metadata that describes the structure and valid content of data and reference metadata sources such as databases, metadata repositories, data sets, metadata sets. This structural metadata enables software applications to understand and to interpret the data and reference metadata in these sources. 66 +1. To enable applications, organisations, and individuals to share and to discover data and reference metadata. This facilitates data and reference metadata dissemination by implementing the data sharing vision of SDMX. 68 68 69 69 == {{id name="_Toc93835"/}}3.2 Structural Metadata == 70 70 71 -Setting up [[structural metadata>>doc:xwiki:Glossary.Structuralmetadata.WebHome]] and the exchange context (referred to as “data provisioning”) involves the following steps for[[maintenance agencies>>doc:xwiki:Glossary.Maintenance agency.WebHome]]:70 +Setting up structural metadata and the exchange context (referred to as “data provisioning”) involves the following steps for maintenance agencies: 72 72 73 -* agreeing and creating a specification of the structure of the data (called a [[Data Structure Definition>>doc:xwiki:Glossary.Datastructure definition.WebHome]] or[[DSD>>doc:xwiki:Glossary.Datastructure definition.WebHome]]inthis document but also known as “key family”), which defines the[[dimensions>>doc:xwiki:Glossary.Dimension.WebHome]],[[measures>>doc:xwiki:Glossary.Measure.WebHome]]and[[attributes>>doc:xwiki:Glossary.Attribute.WebHome]]of a[[dataset>>doc:xwiki:Glossary.Dataset.WebHome]]and their valid value set;74 -* if required, defining a subset or view of a [[DSD>>doc:xwiki:Glossary.Datastructure definition.WebHome]]which allows some restriction of content called a “[[dataflow>>doc:xwiki:Glossary.Dataflow.WebHome]]definition”;75 -* agreeing and creating a specification of the structure of [[reference metadata>>doc:xwiki:Glossary.Referencemetadata.WebHome]]([[Metadata Structure Definition>>doc:xwiki:Glossary.Metadata structure definition.WebHome]]) which defines the metadata[[attributes>>doc:xwiki:Glossary.Attribute.WebHome]]and their presentational arrangement in a Metadataset or as part of a[[Dataset>>doc:xwiki:Glossary.Data set.WebHome]], and their valid values and content;76 -* if required, defining a subset or view of an [[MSD>>doc:xwiki:Glossary.Metadatastructure definition.WebHome]]which allows some restriction of content called a “[[metadataflow>>doc:xwiki:Glossary.Metadataflow.WebHome]]”;77 -* defining which subject matter domains (specified as a [[Category Scheme>>doc:xwiki:Glossary.Category scheme.WebHome]]) are related to the[[Dataflow>>doc:xwiki:Glossary.Dataflow.WebHome]]and[[Metadataflow>>doc:xwiki:Glossary.Metadataflow.WebHome]]to enable browsing;72 +* agreeing and creating a specification of the structure of the data (called a Data Structure Definition or DSD in this document but also known as “key family”), which defines the dimensions, measures and attributes of a dataset and their valid value set; 73 +* if required, defining a subset or view of a DSD which allows some restriction of content called a “dataflow definition”; 74 +* agreeing and creating a specification of the structure of reference metadata (Metadata Structure Definition) which defines the metadata attributes and their presentational arrangement in a Metadataset or as part of a Dataset, and their valid values and content; 75 +* if required, defining a subset or view of an MSD which allows some restriction of content called a “metadataflow”; 76 +* defining which subject matter domains (specified as a Category Scheme) are related to the Dataflow and Metadataflow to enable browsing; 78 78 * defining one or more lists of Data and Metadata Providers; 79 -* defining which Data/Metadata Providers have agreed to publish a given [[Dataflow>>doc:xwiki:Glossary.Dataflow.WebHome]]/[[Metadataflow>>doc:xwiki:Glossary.Metadataflow.WebHome]]– this is called a[[Provision Agreement>>doc:xwiki:Glossary.Provisionagreement.WebHome]] or Metadata[[Provision Agreement>>doc:xwiki:Glossary.Provision agreement.WebHome]], respectively.78 +* defining which Data/Metadata Providers have agreed to publish a given Dataflow/Metadataflow – this is called a Provision Agreement or Metadata Provision Agreement, respectively. 80 80 81 81 [[image:SDMX 3-0-0 SECTION 5 FINAL-1.0_en_28806f51.jpg||height="539" width="443"]] 82 82