Last modified by Artur on 2025/09/30 13:28
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -31,13 +31,15 @@ 31 31 32 32 These architectural standards address the ‘how’, rather than the ‘what’, and are aimed at enabling existing SDMX standards to achieve their mission. The architectural standards address registry services, which initially comprise: 33 33 34 -* structural metadata repository 35 -* data and metadata registration 36 -* query 34 +• structural metadata repository 37 37 36 +• data and metadata registration 37 + 38 +• query 39 + 38 38 The registry services outlined in this specification are designed to help the SDMX community manage the proliferation of SDMX assets and to support data sharing for reporting and dissemination. 39 39 40 -= 2 Scope and Normative Status = 42 += {{id name="_Toc90781"/}}2 Scope and Normative Status = 41 41 42 42 The scope of this document is to specify the logical interfaces for the SDMX registry in terms of the functions required and the data that may be present in the function call, and the behaviour expected of the registry. 43 43 ... ... @@ -54,9 +54,9 @@ 54 54 55 55 Note that although the term “authorised user” is used in this document, the SDMX standards do not define an access control mechanism. Such a mechanism, if required, must be chosen and implemented by the registry software provider. 56 56 57 -= 3 Scope of the SDMX Registry/Repository = 59 += {{id name="_Toc90782"/}}3 Scope of the SDMX Registry/Repository = 58 58 59 -== 3.1 Objective == 61 +=== {{id name="_Toc90783"/}}3.1 Objective === 60 60 61 61 The objective of the SDMX registry/repository is, in broad terms, to allow organisations to publish statistical data and reference metadata in known formats such that interested third parties can discover these data and interpret them accurately and correctly. The mechanism for doing this is twofold: 62 62 ... ... @@ -63,7 +63,7 @@ 63 63 1. To maintain and publish structural metadata that describes the structure and valid content of data and reference metadata sources such as databases, metadata repositories, data sets, metadata sets. This structural metadata enables software applications to understand and to interpret the data and reference metadata in these sources. 64 64 1. To enable applications, organisations, and individuals to share and to discover data and reference metadata. This facilitates data and reference metadata dissemination by implementing the data sharing vision of SDMX. 65 65 66 -== 3.2 Structural Metadata == 68 +=== {{id name="_Toc90784"/}}3.2 Structural Metadata === 67 67 68 68 Setting up structural metadata and the exchange context (referred to as “data provisioning”) involves the following steps for maintenance agencies: 69 69 ... ... @@ -89,7 +89,7 @@ 89 89 90 90 In that context, the term “Metadata” refers to reference metadata. 91 91 92 -== 3.3 Registration == 94 +=== {{id name="_Toc90785"/}}3.3 Registration === 93 93 94 94 Publishing the data and reference metadata involves the following steps for a Data/Metadata Provider: 95 95 ... ... @@ -100,13 +100,13 @@ 100 100 101 101 **Figure 2: Schematic of Registered Data and Metadata Sources in the SDMX-IM** 102 102 103 -== 3.4 Notification == 105 +=== {{id name="_Toc90786"/}}3.4 Notification === 104 104 105 105 Notifying interested parties of newly published or re-published data, reference metadata or changes in structural metadata involves: 106 106 107 107 • registry support of a subscription-based notification service which sends an email or notifies an HTTP address announcing all published data that meets the criteria contained in the subscription request. 108 108 109 -== 3.5 Discovery == 111 +=== {{id name="_Toc90787"/}}3.5 Discovery === 110 110 111 111 Discovering published data and reference metadata involves interaction with the registry to fulfil the following logical steps that would be carried out by a user interacting with a service that itself interacts with the registry and an SDMX-enabled data or reference metadata resource: 112 112 ... ... @@ -118,9 +118,9 @@ 118 118 119 119 **Figure 3: Schematic of Data and Metadata Discovery and Query in the SDMX-IM** 120 120 121 -= 4 SDMX Registry/Repository Architecture = 123 += {{id name="_Toc90788"/}}4 SDMX Registry/Repository Architecture = 122 122 123 -== 4.1 Architectural Schematic == 125 +=== {{id name="_Toc90789"/}}4.1 Architectural Schematic === 124 124 125 125 The architecture of the SDMX registry/repository is derived from the objectives stated above. It is a layered architecture that is founded by a structural metadata repository which supports a provisioning metadata repository which supports the registry services. These are all supported by the SDMX-ML schemas. Applications can be built on top of these services which support the reporting, storage, retrieval, and dissemination aspects of the statistical lifecycle as well as the maintenance of the structural metadata required to drive these applications. 126 126 ... ... @@ -128,7 +128,7 @@ 128 128 129 129 **Figure 4: Schematic of the Registry Content and Services** 130 130 131 -== 4.2 Structural Metadata Repository == 133 +=== {{id name="_Toc90790"/}}4.2 Structural Metadata Repository === 132 132 133 133 The basic layer is that of a structural metadata service which supports the lifecycle of SDMX structural metadata artefacts such as Maintenance Agencies, Data Structure Definitions, Metadata Structure Definitions, Provision Agreements, Processes etc. This layer is supported by the Structure Submission and Query Service. 134 134 ... ... @@ -139,15 +139,15 @@ 139 139 140 140 As of the initial version of SDMX 3.0 no messages are defined to support these artefacts; hence, users may need to use SDMX 2.1 Registry Interface messages, instead. 141 141 142 -== 4.3 Provisioning Metadata Repository == 144 +=== {{id name="_Toc90791"/}}4.3 Provisioning Metadata Repository === 143 143 144 144 The function of this repository is to support the definition of the structural metadata that describes the various types of data-store which model SDMX-conformant databases or files, and to link to these data sources. These links can be specified for a data/metadata provider, for a specific data or metadata flow. In the SDMX model this is called the Provision or Metadata Provision Agreement. 145 145 146 146 This layer is supported by the Data and Metadata Registration Service. 147 147 148 -= 5 Registry Interfaces and Services = 150 += {{id name="_Toc90792"/}}5 Registry Interfaces and Services = 149 149 150 -== 5.1 Registry Interfaces == 152 +=== {{id name="_Toc90793"/}}5.1 Registry Interfaces === 151 151 152 152 The Registry Interfaces are: 153 153 ... ... @@ -173,17 +173,17 @@ 173 173 174 174 It should be noted that all interactions are assumed to be synchronous, with the exception of Notify Registry Event. This document is sent by the SDMX-RR to all subscribers whenever an even occurs to which any users have subscribed. Thus, it does not conform to the requestresponse pattern, because it is inherently asynchronous. 175 175 176 -== 5.2 Registry Services == 178 +=== {{id name="_Toc90794"/}}5.2 Registry Services === 177 177 178 -=== 5.2.1 Introduction === 180 +===== {{id name="_Toc90795"/}}5.2.1 Introduction ===== 179 179 180 180 The services described in this section do not imply that each is implemented as a discrete web service. 181 181 182 -=== 5.2.2 Structure Submission Service === 184 +===== {{id name="_Toc90796"/}}5.2.2 Structure Submission Service ===== 183 183 184 184 The registry must support a mechanism for submitting structural metadata. This mechanism can be the SDMX REST interface for structural metadata (this is defined in the corresponding GitHub project, dedicated to the SDMX REST API: __[[https:~~/~~/github.com/sdmx>>url:https://github.com/sdmx-twg/sdmx-rest]][[->>url:https://github.com/sdmx-twg/sdmx-rest]][[twg/sdmx>>url:https://github.com/sdmx-twg/sdmx-rest]][[->>url:https://github.com/sdmx-twg/sdmx-rest]][[rest>>url:https://github.com/sdmx-twg/sdmx-rest]]__[[)>>url:https://github.com/sdmx-twg/sdmx-rest]]. In order for the architecture to be scalable, the finest-grained piece of structural metadata that can be processed by the SDMX-RR is a MaintainableArtefact, with the exception of Item Schemes, where changes at an Item level is also possible (see next section on the SDMX Information Model). 185 185 186 -=== 5.2.3 Structure Query Service === 188 +===== {{id name="_Toc90797"/}}5.2.3 Structure Query Service ===== 187 187 188 188 The registry must support a mechanism for querying for structural metadata. This mechanism can be the SDMX REST interface for structural metadata (this is defined in the corresponding GitHub project, dedicated to the SDMX REST API: __[[https:~~/~~/github.com/sdmx>>url:https://github.com/sdmx-twg/sdmx-rest]][[->>url:https://github.com/sdmx-twg/sdmx-rest]][[twg/sdmx>>url:https://github.com/sdmx-twg/sdmx-rest]][[->>url:https://github.com/sdmx-twg/sdmx-rest]][[rest>>url:https://github.com/sdmx-twg/sdmx-rest]]__[[)>>url:https://github.com/sdmx-twg/sdmx-rest]]. The registry response to this query mechanism is the SDMX Structure message, which has as its root node: 189 189 ... ... @@ -191,7 +191,7 @@ 191 191 192 192 The SDMX structural artefacts that may be queried are defined in the SDMX structure web service specification which is compatible with this release of the standard __[[https:~~/~~/github.com/sdmx>>url:https://github.com/sdmx-twg/sdmx-rest/blob/master/doc/structures.md]][[->>url:https://github.com/sdmx-twg/sdmx-rest/blob/master/doc/structures.md]][[twg/sdmx>>url:https://github.com/sdmx-twg/sdmx-rest/blob/master/doc/structures.md]][[->>url:https://github.com/sdmx-twg/sdmx-rest/blob/master/doc/structures.md]][[rest/blob/master/doc/structures.md>>url:https://github.com/sdmx-twg/sdmx-rest/blob/master/doc/structures.md]]__[[url:https://github.com/sdmx-twg/sdmx-rest/blob/master/doc/structures.md]] 193 193 194 -=== 5.2.4 Data and Reference Metadata Registration Service === 196 +===== {{id name="_Toc90798"/}}5.2.4 Data and Reference Metadata Registration Service ===== 195 195 196 196 This service must implement the following Registry Interfaces: 197 197 ... ... @@ -214,24 +214,23 @@ 214 214 215 215 The Registration has an action attribute which takes one of the following values: 216 216 217 -(% style="width:893.835px" %) 218 -|(% style="width:241px" %)**Action Attribute Value**|(% style="width:650px" %)**Behaviour** 219 -|(% style="width:241px" %)Append|(% style="width:650px" %)Add this registration to the registry 220 -|(% style="width:241px" %)Replace|(% style="width:650px" %)Replace the existing Registration with this Registration identified by the id in the Registration of the Submit Registration Request 221 -|(% style="width:241px" %)Delete|(% style="width:650px" %)Delete the existing Registration identified by the id in the Registration of the Submit Registration Request 219 +|**Action Attribute Value**|**Behaviour** 220 +|Append|Add this registration to the registry 221 +|Replace|Replace the existing Registration with this Registration identified by the id in the Registration of the Submit Registration Request 222 +|Delete|Delete the existing Registration identified by the id in the Registration of the Submit Registration Request 222 222 223 223 The Registration has three Boolean attributes which may be present to determine how an SDMX compliant dataset or metadataset indexing application must index the datasets or metadatasets upon registration. The indexing application behaviour is as follows: 224 224 225 -(% style="width:896.835px" %) 226 -|**Boolean Attribute**|(% style="width:712px" %)**Behaviour if Value is “true”** 227 -|indexTimeSeries|(% style="width:712px" %)A compliant indexing application must index all the time series keys 228 -|indexDataSet|(% style="width:712px" %)((( 226 +|**Boolean Attribute**|**Behaviour if Value is “true”** 227 +|indexTimeSeries|A compliant indexing application must index all the time series keys 228 +|indexDataSet|((( 229 229 A compliant indexing application must index the range of actual (present) values for each dimension of the Dataset. 230 + 230 230 Note that for data this requires much less storage than full key indexing, but this method cannot guarantee that a specific combination of Dimension values (the Key) is actually present in the Dataset 231 231 ))) 232 -|indexReportingPeriod| (% style="width:712px" %)A compliant indexing application must index the time period range(s) for which data are present in the Dataset.233 +|indexReportingPeriod|A compliant indexing application must index the time period range(s) for which data are present in the Dataset. 233 233 234 -=== 5.2.5 Data Discovery === 235 +===== {{id name="_Toc90799"/}}5.2.5 Data Discovery ===== 235 235 236 236 The Data Discovery Service implements the following Registry Interfaces: 237 237 ... ... @@ -238,7 +238,7 @@ 238 238 * QueryRegistrationRequest 239 239 * QueryRegistrationResponse 240 240 241 -=== 5.2.6 Subscription and Notification === 242 +===== {{id name="_Toc90800"/}}5.2.6 Subscription and Notification ===== 242 242 243 243 The Subscription and Notification Service implements the following Registry Interfaces: 244 244 ... ... @@ -257,7 +257,7 @@ 257 257 258 258 Notification requires that the structural metadata repository and the provisioning metadata repository monitor any event which is of interest to a user (the object of a subscription request query), and to issue an SDMX notification document to the endpoints specified in the relevant subscriptions. 259 259 260 -=== 5.2.7 Registry Behaviour === 261 +===== {{id name="_Toc90801"/}}5.2.7 Registry Behaviour ===== 261 261 262 262 The following table defines the behaviour of the SDMX Registry for the various Registry Interface messages. It should be noted, though, that as of SDMX 3.0, an extended versioning scheme newly including semantic versioning is foreseen for all Maintainable Artefacts. Moreover, while the old versioning scheme is allowed, given there is no more a "final" flag, there is no way guaranteeing the consistency across version of a Maintainable, unless semantic versioning is used. 263 263