Last modified by Artur on 2025/09/30 13:28
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -31,15 +31,13 @@ 31 31 32 32 These architectural standards address the ‘how’, rather than the ‘what’, and are aimed at enabling existing SDMX standards to achieve their mission. The architectural standards address registry services, which initially comprise: 33 33 34 -• structural metadata repository 34 +* structural metadata repository 35 +* data and metadata registration 36 +* query 35 35 36 -• data and metadata registration 37 - 38 -• query 39 - 40 40 The registry services outlined in this specification are designed to help the SDMX community manage the proliferation of SDMX assets and to support data sharing for reporting and dissemination. 41 41 42 -= {{id name="_Toc90781"/}}2 Scope and Normative Status =40 += 2 Scope and Normative Status = 43 43 44 44 The scope of this document is to specify the logical interfaces for the SDMX registry in terms of the functions required and the data that may be present in the function call, and the behaviour expected of the registry. 45 45 ... ... @@ -56,9 +56,9 @@ 56 56 57 57 Note that although the term “authorised user” is used in this document, the SDMX standards do not define an access control mechanism. Such a mechanism, if required, must be chosen and implemented by the registry software provider. 58 58 59 -= {{id name="_Toc90782"/}}3 Scope of the SDMX Registry/Repository =57 += 3 Scope of the SDMX Registry/Repository = 60 60 61 -== ={{id name="_Toc90783"/}}3.1 Objective ===59 +== 3.1 Objective == 62 62 63 63 The objective of the SDMX registry/repository is, in broad terms, to allow organisations to publish statistical data and reference metadata in known formats such that interested third parties can discover these data and interpret them accurately and correctly. The mechanism for doing this is twofold: 64 64 ... ... @@ -65,7 +65,7 @@ 65 65 1. To maintain and publish structural metadata that describes the structure and valid content of data and reference metadata sources such as databases, metadata repositories, data sets, metadata sets. This structural metadata enables software applications to understand and to interpret the data and reference metadata in these sources. 66 66 1. To enable applications, organisations, and individuals to share and to discover data and reference metadata. This facilitates data and reference metadata dissemination by implementing the data sharing vision of SDMX. 67 67 68 -== ={{id name="_Toc90784"/}}3.2 Structural Metadata ===66 +== 3.2 Structural Metadata == 69 69 70 70 Setting up structural metadata and the exchange context (referred to as “data provisioning”) involves the following steps for maintenance agencies: 71 71 ... ... @@ -91,7 +91,7 @@ 91 91 92 92 In that context, the term “Metadata” refers to reference metadata. 93 93 94 -== ={{id name="_Toc90785"/}}3.3 Registration ===92 +== 3.3 Registration == 95 95 96 96 Publishing the data and reference metadata involves the following steps for a Data/Metadata Provider: 97 97 ... ... @@ -102,13 +102,13 @@ 102 102 103 103 **Figure 2: Schematic of Registered Data and Metadata Sources in the SDMX-IM** 104 104 105 -== ={{id name="_Toc90786"/}}3.4 Notification ===103 +== 3.4 Notification == 106 106 107 107 Notifying interested parties of newly published or re-published data, reference metadata or changes in structural metadata involves: 108 108 109 109 • registry support of a subscription-based notification service which sends an email or notifies an HTTP address announcing all published data that meets the criteria contained in the subscription request. 110 110 111 -== ={{id name="_Toc90787"/}}3.5 Discovery ===109 +== 3.5 Discovery == 112 112 113 113 Discovering published data and reference metadata involves interaction with the registry to fulfil the following logical steps that would be carried out by a user interacting with a service that itself interacts with the registry and an SDMX-enabled data or reference metadata resource: 114 114 ... ... @@ -120,9 +120,9 @@ 120 120 121 121 **Figure 3: Schematic of Data and Metadata Discovery and Query in the SDMX-IM** 122 122 123 -= {{id name="_Toc90788"/}}4 SDMX Registry/Repository Architecture =121 += 4 SDMX Registry/Repository Architecture = 124 124 125 -== ={{id name="_Toc90789"/}}4.1 Architectural Schematic ===123 +== 4.1 Architectural Schematic == 126 126 127 127 The architecture of the SDMX registry/repository is derived from the objectives stated above. It is a layered architecture that is founded by a structural metadata repository which supports a provisioning metadata repository which supports the registry services. These are all supported by the SDMX-ML schemas. Applications can be built on top of these services which support the reporting, storage, retrieval, and dissemination aspects of the statistical lifecycle as well as the maintenance of the structural metadata required to drive these applications. 128 128 ... ... @@ -130,7 +130,7 @@ 130 130 131 131 **Figure 4: Schematic of the Registry Content and Services** 132 132 133 -== ={{id name="_Toc90790"/}}4.2 Structural Metadata Repository ===131 +== 4.2 Structural Metadata Repository == 134 134 135 135 The basic layer is that of a structural metadata service which supports the lifecycle of SDMX structural metadata artefacts such as Maintenance Agencies, Data Structure Definitions, Metadata Structure Definitions, Provision Agreements, Processes etc. This layer is supported by the Structure Submission and Query Service. 136 136 ... ... @@ -141,15 +141,15 @@ 141 141 142 142 As of the initial version of SDMX 3.0 no messages are defined to support these artefacts; hence, users may need to use SDMX 2.1 Registry Interface messages, instead. 143 143 144 -== ={{id name="_Toc90791"/}}4.3 Provisioning Metadata Repository ===142 +== 4.3 Provisioning Metadata Repository == 145 145 146 146 The function of this repository is to support the definition of the structural metadata that describes the various types of data-store which model SDMX-conformant databases or files, and to link to these data sources. These links can be specified for a data/metadata provider, for a specific data or metadata flow. In the SDMX model this is called the Provision or Metadata Provision Agreement. 147 147 148 148 This layer is supported by the Data and Metadata Registration Service. 149 149 150 -= {{id name="_Toc90792"/}}5 Registry Interfaces and Services =148 += 5 Registry Interfaces and Services = 151 151 152 -== ={{id name="_Toc90793"/}}5.1 Registry Interfaces ===150 +== 5.1 Registry Interfaces == 153 153 154 154 The Registry Interfaces are: 155 155 ... ... @@ -175,17 +175,17 @@ 175 175 176 176 It should be noted that all interactions are assumed to be synchronous, with the exception of Notify Registry Event. This document is sent by the SDMX-RR to all subscribers whenever an even occurs to which any users have subscribed. Thus, it does not conform to the requestresponse pattern, because it is inherently asynchronous. 177 177 178 -== ={{id name="_Toc90794"/}}5.2 Registry Services ===176 +== 5.2 Registry Services == 179 179 180 -=== =={{id name="_Toc90795"/}}5.2.1 Introduction =====178 +=== 5.2.1 Introduction === 181 181 182 182 The services described in this section do not imply that each is implemented as a discrete web service. 183 183 184 -=== =={{id name="_Toc90796"/}}5.2.2 Structure Submission Service =====182 +=== 5.2.2 Structure Submission Service === 185 185 186 186 The registry must support a mechanism for submitting structural metadata. This mechanism can be the SDMX REST interface for structural metadata (this is defined in the corresponding GitHub project, dedicated to the SDMX REST API: __[[https:~~/~~/github.com/sdmx>>url:https://github.com/sdmx-twg/sdmx-rest]][[->>url:https://github.com/sdmx-twg/sdmx-rest]][[twg/sdmx>>url:https://github.com/sdmx-twg/sdmx-rest]][[->>url:https://github.com/sdmx-twg/sdmx-rest]][[rest>>url:https://github.com/sdmx-twg/sdmx-rest]]__[[)>>url:https://github.com/sdmx-twg/sdmx-rest]]. In order for the architecture to be scalable, the finest-grained piece of structural metadata that can be processed by the SDMX-RR is a MaintainableArtefact, with the exception of Item Schemes, where changes at an Item level is also possible (see next section on the SDMX Information Model). 187 187 188 -=== =={{id name="_Toc90797"/}}5.2.3 Structure Query Service =====186 +=== 5.2.3 Structure Query Service === 189 189 190 190 The registry must support a mechanism for querying for structural metadata. This mechanism can be the SDMX REST interface for structural metadata (this is defined in the corresponding GitHub project, dedicated to the SDMX REST API: __[[https:~~/~~/github.com/sdmx>>url:https://github.com/sdmx-twg/sdmx-rest]][[->>url:https://github.com/sdmx-twg/sdmx-rest]][[twg/sdmx>>url:https://github.com/sdmx-twg/sdmx-rest]][[->>url:https://github.com/sdmx-twg/sdmx-rest]][[rest>>url:https://github.com/sdmx-twg/sdmx-rest]]__[[)>>url:https://github.com/sdmx-twg/sdmx-rest]]. The registry response to this query mechanism is the SDMX Structure message, which has as its root node: 191 191 ... ... @@ -193,7 +193,7 @@ 193 193 194 194 The SDMX structural artefacts that may be queried are defined in the SDMX structure web service specification which is compatible with this release of the standard __[[https:~~/~~/github.com/sdmx>>url:https://github.com/sdmx-twg/sdmx-rest/blob/master/doc/structures.md]][[->>url:https://github.com/sdmx-twg/sdmx-rest/blob/master/doc/structures.md]][[twg/sdmx>>url:https://github.com/sdmx-twg/sdmx-rest/blob/master/doc/structures.md]][[->>url:https://github.com/sdmx-twg/sdmx-rest/blob/master/doc/structures.md]][[rest/blob/master/doc/structures.md>>url:https://github.com/sdmx-twg/sdmx-rest/blob/master/doc/structures.md]]__[[url:https://github.com/sdmx-twg/sdmx-rest/blob/master/doc/structures.md]] 195 195 196 -=== =={{id name="_Toc90798"/}}5.2.4 Data and Reference Metadata Registration Service =====194 +=== 5.2.4 Data and Reference Metadata Registration Service === 197 197 198 198 This service must implement the following Registry Interfaces: 199 199 ... ... @@ -216,23 +216,24 @@ 216 216 217 217 The Registration has an action attribute which takes one of the following values: 218 218 219 -|**Action Attribute Value**|**Behaviour** 220 -|Append|Add this registration to the registry 221 -|Replace|Replace the existing Registration with this Registration identified by the id in the Registration of the Submit Registration Request 222 -|Delete|Delete the existing Registration identified by the id in the Registration of the Submit Registration Request 217 +(% style="width:893.835px" %) 218 +|(% style="width:241px" %)**Action Attribute Value**|(% style="width:650px" %)**Behaviour** 219 +|(% style="width:241px" %)Append|(% style="width:650px" %)Add this registration to the registry 220 +|(% style="width:241px" %)Replace|(% style="width:650px" %)Replace the existing Registration with this Registration identified by the id in the Registration of the Submit Registration Request 221 +|(% style="width:241px" %)Delete|(% style="width:650px" %)Delete the existing Registration identified by the id in the Registration of the Submit Registration Request 223 223 224 224 The Registration has three Boolean attributes which may be present to determine how an SDMX compliant dataset or metadataset indexing application must index the datasets or metadatasets upon registration. The indexing application behaviour is as follows: 225 225 226 -|**Boolean Attribute**|**Behaviour if Value is “true”** 227 -|indexTimeSeries|A compliant indexing application must index all the time series keys 228 -|indexDataSet|((( 225 +(% style="width:896.835px" %) 226 +|**Boolean Attribute**|(% style="width:712px" %)**Behaviour if Value is “true”** 227 +|indexTimeSeries|(% style="width:712px" %)A compliant indexing application must index all the time series keys 228 +|indexDataSet|(% style="width:712px" %)((( 229 229 A compliant indexing application must index the range of actual (present) values for each dimension of the Dataset. 230 - 231 231 Note that for data this requires much less storage than full key indexing, but this method cannot guarantee that a specific combination of Dimension values (the Key) is actually present in the Dataset 232 232 ))) 233 -|indexReportingPeriod|A compliant indexing application must index the time period range(s) for which data are present in the Dataset. 232 +|indexReportingPeriod|(% style="width:712px" %)A compliant indexing application must index the time period range(s) for which data are present in the Dataset. 234 234 235 -=== =={{id name="_Toc90799"/}}5.2.5 Data Discovery =====234 +=== 5.2.5 Data Discovery === 236 236 237 237 The Data Discovery Service implements the following Registry Interfaces: 238 238 ... ... @@ -239,7 +239,7 @@ 239 239 * QueryRegistrationRequest 240 240 * QueryRegistrationResponse 241 241 242 -=== =={{id name="_Toc90800"/}}5.2.6 Subscription and Notification =====241 +=== 5.2.6 Subscription and Notification === 243 243 244 244 The Subscription and Notification Service implements the following Registry Interfaces: 245 245 ... ... @@ -258,7 +258,7 @@ 258 258 259 259 Notification requires that the structural metadata repository and the provisioning metadata repository monitor any event which is of interest to a user (the object of a subscription request query), and to issue an SDMX notification document to the endpoints specified in the relevant subscriptions. 260 260 261 -=== =={{id name="_Toc90801"/}}5.2.7 Registry Behaviour =====260 +=== 5.2.7 Registry Behaviour === 262 262 263 263 The following table defines the behaviour of the SDMX Registry for the various Registry Interface messages. It should be noted, though, that as of SDMX 3.0, an extended versioning scheme newly including semantic versioning is foreseen for all Maintainable Artefacts. Moreover, while the old versioning scheme is allowed, given there is no more a "final" flag, there is no way guaranteeing the consistency across version of a Maintainable, unless semantic versioning is used. 264 264