Skip to Content

Changes for page 13 Data Provisioning

Last modified by Artur on 2025/09/10 11:19
From version 6.1
edited by Helena
on 2025/05/16 14:02
Change comment: There is no comment for this version
To version 7.2
edited by Helena
on 2025/05/19 13:49
Change comment: Update document after refactoring.

Summary

Details

Page properties
Parent
... ... @@ -1,0 +1,1 @@
1 +Methodology.SDMX STANDARDS\: SECTION 2\. INFORMATION MODEL\: UML CONCEPTUAL DESIGN Version 3\.0.WebHome
Content
... ... @@ -12,19 +12,19 @@
12 12  
13 13  === 13.2.1 Narrative ===
14 14  
15 -This sub model links many artefacts in the SDMX-IM and is pivotal to an SDMX metadata registry, as all of the artefacts in this sub model must be accessible to an application that is responsible for data and metadata registration or for an application that requires access to the data or metadata.
15 +This sub model links many [[artefacts>>doc:xwiki:Glossary.Artefact.WebHome]] in the [[SDMX-IM>>doc:xwiki:Glossary.SDMX Information Model.WebHome]] and is pivotal to an [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] metadata registry, as all of the [[artefacts>>doc:xwiki:Glossary.Artefact.WebHome]] in this sub model must be accessible to an application that is responsible for data and metadata registration or for an application that requires access to the data or metadata.
16 16  
17 -Whilst a registry contains all of the metadata depicted on the diagram above, the classes in the grey shaded area are specific to a registry-based scenario where data sources (either physical data and metadata sets or databases and metadata repositories) are registered. More details on how these classes are used in a registry scenario can be found in the SDMX Registry Interface document. (Section 5 of the SDMX Standards).
17 +Whilst a registry contains all of the metadata depicted on the diagram above, the classes in the grey shaded area are specific to a registry-based scenario where [[data sources>>doc:xwiki:Glossary.Data source.WebHome]] (either physical data and [[metadata sets>>doc:xwiki:Glossary.Metadata set.WebHome]] or databases and [[metadata repositories>>doc:xwiki:Glossary.Metadata repository.WebHome]]) are registered. More details on how these classes are used in a registry scenario can be found in the [[SDMX Registry>>doc:xwiki:Glossary.SDMX Registry.WebHome]] Interface document. (Section 5 of the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] Standards).
18 18  
19 -A ProvisionAgreement / MetadataProvisionAgreement links the artefact that defines how data / metadata are structured and classified (//StructureUsage//) to the DataProvider / MetadataProvider. By means of a data or metadata registration, it references the //Datasource// (this can be data or metadata), whether this be an SDMX conformant file on a website (SimpleDatasource) or a database service capable of supporting an SDMX query and responding with an SDMX conformant document (//QueryDatasource//).
19 +A ProvisionAgreement / MetadataProvisionAgreement links the [[artefact>>doc:xwiki:Glossary.Artefact.WebHome]] that defines how data / metadata are structured and classified (//StructureUsage//) to the DataProvider / MetadataProvider. By means of a data or metadata registration, it references the //Datasource// (this can be data or metadata), whether this be an [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] conformant file on a website (SimpleDatasource) or a database service capable of supporting an [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] query and responding with an [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] conformant document (//QueryDatasource//).
20 20  
21 -The //StructureUsage//, which has concrete classes of Dataflow and Metadataflow identifies the corresponding DataStructureDefinition or MetadataStructureDefinition, and, via Categorisation, can link to one or more Category(s) in a CategoryScheme such as a subject matter domain scheme, by which the //StructureUsage// can be classified. This can assist in drilling down from subject matter domains to find the data or metadata that may be relevant.
21 +The //StructureUsage//, which has concrete classes of [[Dataflow>>doc:xwiki:Glossary.Dataflow.WebHome]] and [[Metadataflow>>doc:xwiki:Glossary.Metadataflow.WebHome]] identifies the corresponding DataStructureDefinition or MetadataStructureDefinition, and, via Categorisation, can link to one or more Category(s) in a CategoryScheme such as a subject matter domain scheme, by which the //StructureUsage// can be classified. This can assist in drilling down from subject matter domains to find the data or metadata that may be relevant.
22 22  
23 -The SimpleDatasource links to the actual DataSet or MetadataSet on a website (this is shown on the diagram as a dependency called “references”). The sourceURL is obtained during the registration process of the DataSet or the MetadataSet. Additional information about the content of the SimpleDatasource is stored in the registry in terms of a //Constraint// (see 12.3) for the Registration.
23 +The SimpleDatasource links to the actual [[DataSet>>doc:xwiki:Glossary.Data set.WebHome]] or MetadataSet on a website (this is shown on the diagram as a dependency called “references”). The sourceURL is obtained during the registration process of the [[DataSet>>doc:xwiki:Glossary.Data set.WebHome]] or the MetadataSet. Additional information about the content of the SimpleDatasource is stored in the registry in terms of a (% style="color:#2ecc71" %)//Constraint//(%%) (see 12.3) for the Registration.
24 24  
25 -The //QueryDatasource// is an abstract class that represents a data source, which can understand an SDMX RESTful query (RESTDatasource) and respond appropriately. Each of these different //Datasource//s inherit the dataURL from //Datasource//, and the //QueryDatasource// has an additional URL, the specURL, to locate the specification of the service (i.e., the open API specification for RESTDatasource), which describes how to access it. All other supported protocols are assumed to use the SimpleDatasource URL.
25 +The //QueryDatasource// is an abstract class that represents a [[data source>>doc:xwiki:Glossary.Data source.WebHome]], which can understand an [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] RESTful query (RESTDatasource) and respond appropriately. Each of these different //Datasource//s inherit the dataURL from //Datasource//, and the //QueryDatasource// has an additional URL, the specURL, to locate the specification of the service (i.e., the open API specification for RESTDatasource), which describes how to access it. All other supported protocols are assumed to use the SimpleDatasource URL.
26 26  
27 -The diagram below shows in schematic way the essential navigation through the SDMX structural artefacts that eventually link to a data or metadata registration{{footnote}}Provider Scheme, Provider, Provision Agreement and Registered source refer both to data and reference metadata.{{/footnote}}.
27 +The diagram below shows in schematic way the essential navigation through the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] structural [[artefacts>>doc:xwiki:Glossary.Artefact.WebHome]] that eventually link to a data or metadata registration{{footnote}}Provider Scheme, Provider, Provision Agreement and Registered source refer both to data and reference metadata.{{/footnote}}.
28 28  
29 29  [[image:SDMX 3-0-0 SECTION 2 FINAL-1.0 (1)_en_39d2fe45.jpg||height="360" width="592"]]
30 30  
... ... @@ -40,32 +40,32 @@
40 40  Dataflow
41 41  Metadataflow
42 42  )))|(% style="width:508px" %)This is described in the Base.
43 -| |(% style="width:232px" %)controlledBy|(% style="width:508px" %)Association to the Provision Agreements that comprise the metadata related to the provision of data.
43 +| |(% style="width:232px" %)controlledBy|(% style="width:508px" %)Association to the [[Provision Agreements>>doc:xwiki:Glossary.Provision agreement.WebHome]] that comprise the metadata related to the provision of data.
44 44  |DataProvider|(% style="width:232px" %) |(% style="width:508px" %)See Organisation Scheme.
45 -| |(% style="width:232px" %)hasAgreement|(% style="width:508px" %)Association to the Provision Agreements for which the provider supplies data or metadata.
46 -| |(% style="width:232px" %)+source|(% style="width:508px" %)Association to a data source, which can process a data query.
45 +| |(% style="width:232px" %)hasAgreement|(% style="width:508px" %)Association to the [[Provision Agreements>>doc:xwiki:Glossary.Provision agreement.WebHome]] for which the provider supplies data or metadata.
46 +| |(% style="width:232px" %)+source|(% style="width:508px" %)Association to a [[data source>>doc:xwiki:Glossary.Data source.WebHome]], which can process a data query.
47 47  |MetadataProvider|(% style="width:232px" %) |(% style="width:508px" %)See Organisation Scheme.
48 -| |(% style="width:232px" %)hasAgreement|(% style="width:508px" %)Association to the Metadata Provision Agreements for which the provider supplies data or metadata.
48 +| |(% style="width:232px" %)hasAgreement|(% style="width:508px" %)Association to the Metadata [[Provision Agreements>>doc:xwiki:Glossary.Provision agreement.WebHome]] for which the provider supplies data or metadata.
49 49  | |(% style="width:232px" %)+source|(% style="width:508px" %)Association to a metadata source, which can process a metadata query.
50 -|ProvisionAgreement|(% style="width:232px" %) |(% style="width:508px" %)Links the Data Provider to the relevant Structure Usage (i.e., the Dataflow) for which the provider supplies data. The agreement may constrain the scope of the data that can be provided, by means of a DataConstraint.
51 -| |(% style="width:232px" %)+source|(% style="width:508px" %)Association to a data source, which can process a data query.
52 -|MetadataProvisionAgr eement|(% style="width:232px" %) |(% style="width:508px" %)Links the Metadata Provider to the relevant Structure Usage (i.e., the Metadataflow) for which the provider supplies metadata. The agreement may constrain the scope of the metadata that can be provided, by means of a MetadataConstraint.
53 -| |(% style="width:232px" %)+source|(% style="width:508px" %)Association to reference metadata source, which can process a metadata query.
50 +|ProvisionAgreement|(% style="width:232px" %) |(% style="width:508px" %)Links the [[Data Provider>>doc:xwiki:Glossary.Data provider.WebHome]] to the relevant Structure Usage (i.e., the [[Dataflow>>doc:xwiki:Glossary.Dataflow.WebHome]]) for which the provider supplies data. The agreement may constrain the scope of the data that can be provided, by means of a DataConstraint.
51 +| |(% style="width:232px" %)+source|(% style="width:508px" %)Association to a [[data source>>doc:xwiki:Glossary.Data source.WebHome]], which can process a data query.
52 +|MetadataProvisionAgreement|(% style="width:232px" %) |(% style="width:508px" %)Links the Metadata Provider to the relevant Structure Usage (i.e., the [[Metadataflow>>doc:xwiki:Glossary.Metadataflow.WebHome]]) for which the provider supplies metadata. The agreement may constrain the scope of the metadata that can be provided, by means of a MetadataConstraint.
53 +| |(% style="width:232px" %)+source|(% style="width:508px" %)Association to [[reference metadata>>doc:xwiki:Glossary.Reference metadata.WebHome]] source, which can process a metadata query.
54 54  |//Datasource//|(% style="width:232px" %)(((
55 55  Abstract class
56 56  Sub classes are: SimpleDatasource //QueryDatasource//
57 -)))|(% style="width:508px" %)Identification of the location or service from where data or reference metadata can be obtained.
58 -| |(% style="width:232px" %)+sourceURL|(% style="width:508px" %)The URL of the data or reference metadata source (a file or a web service).
59 -|SimpleDatasource|(% style="width:232px" %) |(% style="width:508px" %)An SDMX dataset / metadataset accessible as a file at a URL.
57 +)))|(% style="width:508px" %)Identification of the location or service from where data or [[reference metadata>>doc:xwiki:Glossary.Reference metadata.WebHome]] can be obtained.
58 +| |(% style="width:232px" %)+sourceURL|(% style="width:508px" %)The URL of the data or [[reference metadata>>doc:xwiki:Glossary.Reference metadata.WebHome]] source (a file or a web service).
59 +|SimpleDatasource|(% style="width:232px" %) |(% style="width:508px" %)An [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] dataset / metadataset accessible as a file at a URL.
60 60  |//QueryDatasource//|(% style="width:232px" %)(((
61 61  Abstract class Inherits from:
62 62  //Datasource//
63 63  Sub classes are:
64 64  RESTDatasource
65 -)))|(% style="width:508px" %)A data or reference metadata source, which can process a data or metadata query.
66 -|RESTDatasource|(% style="width:232px" %) |(% style="width:508px" %)A data or reference metadata source that is accessible via a RESTful web services interface.
65 +)))|(% style="width:508px" %)A data or [[reference metadata>>doc:xwiki:Glossary.Reference metadata.WebHome]] source, which can process a data or metadata query.
66 +|RESTDatasource|(% style="width:232px" %) |(% style="width:508px" %)A data or [[reference metadata>>doc:xwiki:Glossary.Reference metadata.WebHome]] source that is accessible via a RESTful web services interface.
67 67  | |(% style="width:232px" %)+specificationURL|(% style="width:508px" %)Association to the URL for the specification of the web service.
68 -|Registration|(% style="width:232px" %) |(% style="width:508px" %)This is not detailed here but is shown as the link between the SDMX-IM and the Registry Service API. It denotes a data or metadata registration document.
68 +|Registration|(% style="width:232px" %) |(% style="width:508px" %)This is not detailed here but is shown as the link between the [[SDMX-IM>>doc:xwiki:Glossary.SDMX Information Model.WebHome]] and the Registry Service API. It denotes a data or metadata registration document.
69 69  
70 70  ----
71 71