Skip to Content

Changes for page 11 Data Provisioning

Last modified by Artur on 2025/09/10 11:19
From version 11.2
edited by Elena
on 2025/06/17 15:40
Change comment: There is no comment for this version
To version 8.1
edited by Artur
on 2025/05/22 14:49
Change comment: There is no comment for this version

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -xwiki:XWiki.elenasemanticproorg
1 +xwiki:XWiki.arturkryazhev
Tags
... ... @@ -1,1 +1,0 @@
1 -Artefact|Category|Data provider|Data set|Data source|Dataflow|Metadata repository|Metadata set|Metadataflow|Provision agreement|Reference metadata|SDMX Information Model|SDMX Registry|SDMX-ML|Statistical data and metadata exchange|Structural metadata
Content
... ... @@ -12,23 +12,23 @@
12 12  
13 13  === {{id name="_Toc371073"/}}11.2.1 Narrative ===
14 14  
15 -This sub model links many [[artefacts>>doc:sdmx:Glossary.Artefact.WebHome]] in the [[SDMX-IM>>doc:sdmx:Glossary.SDMX Information Model.WebHome]] and is pivotal to an [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] metadata registry, as all of the [[artefacts>>doc:sdmx:Glossary.Artefact.WebHome]] in this sub model must be accessible to an application that is responsible for data and metadata registration or for an application that requires access to the data or metadata.
15 +This sub model links many artefacts in the SDMX-IM and is pivotal to an SDMX metadata registry, as all of the artefacts in this sub model must be accessible to an application that is responsible for data and metadata registration or for an application that requires access to the data or metadata.
16 16  
17 -Whilst a registry contains all of the metadata depicted on the diagram above, the classes in the grey shaded area are specific to a registry based scenario where [[data sources>>doc:sdmx:Glossary.Data source.WebHome]] (either physical data and [[metadata sets>>doc:sdmx:Glossary.Metadata set.WebHome]] or databases and [[metadata repositories>>doc:sdmx:Glossary.Metadata repository.WebHome]]) are registered. More details on how these classes are used in a registry scenario can be found in the [[SDMX Registry>>doc:sdmx:Glossary.SDMX Registry.WebHome]] Interface document. (Section 5 of the [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] Standards).
17 +Whilst a registry contains all of the metadata depicted on the diagram above, the classes in the grey shaded area are specific to a registry based scenario where data sources (either physical data and metadata sets or databases and metadata repositories) are registered. More details on how these classes are used in a registry scenario can be found in the SDMX Registry Interface document. (Section 5 of the SDMX Standards).
18 18  
19 -A ProvisionAgreement links the [[artefact>>doc:sdmx:Glossary.Artefact.WebHome]] that defines how data and metadata are structured and classified (//StructureUsage//) to the DataProvider, and, by means of a data or metadata registration, it references the Datasource (this can be data or metadata), whether this be an [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] conformant file on a website (SimpleDatasource) or a database service capable of supporting an [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] query and responding with an [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] conformant document (//QueryDatasource//).
19 +A ProvisionAgreement links the artefact that defines how data and metadata are structured and classified (//StructureUsage//) to the DataProvider, and, by means of a data or metadata registration, it references the Datasource (this can be data or metadata), whether this be an SDMX conformant file on a website (SimpleDatasource) or a database service capable of supporting an SDMX query and responding with an SDMX conformant document (//QueryDatasource//).
20 20  
21 -The //StructureUsage//, which has concrete classes of DataflowDefinition and MetadataflowDefinition identifies the corresponding DataStructureDefinition or MetadataStructureDefinition, and, via Categorisation, can link to one or more [[Category>>doc:sdmx:Glossary.Category.WebHome]] in a CategoryScheme such as a subject matter domain scheme, by which the //StructureUsage// can be classified. This can assist in drilling down from subject matter domains to find the data or metadata that may be relevant.
21 +The //StructureUsage//, which has concrete classes of DataflowDefinition and MetadataflowDefinition identifies the corresponding DataStructureDefinition or MetadataStructureDefinition, and, via Categorisation, can link to one or more Category in a CategoryScheme such as a subject matter domain scheme, by which the //StructureUsage// can be classified. This can assist in drilling down from subject matter domains to find the data or metadata that may be relevant.
22 22  
23 -The SimpleDatasource links to the actual [[DataSet>>doc:sdmx:Glossary.Data set.WebHome]] or MetadataSet on a website (this is shown on the diagram as a dependency called “references”). The sourceURL is obtained during the registration process of the [[DataSet>>doc:sdmx:Glossary.Data set.WebHome]] or the MetadataSet. Additional information about the content of the SimpleDatasource is stored in the registry in terms of a ContentConstraint (see 10.3) for the Registration.
23 +The SimpleDatasource links to the actual DataSet or MetadataSet on a website (this is shown on the diagram as a dependency called “references”). The sourceURL is obtained during the registration process of the DataSet or the MetadataSet. Additional information about the content of the SimpleDatasource is stored in the registry in terms of a ContentConstraint (see 10.3) for the Registration.
24 24  
25 -The QueryDatasource is an abstract class that represents a [[data source>>doc:sdmx:Glossary.Data source.WebHome]] which can understand an [[SDMX-ML>>doc:sdmx:Glossary.SDMX-ML.WebHome]] query (SOAPDatasource) or RESTful query (RESTDatasource) and respond appropriately. Each of these different Datasources inherit the dataURL from Datasource, and the QueryDatasource has an additional URL to locate a WSDL or WADL document to describe how to access it. All other supported protocols are assumed to use the SimpleDatasource URL.
25 +The QueryDatasource is an abstract class that represents a data source which can understand an SDMX-ML query (SOAPDatasource) or RESTful query (RESTDatasource) and respond appropriately. Each of these different Datasources inherit the dataURL from Datasource, and the QueryDatasource has an additional URL to locate a WSDL or WADL document to describe how to access it. All other supported protocols are assumed to use the SimpleDatasource URL.
26 26  
27 -The diagram below shows in schematic way the essential navigation through the [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] structural [[artefacts>>doc:sdmx:Glossary.Artefact.WebHome]] that eventually link to a data or metadata registration.
27 +The diagram below shows in schematic way the essential navigation through the SDMX structural artefacts that eventually link to a data or metadata registration.
28 28  
29 29  [[image:SDMX_2-1_SECTION_2_InformationModel_2020-07_c6141d32.jpg||height="416" width="554"]]
30 30  
31 -**Figure 42: Schematic of the linking of [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]] to data and metadata registration**
31 +**Figure 42: Schematic of the linking of structural metadata to data and metadata registration**
32 32  
33 33  === {{id name="_Toc371074"/}}11.2.2 Definitions ===
34 34  
... ... @@ -41,12 +41,12 @@
41 41  DataflowDefinition
42 42  MetadataflowDefinition
43 43  )))|(% style="width:634px" %)This is described in the Base.
44 -|(% style="width:227px" %) |(% style="width:271px" %)controlledBy|(% style="width:634px" %)Association to the [[Provision Agreements>>doc:sdmx:Glossary.Provision agreement.WebHome]] that comprise the metadata related to the provision of data.
44 +|(% style="width:227px" %) |(% style="width:271px" %)controlledBy|(% style="width:634px" %)Association to the Provision Agreements that comprise the metadata related to the provision of data.
45 45  |(% style="width:227px" %)DataProvider|(% style="width:271px" %) |(% style="width:634px" %)See Organisation Scheme.
46 -|(% style="width:227px" %) |(% style="width:271px" %)hasAgreement|(% style="width:634px" %)Association to the [[Provision Agreements>>doc:sdmx:Glossary.Provision agreement.WebHome]] for which the provider supplies data or metadata.
46 +|(% style="width:227px" %) |(% style="width:271px" %)hasAgreement|(% style="width:634px" %)Association to the Provision Agreements for which the provider supplies data or metadata.
47 47  |(% style="width:227px" %) |(% style="width:271px" %)+source|(% style="width:634px" %)Association to a data or metadata source which can process a data or metadata query.
48 -|(% style="width:227px" %)ProvisionAgreement|(% style="width:271px" %) |(% style="width:634px" %)Links the [[Data Provider>>doc:sdmx:Glossary.Data provider.WebHome]] to the relevant Structure Usage (e.g. [[Dataflow>>doc:sdmx:Glossary.Dataflow.WebHome]] Definition or [[Metadataflow>>doc:sdmx:Glossary.Metadataflow.WebHome]] Definition) for which the provider supplies data or metadata The agreement may constrain the scope of the data or metadata that can be provided, by means of a Constraint.
49 -|(% style="width:227px" %) |(% style="width:271px" %)+source|(% style="width:634px" %)Association to a data or [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] source which can process a data or metadata query.
48 +|(% style="width:227px" %)ProvisionAgreement|(% style="width:271px" %) |(% style="width:634px" %)Links the Data Provider to the relevant Structure Usage (e.g. Dataflow Definition or Metadataflow Definition) for which the provider supplies data or metadata The agreement may constrain the scope of the data or metadata that can be provided, by means of a Constraint.
49 +|(% style="width:227px" %) |(% style="width:271px" %)+source|(% style="width:634px" %)Association to a data or reference metadata source which can process a data or metadata query.
50 50  |(% style="width:227px" %)//Datasource//|(% style="width:271px" %)(((
51 51  Abstract class:
52 52  Sub classes are:
... ... @@ -53,9 +53,9 @@
53 53  SimpleDatasource
54 54  //WebServices
55 55  Datasource//
56 -)))|(% style="width:634px" %)Identification of the location or service from where data or [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] can be obtained.
57 -|(% style="width:227px" %) |(% style="width:271px" %)+sourceURL|(% style="width:634px" %)The URL of the data or [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] source (a file or a web service).
58 -|(% style="width:227px" %)SimpleDatasource|(% style="width:271px" %) |(% style="width:634px" %)An [[SDMX-ML>>doc:sdmx:Glossary.SDMX-ML.WebHome]] [[data set>>doc:sdmx:Glossary.Data set.WebHome]] accessible as a file at a URL.
56 +)))|(% style="width:634px" %)Identification of the location or service from where data or reference metadata can be obtained.
57 +|(% style="width:227px" %) |(% style="width:271px" %)+sourceURL|(% style="width:634px" %)The URL of the data or reference metadata source (a file or a web service).
58 +|(% style="width:227px" %)SimpleDatasource|(% style="width:271px" %) |(% style="width:634px" %)An SDMX-ML data set accessible as a file at a URL.
59 59  |(% style="width:227px" %)//WebServices Datasource//|(% style="width:271px" %)(((
60 60  Abstract class:
61 61  Inherits from:
... ... @@ -63,9 +63,13 @@
63 63  Sub classes are:
64 64  RESTDatasource
65 65  SOAPDatasource
66 -)))|(% style="width:634px" %)A data or [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] source which can process a data or metadata query.
67 -|(% style="width:227px" %)RESTDatasource|(% style="width:271px" %) |(% style="width:634px" %)A data or [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] source that is accessible via a RESTful web services interface.
68 -|(% style="width:227px" %) |(% style="width:271px" %) |(% style="width:634px" %)A data or [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] source that conforms to a SOAP web service interface.
69 -|(% style="width:227px" %)SOAPDatasource|(% style="width:271px" %)+WSDLURL|(% style="width:634px" %)Association to the URL of the Web Service Definition Language (SOAP) or Web Service Application Language (REST) profile of the web service.
70 -|(% style="width:227px" %)Registration|(% style="width:271px" %) |(% style="width:634px" %)This is not detailed here but is shown as the link between the [[SDMX-IM>>doc:sdmx:Glossary.SDMX Information Model.WebHome]] and the Registry Service API. It denotes a data or metadata registration document.
66 +)))|(% style="width:634px" %)A data or reference metadata source which can process a data or metadata query.
71 71  )))
68 +
69 +(% style="width:1172.29px" %)
70 +|(% style="width:235px" %)RESTDatasource|(% style="width:281px" %) |(% style="width:653px" %)A data or reference metadata source that is accessible via a RESTful web services interface.
71 +|(% style="width:235px" %)SOAPDatasource|(% style="width:281px" %) |(% style="width:653px" %)A data or reference metadata source that conforms to a SOAP web service interface.
72 +|(% style="width:235px" %) |(% style="width:281px" %)+WSDLURL|(% style="width:653px" %)(((
73 +Association to the URL of the Web Service Definition Language (SOAP) or Web Service Application Language (REST) profile of the web service.
74 +)))
75 +|(% style="width:235px" %)Registration|(% style="width:281px" %) |(% style="width:653px" %)This is not detailed here but is shown as the link between the SDMX-IM and the Registry Service API. It denotes a data or metadata registration document.