Skip to Content

Changes for page 10 Community Management

Last modified by Artur on 2025/09/10 11:19
From version 1.1
edited by Artur
on 2025/04/21 12:12
Change comment: Imported from XAR
To version 4.1
edited by Artur
on 2025/05/27 15:51
Change comment: There is no comment for this version

Summary

Details

Page properties
Parent
... ... @@ -1,1 +1,1 @@
1 -Methodology.SDMX 2\.1 User Guide.WebHome
1 +WebHome
Content
... ... @@ -4,43 +4,41 @@
4 4  
5 5  == 10.1 Scope of this Chapter ==
6 6  
7 -Many organizations have a community of data reporters, data sharing agencies, or data consumers. This places responsibilities upon the organization in terms of publishing and dissemination of structural metadata, setting up hubs for data sharing, administration of maintenance agencies, usernames etc.
7 +Many organizations have a community of data reporters, data sharing agencies, or [[data consumers>>doc:sdmx:Glossary.Data consumer.WebHome]]. This places responsibilities upon the organization in terms of publishing and dissemination of [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]], setting up [[hubs>>doc:sdmx:Glossary.Hub (dissemination architecture).WebHome]] for data sharing, administration of [[maintenance agencies>>doc:sdmx:Glossary.Maintenance agency.WebHome]], usernames etc.
8 8  
9 9  These aspects are dealt with in this Chapter.
10 10  
11 11  == 10.2 Maintenance Agency Maintenance ==
12 12  
13 -All structural metadata in SDMX is owned and maintained by a maintenance agency (Agency identified by agencyID in the schemas). It is vital to the integrity of the structural metadata that there are no conflicts in agencyID.
13 +All [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]] in [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] is owned and maintained by a [[maintenance agency>>doc:sdmx:Glossary.Maintenance agency.WebHome]] (Agency identified by agencyID in the schemas). It is vital to the integrity of the [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]] that there are no conflicts in agencyID.
14 14  
15 -The maintenance of maintenance agencies in SDMX is a devolved function. Any organization registered as a maintenance agency can itself set up and maintain its own maintenance agencies. However, in order for this devolved system to work there must be a “top-level” maintenance agency list (called an Agency Scheme in SDMX) which is itself maintained by the recognized top-level Agency. This Agency is SDMX. Any organization registered in the SDMX Agency Scheme can itself maintain its own Agency Scheme of sub-agencies. Only one such Agency Scheme is allowed for any recognized Agency. With the exception of the “SDMX” Agency, a recognized Agency must itself be registered in a “parent” Agency Scheme.
15 +The maintenance of [[maintenance agencies>>doc:sdmx:Glossary.Maintenance agency.WebHome]] in [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] is a devolved function. Any organization registered as a [[maintenance agency>>doc:sdmx:Glossary.Maintenance agency.WebHome]] can itself set up and maintain its own [[maintenance agencies>>doc:sdmx:Glossary.Maintenance agency.WebHome]]. However, in order for this devolved system to work there must be a “top-(% style="color:#e74c3c" %)level(%%)” [[maintenance agency>>doc:sdmx:Glossary.Maintenance agency.WebHome]] list (called an [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]] in [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]]) which is itself maintained by the recognized top-(% style="color:#e74c3c" %)level(%%) Agency. This Agency is [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]]. Any organization registered in the [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]] can itself maintain its own [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]] of sub-agencies. Only one such [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]] is allowed for any recognized Agency. With the exception of the “[[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]]” Agency, a recognized Agency must itself be registered in a “parent” [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]].
16 16  
17 -The following rules are a more formal definition of the way the SDMX agency system works:
17 +The following rules are a more formal definition of the way the [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] agency system works:
18 18  
19 -1. Agencies are maintained in an Agency Scheme.
20 -1. The maintenance agency of the Agency Scheme must be registered as an Agency in a (different) Agency Scheme (the “parent” Agency Scheme).
21 -1. The “top-level” agency is SDMX and this agency scheme is maintained by SDMX.
22 -1. Agencies registered in the top-level scheme can themselves maintain a single Agency Scheme. SDMX is an agency in the SDMX agency scheme, thus allowing SDMX be a maintenance agency. Agencies in this (child) scheme can themselves maintain a single Agency Scheme and so on.
23 -1. The Agency Scheme cannot be versioned and so takes a default version number of 1.0, and it cannot be made “final”.
24 -1. There can be only one Agency Scheme maintained by any one Agency. It has a fixed Id of AGENCIES.
25 -1. The format of the agency identifier is agencyId.agencyID etc. The top-level agency in this identification mechanism is the agency registered in the SDMX agency scheme. In other words, SDMX is not a part of the hierarchical ID structure for agencies.
26 -1. SDMX is, itself, a maintenance agency.
19 +1. Agencies are maintained in an [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]].
20 +1. The [[maintenance agency>>doc:sdmx:Glossary.Maintenance agency.WebHome]] of the [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]] must be registered as an Agency in a (different) [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]] (the “parent” [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]]).
21 +1. The “top-(% style="color:#e74c3c" %)level(%%)” agency is [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] and this [[agency scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]] is maintained by [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]].
22 +1. Agencies registered in the top-(% style="color:#e74c3c" %)level(%%) scheme can themselves maintain a single [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]]. [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] is an agency in the [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] [[agency scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]], thus allowing [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] be a [[maintenance agency>>doc:sdmx:Glossary.Maintenance agency.WebHome]]. Agencies in this (child) scheme can themselves maintain a single [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]] and so on.
23 +1. The [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]] cannot be versioned and so takes a default (% style="color:#e74c3c" %)version(%%) number of 1.0, and it cannot be made “final”.
24 +1. There can be only one [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]] maintained by any one Agency. It has a fixed Id of AGENCIES.
25 +1. The format of the agency identifier is agencyId.agencyID etc. The top-(% style="color:#e74c3c" %)level(%%) agency in this identification mechanism is the agency registered in the [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] [[agency scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]]. In other words, [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] is not a part of the hierarchical ID structure for agencies.
26 +1. [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] is, itself, a [[maintenance agency>>doc:sdmx:Glossary.Maintenance agency.WebHome]].
27 27  
28 28  This supports a hierarchical structure of agencyID.
29 29  
30 30  An example is shown below.
31 31  
32 -(% style="text-align: center;" %)
33 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_cf0235008d0d8c4c.jpg||height="294" width="373"]]
32 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_cf0235008d0d8c4c.jpg||data-xwiki-image-style-alignment="center" height="294" width="373"]]
34 34  
35 35  (% style="text-align: center;" %)
36 36  **{{id name="image_29"/}}Figure 29:Example of Hierarchic Structure of Agencies**
37 37  
38 -Each agency is identified by its full hierarchy excluding SDMX.
37 +Each agency is identified by its full [[hierarchy>>doc:sdmx:Glossary.Hierarchy.WebHome]] excluding [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]].
39 39  
40 40  The XML representing this structure is shown below.
41 41  
42 -(% style="text-align: center;" %)
43 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_8f57e83ccb4d76c1.jpg||height="634" width="411"]]
41 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_8f57e83ccb4d76c1.jpg||data-xwiki-image-style-alignment="center" height="634" width="411"]]
44 44  
45 45  (% style="text-align: center;" %)
46 46  **{{id name="image_30"/}}Figure 30: Example Agency Schemes Showing a Hierarchy**
... ... @@ -47,18 +47,16 @@
47 47  
48 48  __Example of Structure Definitions:__
49 49  
50 -(% style="text-align: center;" %)
51 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_ced0c4e613850a25.jpg||height="251" width="433"]]
48 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_ced0c4e613850a25.jpg||data-xwiki-image-style-alignment="center" height="251" width="433"]]
52 52  
53 53  (% style="text-align: center;" %)
54 54  **{{id name="image_31"/}}Figure 31: Example Showing Use of Agency Identifiers**
55 55  
56 -Each of these maintenance agencies has an identical Codelist with the Id CL_BOP. However, each is uniquely identified by means of the hierarchic agency structure.
53 +Each of these [[maintenance agencies>>doc:sdmx:Glossary.Maintenance agency.WebHome]] has an identical Codelist with the Id CL_BOP. However, each is uniquely identified by means of the hierarchic agency structure.
57 57  
58 -Clearly, in order for such a system to work there must be a mechanism that enables a user or organisation to discover the full “list” of maintenance agencies or at least the Agency Scheme in which an organisation is registered. In order for this to be possible all Agency Schemes must be made known to a Global SDMX Registry and either maintained in that Registry or maintained and made available from a metadata source that is referenced from an entry in the Global Registry. For example, the Agency Schemes shown in Figure 30 could be “registered” in the Global Registry as follows:
55 +Clearly, in order for such a system to work there must be a mechanism that enables a user or organisation to discover the full “list” of [[maintenance agencies>>doc:sdmx:Glossary.Maintenance agency.WebHome]] or at least the [[Agency Scheme>>doc:sdmx:Glossary.Agency scheme.WebHome]] in which an organisation is registered. In order for this to be possible all [[Agency Schemes>>doc:sdmx:Glossary.Agency scheme.WebHome]] must be made known to a Global [[SDMX Registry>>doc:sdmx:Glossary.SDMX Registry.WebHome]] and either maintained in that Registry or maintained and made available from a metadata source that is referenced from an entry in the [[Global Registry>>doc:sdmx:Glossary.Global registry.WebHome]]. For example, the [[Agency Schemes>>doc:sdmx:Glossary.Agency scheme.WebHome]] shown in Figure 30 could be “registered” in the [[Global Registry>>doc:sdmx:Glossary.Global registry.WebHome]] as follows:
59 59  
60 -(% style="text-align: center;" %)
61 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_348aea09d640ec2d.jpg||height="215" width="553"]]
57 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_348aea09d640ec2d.jpg||data-xwiki-image-style-alignment="center" height="215" width="553"]]
62 62  
63 63  (% style="text-align: center;" %)
64 64  **{{id name="image_32"/}}Figure 32: Example XML Showing External References**
... ... @@ -65,55 +65,54 @@
65 65  
66 66  == 10.3 Dissemination of Structural Metadata ==
67 67  
68 -When structural metadata are disseminated or exchanged it is important that any consuming application has access to all of the structural metadata that is referenced from structures such as a DSD or MSD (i.e. in these cases the Concept Schemes, Code Lists, Category Schemes etc. that are “used” in the DSD or the MSD). These structures can be embedded as complete structures in the file that is disseminated, or they can be embedded as “stubs” that contain the reference from where the structures can be retrieved. This referencing mechanism is achieved using one of the SDMX-ML attributes:
64 +When [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]] are disseminated or exchanged it is important that any consuming application has access to all of the [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]] that is referenced from structures such as a [[DSD>>doc:sdmx:Glossary.Data structure definition.WebHome]] or [[MSD>>doc:sdmx:Glossary.Metadata structure definition.WebHome]] (i.e. in these cases the [[Concept Schemes>>doc:sdmx:Glossary.Concept scheme.WebHome]], [[Code Lists>>doc:sdmx:Glossary.Code list.WebHome]], [[Category Schemes>>doc:sdmx:Glossary.Category scheme.WebHome]] etc. that are “used” in the [[DSD>>doc:sdmx:Glossary.Data structure definition.WebHome]] or the [[MSD>>doc:sdmx:Glossary.Metadata structure definition.WebHome]]). These structures can be embedded as complete structures in the file that is disseminated, or they can be embedded as “stubs” that contain the reference from where the structures can be retrieved. This referencing mechanism is achieved using one of the [[SDMX-ML>>doc:sdmx:Glossary.SDMX-ML.WebHome]] [[attributes>>doc:sdmx:Glossary.Attribute.WebHome]]:
69 69  
70 70  * structureURL
71 71  * serviceURL
72 72  
73 -These attributes are available on every structure that is maintained e.g. it is at the level of the “maintained object” such as Code List, Data Structure Definition. In addition to the use of these attributes the attribute isExternalReference should be set to “true” indicating that the full definition of the structure is not available and must be retrieved from one of the reference attributes structureURL or serviceURL.
69 +These [[attributes>>doc:sdmx:Glossary.Attribute.WebHome]] are available on every structure that is maintained e.g. it is at the (% style="color:#e74c3c" %)level(%%) of the “maintained object” such as [[Code List>>doc:sdmx:Glossary.Code list.WebHome]], [[Data Structure Definition>>doc:sdmx:Glossary.Data structure definition.WebHome]]. In addition to the use of these [[attributes>>doc:sdmx:Glossary.Attribute.WebHome]] the [[attribute>>doc:sdmx:Glossary.Attribute.WebHome]] [[isExternalReference>>doc:sdmx:Glossary.isExternalReference.WebHome]] should be set to “true” indicating that the full definition of the structure is not available and must be retrieved from one of the reference [[attributes>>doc:sdmx:Glossary.Attribute.WebHome]] structureURL or serviceURL.
74 74  
75 75  It is therefore the responsibility of the agency maintaining these structures that the structures can be accessed using the URL. If the URL cannot be used to retrieve the structure then it is possible that applications using the structures will not be able to process the information properly. It follows that the content of structureURL and serviceURL should be deemed to be resolvable in the long term.
76 76  
77 -The use of or a link to a shared community SDMX Registry is recommended for organizations that wish to store such structures. For example, the shared community registry can be used as the repository for the referenced structures.
73 +The use of or a link to a shared community [[SDMX Registry>>doc:sdmx:Glossary.SDMX Registry.WebHome]] is recommended for organizations that wish to store such structures. For example, the shared community registry can be used as the repository for the referenced structures.
78 78  
79 -Note that any structural metadata submitted to an SDMX Registry (SubmitStructureRequest) must have resolvable references to all of the structures cross referenced in the submitted structure. If this is not the case then the submission may be rejected.
75 +Note that any [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]] submitted to an [[SDMX Registry>>doc:sdmx:Glossary.SDMX Registry.WebHome]] (SubmitStructureRequest) must have resolvable references to all of the structures cross referenced in the submitted structure. If this is not the case then the submission may be rejected.
80 80  
81 81  == 10.4 Maintenance of Community Concept Roles ==
82 82  
83 83  === 10.4.1 Overview ===
84 84  
85 -The DSD Components of Dimension and Attribute can play a specific role in the DSD and it is important to some applications that this role is specified. For instance, the following roles are some examples:
81 +The [[DSD>>doc:sdmx:Glossary.Data structure definition.WebHome]] [[Components>>doc:sdmx:Glossary.Component.WebHome]] of [[Dimension>>doc:sdmx:Glossary.Dimension.WebHome]] and [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]] can play a specific role in the [[DSD>>doc:sdmx:Glossary.Data structure definition.WebHome]] and it is important to some applications that this role is specified. For instance, the following roles are some examples:
86 86  
87 -**Frequency **– in a data set the content of this Component contains information on the frequency of the observation values
83 +**Frequency **– in a [[data set>>doc:sdmx:Glossary.Data set.WebHome]] the content of this [[Component>>doc:sdmx:Glossary.Component.WebHome]] contains information on the frequency of the observation values
88 88  
89 -**Geography** - in a data set the content of this Component contains information on the geographic location of the observation values
85 +**Geography** - in a [[data set>>doc:sdmx:Glossary.Data set.WebHome]] the content of this [[Component>>doc:sdmx:Glossary.Component.WebHome]] contains information on the geographic location of the observation values
90 90  
91 -**Unit** **of Measure** - in a data set the content of this Component contains information on the unit of measure of the observation values
87 +**Unit** **of [[Measure>>doc:sdmx:Glossary.Measure.WebHome]]** - in a [[data set>>doc:sdmx:Glossary.Data set.WebHome]] the content of this [[Component>>doc:sdmx:Glossary.Component.WebHome]] contains information on the [[unit of measure>>doc:sdmx:Glossary.Unit of measure.WebHome]] of the observation values
92 92  
93 -In order for these roles to be extensible and also to enable user communities to maintain community-specific roles, the roles are maintained in a controlled vocabulary which is implemented in SDMX as Concepts in a Concept Scheme.
89 +In order for these roles to be extensible and also to enable user communities to maintain community-specific roles, the roles are maintained in a controlled vocabulary which is implemented in [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] as (% style="color:#e74c3c" %)Concepts(%%) in a [[Concept Scheme>>doc:sdmx:Glossary.Concept scheme.WebHome]].
94 94  
95 -It is possible to specify zero or more concept roles for a Dimension, Measure Dimension and Data Attribute (but not the ReportingYearStartDay). The Time Dimension, Primary Measure, and the Attribute ReportingYearStartDay have explicitly defined roles and cannot be further specified with additional concept roles.
91 +It is possible to specify zero or more (% style="color:#e74c3c" %)concept(%%) roles for a [[Dimension>>doc:sdmx:Glossary.Dimension.WebHome]], [[Measure>>doc:sdmx:Glossary.Measure.WebHome]] [[Dimension>>doc:sdmx:Glossary.Dimension.WebHome]] and Data [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]] (but not the ReportingYearStartDay). The Time [[Dimension>>doc:sdmx:Glossary.Dimension.WebHome]], Primary [[Measure>>doc:sdmx:Glossary.Measure.WebHome]], and the [[Attribute>>doc:sdmx:Glossary.Attribute.WebHome]] ReportingYearStartDay have explicitly defined roles and cannot be further specified with additional (% style="color:#e74c3c" %)concept(%%) roles.
96 96  
97 97  === 10.4.2 Maintaining and Using Concept Roles ===
98 98  
99 -The mechanism for maintaining and using concept roles is described in the SDMX Standards Section 6: Technical Notes. It is the responsibility of Agencies to ensure their community knows which concepts in which concept schemes play a “role” and the significance and interpretation of this role. In other words, such concepts must be known by applications, there is no technical mechanism that can inform an application on how to process such a “role”.
95 +The mechanism for maintaining and using (% style="color:#e74c3c" %)concept(%%) roles is described in the [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] Standards Section 6: Technical Notes. It is the responsibility of Agencies to ensure their community knows which (% style="color:#e74c3c" %)concepts(%%) in which [[concept schemes>>doc:sdmx:Glossary.Concept scheme.WebHome]] play a “role” and the significance and interpretation of this role. In other words, such (% style="color:#e74c3c" %)concepts(%%) must be known by applications, there is no technical mechanism that can inform an application on how to process such a “role”.
100 100  
101 -Clearly, Agencies defining DSDs can use Concepts from any Concept Scheme, even a Concept Scheme not maintained by this Agency. It is therefore important that any Concept Scheme that is referenced from the DSD must be available from a known URL to any application that needs to process the DSD, or be embedded in the file of structural metadata (this is no different from any other cross referenced structure as described in 10.3 above). Therefore, if an Agency decides to maintain its own Concept Scheme of concept roles it needs to consider whether this scheme is “public” (i.e. it is required in the DSDs disseminated by the organisation) and, if so, ensure that it is made available.
97 +Clearly, Agencies defining DSDs can use (% style="color:#e74c3c" %)Concepts(%%) from any [[Concept Scheme>>doc:sdmx:Glossary.Concept scheme.WebHome]], even a [[Concept Scheme>>doc:sdmx:Glossary.Concept scheme.WebHome]] not maintained by this Agency. It is therefore important that any [[Concept Scheme>>doc:sdmx:Glossary.Concept scheme.WebHome]] that is referenced from the [[DSD>>doc:sdmx:Glossary.Data structure definition.WebHome]] must be available from a known URL to any application that needs to process the [[DSD>>doc:sdmx:Glossary.Data structure definition.WebHome]], or be embedded in the file of [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]] (this is no different from any other cross referenced structure as described in 10.3 above). Therefore, if an Agency decides to maintain its own [[Concept Scheme>>doc:sdmx:Glossary.Concept scheme.WebHome]] of (% style="color:#e74c3c" %)concept(%%) roles it needs to consider whether this scheme is “public” (i.e. it is required in the DSDs disseminated by the organisation) and, if so, ensure that it is made available.
102 102  
103 103  == 10.5 Hosting of a shared registry ==
104 104  
105 -It is clear from the responsibilities of an Agency that there is a need to ensure structural metadata maintained by that Agency, and which is to be used outside of the organization that is the Agency, is made available. As more and more organizations use SDMX and as more Agencies are created, it is clear that a central repository of structural metadata will benefit the “community” of the Agency. Many of these communities will exist already, as they will pre-date the existence of. The SDMX standard formalizes the way a community exchanges and shares data and reference metadata, and as more SDMX communities are created then the greater is the need for control over the maintenance and sharing of the structural metadata.
101 +It is clear from the responsibilities of an Agency that there is a need to ensure [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]] maintained by that Agency, and which is to be used outside of the organization that is the Agency, is made available. As more and more organizations use [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] and as more Agencies are created, it is clear that a central repository of [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]] will benefit the “community” of the Agency. Many of these communities will exist already, as they will pre-date the existence of. The [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] standard formalizes the way a community exchanges and shares data and [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]], and as more [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] communities are created then the greater is the need for control over the maintenance and sharing of the [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]].
106 106  
107 -Community “Agencies” should consider taking on the role of hosting a shared SDMX Registry for the community. Clearly, there will be many of these shared registries and it may be necessary that these registries can be linked in a “federation” so that common structural metadata is accessible. This is especially true of the Agency Schemes that will exist: it will only be possible to validate an agencyID if the Agency is known and this may involve knowledge of the full hierarchy of Agencies which will be need to be built from the Agencies maintained in separate Agency Schemes. Furthermore, it is probable that many Code Lists and Concept Schemes will not be disseminated with DSDs and MSDs, but rather be referenced from the structure file disseminated. This type of federated architecture is best supported by an SDMX Registry, as this is the one of the key roles of an SDMX Registry.
103 +Community “Agencies” should consider taking on the role of hosting a shared [[SDMX Registry>>doc:sdmx:Glossary.SDMX Registry.WebHome]] for the community. Clearly, there will be many of these shared registries and it may be necessary that these registries can be linked in a “federation” so that common [[structural metadata>>doc:sdmx:Glossary.Structural metadata.WebHome]] is accessible. This is especially true of the [[Agency Schemes>>doc:sdmx:Glossary.Agency scheme.WebHome]] that will exist: it will only be possible to validate an agencyID if the Agency is known and this may involve knowledge of the full [[hierarchy>>doc:sdmx:Glossary.Hierarchy.WebHome]] of Agencies which will be need to be built from the Agencies maintained in separate [[Agency Schemes>>doc:sdmx:Glossary.Agency scheme.WebHome]]. Furthermore, it is probable that many [[Code Lists>>doc:sdmx:Glossary.Code list.WebHome]] and [[Concept Schemes>>doc:sdmx:Glossary.Concept scheme.WebHome]] will not be disseminated with DSDs and MSDs, but rather be referenced from the structure file disseminated. This type of federated architecture is best supported by an [[SDMX Registry>>doc:sdmx:Glossary.SDMX Registry.WebHome]], as this is the one of the key roles of an [[SDMX Registry>>doc:sdmx:Glossary.SDMX Registry.WebHome]].
108 108  
109 109  == 10.6 Data Provider Maintenance ==
110 110  
111 -An organization that collects data or reference metadata from other organizations (these are known as Data Providers in SDMX) must maintain a DataProvider Scheme. This is self evident as the collecting organization must know from which reporting organization data or reference metadata is received. Clearly, an organization can collect data or reference metadata in an SDMX format without having an SDMX DataProvider Scheme. Nevertheless, data collecting organizations which adopt SDMX are encouraged to maintain an SDMX DataProvider Scheme, or to be able to disseminate such a scheme from their own internal scheme.
107 +An organization that collects data or [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] from other organizations (these are known as [[Data Providers>>doc:sdmx:Glossary.Data provider.WebHome]] in [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]]) must maintain a DataProvider Scheme. This is self evident as the collecting organization must know from which reporting organization data or [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] is received. Clearly, an organization can collect data or [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] in an [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] format without having an [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] DataProvider Scheme. Nevertheless, data collecting organizations which adopt [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] are encouraged to maintain an [[SDMX>>doc:sdmx:Glossary.Statistical data and metadata exchange.WebHome]] DataProvider Scheme, or to be able to disseminate such a scheme from their own internal scheme.
112 112  
113 -If the collecting organization wishes to adopt the “pull” method of data/metadata reporting, or wishes to host an SDMX Registry where its community can publish the existence of data and reference metadata sources (by means of a data/metadata Registration), then it is mandatory to have a DataProvider Scheme. The relationship between the fundamental structures supporting the “pull” mechanism and data/metadata discovery is shown in the diagram below.
109 +If the collecting organization wishes to adopt the “pull” method of data/metadata reporting, or wishes to host an [[SDMX Registry>>doc:sdmx:Glossary.SDMX Registry.WebHome]] where its community can publish the existence of data and [[reference metadata>>doc:sdmx:Glossary.Reference metadata.WebHome]] sources (by means of a data/metadata Registration), then it is mandatory to have a DataProvider Scheme. The relationship between the fundamental structures supporting the “pull” mechanism and data/metadata discovery is shown in the diagram below.
114 114  
115 -(% style="text-align: center;" %)
116 -[[image:SDMX_2-1_User_Guide_draft_0-1_html_1ac2660026676010.jpg||height="512" width="575"]]
111 +[[image:SDMX_2-1_User_Guide_draft_0-1_html_1ac2660026676010.jpg||data-xwiki-image-style-alignment="center" height="512" width="575"]]
117 117  
118 118  (% style="text-align: center;" %)
119 119  **{{id name="image_33"/}}Figure 33: SDMX structures required for the “pull” reporting mechanism or for data/metadata discovery**