Changes for page 9 Concept Roles

Last modified by Helena on 2025/09/10 11:19

From version 4.1
edited by Helena
on 2025/05/16 00:15
Change comment: There is no comment for this version
To version 7.1
edited by Artur
on 2025/05/21 10:50
Change comment: There is no comment for this version

Summary

Details

Page properties
Parent
... ... @@ -1,0 +1,1 @@
1 +Methodology.SDMX 3\.0 Standards\. Section 6\. Technical notes.WebHome
Author
... ... @@ -1,1 +1,1 @@
1 -xwiki:XWiki.helena
1 +xwiki:XWiki.arturkryazhev
Content
... ... @@ -4,10 +4,10 @@
4 4  
5 5  == 9.1 Overview ==
6 6  
7 -The DSD Components of Dimension and Attribute can play a specific role in the DSD and it is important to some applications that this role is specified. For instance, the following roles are some examples:
7 +The [[DSD>>doc:xwiki:Glossary.Data structure definition.WebHome]] [[Components>>doc:xwiki:Glossary.Component.WebHome]] of [[Dimension>>doc:xwiki:Glossary.Dimension.WebHome]] and [[Attribute>>doc:xwiki:Glossary.Attribute.WebHome]] can play a specific role in the [[DSD>>doc:xwiki:Glossary.Data structure definition.WebHome]] and it is important to some applications that this role is specified. For instance, the following roles are some examples:
8 8  
9 -* **Frequency **– in a data set the content of this Component contains information on the frequency of the observation values.
10 -* **Geography** – in a data set the content of this Component contains information on the geographic location of the observation values.
9 +* **Frequency **– in a [[data set>>doc:xwiki:Glossary.Data set.WebHome]] the content of this [[Component>>doc:xwiki:Glossary.Component.WebHome]] contains information on the frequency of the observation values.
10 +* **Geography** – in a [[data set>>doc:xwiki:Glossary.Data set.WebHome]] the content of this [[Component>>doc:xwiki:Glossary.Component.WebHome]] contains information on the geographic location of the observation values.
11 11  
12 12  == 9.2 Information Model ==
13 13  
... ... @@ -18,79 +18,57 @@
18 18  (% class="wikigeneratedid" id="HFigure19:InformationModelExtractforConceptRole" %)
19 19  **Figure 19: Information Model Extract for Concept Role**
20 20  
21 -It is possible to specify zero or more concept roles for a Dimension, Measure and Data Attribute. The Time Dimension has explicitly defined roles and cannot be further specified with additional concept roles.
21 +It is possible to specify zero or more (% style="color:#2ecc71" %)concept(%%) roles for a [[Dimension>>doc:xwiki:Glossary.Dimension.WebHome]], [[Measure>>doc:xwiki:Glossary.Measure.WebHome]] and Data [[Attribute>>doc:xwiki:Glossary.Attribute.WebHome]]. The Time [[Dimension>>doc:xwiki:Glossary.Dimension.WebHome]] has explicitly defined roles and cannot be further specified with additional (% style="color:#2ecc71" %)concept(%%) roles.
22 22  
23 23  == 9.3 Technical Mechanism ==
24 24  
25 -The mechanism for maintain and using concept roles is as follows:
25 +The mechanism for maintain and using (% style="color:#2ecc71" %)concept(%%) roles is as follows:
26 26  
27 -1. A standard Concept Scheme maintained in the Global Registry, with the following identification: SDMX:CONCEPT_ROLES(1.0.0), shall include the default roles, specified by the SDMX SWG (as detailed in 9.5).
28 -1. Any recognized Agency can have a concept scheme that contains concepts that identify concept roles. Indeed, from a technical perspective any agency can have more than one of these schemes, though this is not recommended.
29 -1. The concept scheme that contains the "role" concepts can contain concepts that do not play a role.
30 -1. There is no explicit indication on the Concept whether it is a 'role' concept.
31 -1. Therefore, any concept in any concept scheme is capable of being a 'role' concept.
32 -1. It is the responsibility of Agencies to ensure their community knows which concepts in which concept schemes play a 'role' and the significance and interpretation of this role. In other words, such concepts must be known by applications, there is no technical mechanism that can inform an application on how to process such a 'role'.
33 -1. If the concept referenced in the Concept Identity in a DSD component (Dimension, Measure Dimension, Attribute) is contained in the concept scheme containing concept roles then the DSD component could play the role implied by the concept, if this is understood by the processing application.
34 -1. If the concept referenced in the Concept Identity in a DSD component (Dimension, Measure Dimension, Attribute) is not contained in the concept scheme containing concept roles, and the DSD component is playing a role, then the concept role is identified by the Concept Role in the schema.
27 +1. A standard [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]] maintained in the [[Global Registry>>doc:xwiki:Glossary.Global registry.WebHome]], with the following identification: [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]:CONCEPT_ROLES(1.0.0), shall include the default roles, specified by the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] SWG (as detailed in 9.5).
28 +1. Any recognized Agency can have a [[concept scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]] that contains (% style="color:#2ecc71" %)concepts(%%) that identify (% style="color:#2ecc71" %)concept(%%) roles. Indeed, from a technical perspective any agency can have more than one of these schemes, though this is not recommended.
29 +1. The [[concept scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]] that contains the "role" (% style="color:#2ecc71" %)concepts(%%) can contain (% style="color:#2ecc71" %)concepts(%%) that do not play a role.
30 +1. There is no explicit indication on the (% style="color:#2ecc71" %)Concept(%%) whether it is a 'role' (% style="color:#2ecc71" %)concept(%%).
31 +1. Therefore, any (% style="color:#2ecc71" %)concept(%%) in any [[concept scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]] is capable of being a 'role' (% style="color:#2ecc71" %)concept(%%).
32 +1. It is the responsibility of Agencies to ensure their community knows which (% style="color:#2ecc71" %)concepts(%%) in which [[concept schemes>>doc:xwiki:Glossary.Concept scheme.WebHome]] play a 'role' and the significance and interpretation of this role. In other words, such (% style="color:#2ecc71" %)concepts(%%) must be known by applications, there is no technical mechanism that can inform an application on how to process such a 'role'.
33 +1. If the (% style="color:#2ecc71" %)concept(%%) referenced in the (% style="color:#2ecc71" %)Concept(%%) Identity in a [[DSD>>doc:xwiki:Glossary.Data structure definition.WebHome]] [[component>>doc:xwiki:Glossary.Component.WebHome]] ([[Dimension>>doc:xwiki:Glossary.Dimension.WebHome]], [[Measure>>doc:xwiki:Glossary.Measure.WebHome]] [[Dimension>>doc:xwiki:Glossary.Dimension.WebHome]], [[Attribute>>doc:xwiki:Glossary.Attribute.WebHome]]) is contained in the [[concept scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]] containing (% style="color:#2ecc71" %)concept(%%) roles then the [[DSD>>doc:xwiki:Glossary.Data structure definition.WebHome]] [[component>>doc:xwiki:Glossary.Component.WebHome]] could play the role implied by the (% style="color:#2ecc71" %)concept(%%), if this is understood by the processing application.
34 +1. If the (% style="color:#2ecc71" %)concept(%%) referenced in the (% style="color:#2ecc71" %)Concept(%%) Identity in a [[DSD>>doc:xwiki:Glossary.Data structure definition.WebHome]] [[component>>doc:xwiki:Glossary.Component.WebHome]] ([[Dimension>>doc:xwiki:Glossary.Dimension.WebHome]], [[Measure>>doc:xwiki:Glossary.Measure.WebHome]] [[Dimension>>doc:xwiki:Glossary.Dimension.WebHome]], [[Attribute>>doc:xwiki:Glossary.Attribute.WebHome]]) is not contained in the [[concept scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]] containing (% style="color:#2ecc71" %)concept(%%) roles, and the [[DSD>>doc:xwiki:Glossary.Data structure definition.WebHome]] [[component>>doc:xwiki:Glossary.Component.WebHome]] is playing a role, then the (% style="color:#2ecc71" %)concept(%%) role is identified by the (% style="color:#2ecc71" %)Concept(%%) Role in the schema.
35 35  
36 36  == 9.4 SDMX-ML Examples in a DSD ==
37 37  
38 -The standard roles Concept Scheme, is still a normal Concept Scheme, thus it may be used also for the concept identity of a Component, e.g., the 'FREQ':
38 +The standard roles [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]], is still a normal [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]], thus it may be used also for the (% style="color:#2ecc71" %)concept(%%) identity of a [[Component>>doc:xwiki:Glossary.Component.WebHome]], e.g., the 'FREQ':
39 39  
40 -**<str:Dimension id="FREQ">**
40 +[[image:1747386659499-933.png]]
41 41  
42 -**<str:ConceptIdentity>urn:sdmx:org.sdmx.infomodel.conceptscheme.Concept=**
42 +Given this is the standard roles [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]], any application should interpret the above [[Dimension>>doc:xwiki:Glossary.Dimension.WebHome]] to have the role of Frequency.
43 43  
44 -**SDMX:CONCEPT_ROLES(1.0.0).FREQ</str:ConceptIdentity> </str:Dimension>**
44 +Using a [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]] that is not the standard roles [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]] where it is required to assign a role using the standard roles [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]]. Again, FREQ is chosen as the example.
45 45  
46 -Given this is the standard roles Concept Scheme, any application should interpret the above Dimension to have the role of Frequency.
46 +[[image:1747386677366-237.png]]
47 47  
48 -Using a Concept Scheme that is not the standard roles Concept Scheme where it is required to assign a role using the standard roles Concept Scheme. Again, FREQ is chosen as the example.
48 +This explicitly states that this [[Dimension>>doc:xwiki:Glossary.Dimension.WebHome]] is playing a role identified by the FREQ (% style="color:#2ecc71" %)concept(%%) in the standard roles [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]]. Again, the application must interpret this as a Frequency role.
49 49  
50 -**<str:Dimension id="FREQ">**
50 +In other cases where a role from a non-standard roles [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]] is used, then the application has to know how to interpret the provided roles, e.g., like in the case below:
51 51  
52 -**<str:ConceptIdentity>urn:sdmx:org.sdmx.infomodel.conceptscheme.Concept=**
52 +[[image:1747386694309-599.png]]
53 53  
54 -**SDMX:CONCEPTS(1.0.0).FREQ</str:ConceptIdentity>**
54 +This is all that is required for interoperability within a community. Having a standard roles [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]], maintained by the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] SWG, allows the [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] community to have a common understanding of the roles, while also being able to extend the roles in bilateral (or multilateral) agreements, by maintaining their own roles [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]]. This will then ensure there is interoperability between systems that understand the use of these (% style="color:#2ecc71" %)concepts(%%).
55 55  
56 -**<str:ConceptRole>urn:sdmx:org.sdmx.infomodel.conceptscheme.Concept=**
56 +Note that each of the [[Components>>doc:xwiki:Glossary.Component.WebHome]] (Data [[Attribute>>doc:xwiki:Glossary.Attribute.WebHome]], [[Measure>>doc:xwiki:Glossary.Measure.WebHome]], [[Dimension>>doc:xwiki:Glossary.Dimension.WebHome]], Time [[Dimension>>doc:xwiki:Glossary.Dimension.WebHome]]) has a mandatory identity association ((% style="color:#2ecc71" %)Concept(%%) Identity) and if this (% style="color:#2ecc71" %)Concept(%%) also identifies the role then it must be interpreted accordingly.
57 57  
58 -**SDMX:CONCEPT_ROLES(1.0.0).FREQ</str:ConceptRole>**
58 +In order for these roles to be extensible and also to enable user communities to maintain community-specific roles, the roles are maintained in a controlled vocabulary which is implemented in [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] as (% style="color:#2ecc71" %)Concepts(%%) in a [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]]. The [[Component>>doc:xwiki:Glossary.Component.WebHome]] optionally references this (% style="color:#2ecc71" %)Concept(%%) if it is required to declare the role explicitly. Note that a [[Component>>doc:xwiki:Glossary.Component.WebHome]] can play more than one role and therefore multiple "role" (% style="color:#2ecc71" %)concepts(%%) can be referenced.
59 59  
60 -**</str:Dimension>**
61 -
62 -This explicitly states that this Dimension is playing a role identified by the FREQ concept in the standard roles Concept Scheme. Again, the application must interpret this as a Frequency role.
63 -
64 -In other cases where a role from a non-standard roles Concept Scheme is used, then the application has to know how to interpret the provided roles, e.g., like in the case below:
65 -
66 -**<str:Dimension id="FREQ">**
67 -
68 -**<str:ConceptIdentity>urn:sdmx:org.sdmx.infomodel.conceptscheme.Concept=**
69 -
70 -**SDMX:CONCEPTS(1.0.0).FREQ</str:ConceptIdentity>**
71 -
72 -**<str:ConceptRole>urn:sdmx:org.sdmx.infomodel.conceptscheme.Concept=**
73 -
74 -**SDMX:MY_CONCEPT_ROLES(1.0.0).FREQ</str:ConceptRole> </str:Dimension>**
75 -
76 -This is all that is required for interoperability within a community. Having a standard roles Concept Scheme, maintained by the SDMX SWG, allows the SDMX community to have a common understanding of the roles, while also being able to extend the roles in bilateral (or multilateral) agreements, by maintaining their own roles Concept Scheme. This will then ensure there is interoperability between systems that understand the use of these concepts.
77 -
78 -Note that each of the Components (Data Attribute, Measure, Dimension, Time Dimension) has a mandatory identity association (Concept Identity) and if this Concept also identifies the role then it must be interpreted accordingly.
79 -
80 -In order for these roles to be extensible and also to enable user communities to maintain community-specific roles, the roles are maintained in a controlled vocabulary which is implemented in SDMX as Concepts in a Concept Scheme. The Component optionally references this Concept if it is required to declare the role explicitly. Note that a Component can play more than one role and therefore multiple "role" concepts can be referenced.
81 -
82 82  == 9.5 SDMX standard roles Concept Scheme ==
83 83  
84 -As of SDMX 3.0, there is a predefined Concept Scheme, with a set of Concepts that are considered the standard roles for SDMX. Beyond that, a user is free to add other roles, using custom Concept Schemes. This predefined Concept Scheme is the result of the SWG guidelines for Concept Roles, plus that for Measure, and includes the following Concepts:
62 +As of [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] 3.0, there is a predefined [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]], with a set of (% style="color:#2ecc71" %)Concepts(%%) that are considered the standard roles for [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]]. Beyond that, a user is free to add other roles, using custom [[Concept Schemes>>doc:xwiki:Glossary.Concept scheme.WebHome]]. This predefined [[Concept Scheme>>doc:xwiki:Glossary.Concept scheme.WebHome]] is the result of the SWG guidelines for (% style="color:#2ecc71" %)Concept(%%) Roles, plus that for [[Measure>>doc:xwiki:Glossary.Measure.WebHome]], and includes the following (% style="color:#2ecc71" %)Concepts(%%):
85 85  
86 86  (% style="width:1183.29px" %)
87 -|COMMENT|Comment|(% style="width:723px" %)Descriptive text which can be attached to data or metadata.
88 -|ENTITY|Entity|(% style="width:723px" %)Describes the subject of the data set (e.g., a country).
89 -|FLAG|Flag|(% style="width:723px" %)Coded attribute in a data set that represents qualitative information for the cell or partial key (e.g. series) value.
65 +|COMMENT|[[Comment>>doc:xwiki:Glossary.Comment.WebHome]]|(% style="width:723px" %)Descriptive text which can be attached to data or metadata.
66 +|ENTITY|Entity|(% style="width:723px" %)Describes the subject of the [[data set>>doc:xwiki:Glossary.Data set.WebHome]] (e.g., a country).
67 +|FLAG|Flag|(% style="width:723px" %)Coded [[attribute>>doc:xwiki:Glossary.Attribute.WebHome]] in a [[data set>>doc:xwiki:Glossary.Data set.WebHome]] that represents qualitative information for the cell or partial key (e.g. series) value.
90 90  |FREQ|Frequency|(% style="width:723px" %)Time interval at which the source data are collected.
91 91  |GEO|Geographical|(% style="width:723px" %)Geographic area to which the measured statistical phenomenon relates.
92 92  |OPERATION|Statistical operation|(% style="width:723px" %)Signifies statistical operations have been done on the observations.
93 -|VARIABLE|Variable|(% style="width:723px" %)Characteristic of a unit being observed that may assume more than one of a set of values to which a numerical measure or a category from a classification can be assigned.
94 -|MEASURE|Measure|(% style="width:723px" %)Used for emulating the functionality of the deprecated MeasureDimension.
95 -|GEO_FEATU RE_SET|Geographical Feature Set|(% style="width:723px" %)Georeferencing information to describe the location or the shape of a statistical unit, recognizable object or geographical area.
96 -|PRIMARY|Primary Measure|(% style="width:723px" %)Used for backwards compatibility with SDMX 2.1 and back, or when the “Primary Measure” concept is needed.
71 +|VARIABLE|Variable|(% style="width:723px" %)Characteristic of a unit being observed that may assume more than one of a set of values to which a numerical [[measure>>doc:xwiki:Glossary.Measure.WebHome]] or a [[category>>doc:xwiki:Glossary.Category.WebHome]] from a classification can be assigned.
72 +|MEASURE|[[Measure>>doc:xwiki:Glossary.Measure.WebHome]]|(% style="width:723px" %)Used for emulating the functionality of the deprecated MeasureDimension.
73 +|GEO_FEATU RE_SET|Geographical Feature Set|(% style="width:723px" %)Georeferencing information to describe the location or the shape of a [[statistical unit>>doc:xwiki:Glossary.Statistical unit.WebHome]], recognizable object or geographical area.
74 +|PRIMARY|Primary [[Measure>>doc:xwiki:Glossary.Measure.WebHome]]|(% style="width:723px" %)Used for backwards compatibility with [[SDMX>>doc:xwiki:Glossary.Statistical data and metadata exchange.WebHome]] 2.1 and back, or when the “Primary [[Measure>>doc:xwiki:Glossary.Measure.WebHome]](% style="color:#2ecc71" %)concept(%%) is needed.
1747386659499-933.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.helena
Size
... ... @@ -1,0 +1,1 @@
1 +10.2 KB
Content
1747386677366-237.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.helena
Size
... ... @@ -1,0 +1,1 @@
1 +23.1 KB
Content
1747386694309-599.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.helena
Size
... ... @@ -1,0 +1,1 @@
1 +23.2 KB
Content