Changes for page Guidelines for SDMX Data Structure Definitions
Last modified by Artur K. on 2026/05/29 14:28
Summary
-
Page properties (2 modified, 0 added, 0 removed)
-
Attachments (0 modified, 0 added, 19 removed)
- 1768470533088-795.png
- 1768470575978-226.png
- 1768470596130-305.png
- 1768470611326-907.png
- 1768470626558-321.png
- 1768470646456-652.png
- 1768470678965-391.png
- 1768470705894-724.png
- 1768470729899-225.png
- 1768470752201-691.png
- 1768470775109-874.png
- 1768470796725-270.png
- 1768470829131-599.png
- 1768470860119-204.png
- 1768470878394-873.png
- 1768470896763-366.png
- 1768470911321-123.png
- 1768470939545-136.png
- 1768471052577-528.png
Details
- Page properties
-
- Author
-
... ... @@ -1,1 +1,1 @@ 1 -xwiki:XWiki. arturkryazhev1 +xwiki:XWiki.helena - Content
-
... ... @@ -14,17 +14,17 @@ 14 14 15 15 Target audiences for these guidelines include domain experts and official statisticians involved in DSD development. Thus focusing on the business/content side of DSD development, the document tries to avoid technical jargon when explaining underlying concepts and ideas, but tries to still be useful for IT experts supporting SDMX implementations. Ideally, the document can bridge the gap between IT and statistical experts. The scope of the guidelines is restricted to conceptual aspects. Organizational and technical aspects are treated in separate documents. 16 16 17 -* Code lists are the crucial building blocks of data structure definitions. Especially in the case of SDMX recommended code lists (particularly for cross-domain concepts; see SDMX Content Oriented Guidelines under “Guidelines” at [[http:~~/~~/sdmx.org/>>https://http:sdmx.org]]), list development and maintenance as well as DSD development and maintenance are carried out by different organizations at different points in time. For example SDMX recommended code lists for frequency and observation status already exist and should be used by reference in DSDs. While “SDMX” is responsible for the maintenance of these code lists, the DSD developing organization will be responsible for the maintenance of the DSD, that is, for the structure at a higher level. (Of course, a global DSD may also have “SDMX” as maintenance agency.) In any case, there is a strong interrelationship between DSD and code list development and maintenance (see SDMX Guidelines for the creation and maintenance of code lists under “Guidelines” at[[http:~~/~~/sdmx.org/>>https://http:sdmx.org?page_id=13]]).18 -* Maintenance and governance rules for DSDs including issues of updating, versioning, retiring as well as questions of responsibilities, especially relevant in the context of global DSDs jointly developed by multiple organizations and maintained by “SDMX” (or multiple organizations), will be covered by separate guidelines (see “Guidelines” at [[http:~~/~~/sdmx.org/>>https://http:sdmx.org]]).19 -* Issues related to SDMX registries (in general, and the global SDMX registry in particular) such as storage, federation, and registration of, as well as search for, retrieval and download of, code lists and DSDs are not in the scope of this document. For more information on the registry see the “Standards” page at [[http:~~/~~/sdmx.org/>>https://http:sdmx.org]].20 -* Guidelines for the development, maintenance, and governance of metadata structure definitions (MSDs) will be made available separately under “Guidelines” at [[http:~~/~~/sdmx.org/>>https://http:sdmx.org]].21 -* Documentation on more IT-related issues is available at the SDMX IT tools and SDMX tutorials site at [[http:~~/~~/sdmx.org/?page_id=13>>https://http:sdmx.org?page_id=13]].The SDMX Tools Repository can be accessed at[[http:~~/~~/www.sdmxtools.org/.>>https://http:www.sdmxtools.org.WebHome]]Many of the SDMX tools listed and described there are available free of charge.17 +* Code lists are the crucial building blocks of data structure definitions. Especially in the case of SDMX recommended code lists (particularly for cross-domain concepts; see SDMX Content Oriented Guidelines under “Guidelines” at http:~/~/sdmx.org/), list development and maintenance as well as DSD development and maintenance are carried out by different organizations at different points in time. For example SDMX recommended code lists for frequency and observation status already exist and should be used by reference in DSDs. While “SDMX” is responsible for the maintenance of these code lists, the DSD developing organization will be responsible for the maintenance of the DSD, that is, for the structure at a higher level. (Of course, a global DSD may also have “SDMX” as maintenance agency.) In any case, there is a strong interrelationship between DSD and code list development and maintenance (see SDMX Guidelines for the creation and maintenance of code lists under “Guidelines” at http:~/~/sdmx.org/). 18 +* Maintenance and governance rules for DSDs including issues of updating, versioning, retiring as well as questions of responsibilities, especially relevant in the context of global DSDs jointly developed by multiple organizations and maintained by “SDMX” (or multiple organizations), will be covered by separate guidelines (see “Guidelines” at http:~/~/sdmx.org/). 19 +* Issues related to SDMX registries (in general, and the global SDMX registry in particular) such as storage, federation, and registration of, as well as search for, retrieval and download of, code lists and DSDs are not in the scope of this document. For more information on the registry see the “Standards” page at http:~/~/sdmx.org/. 20 +* Guidelines for the development, maintenance, and governance of metadata structure definitions (MSDs) will be made available separately under “Guidelines” at http:~/~/sdmx.org/. 21 +* Documentation on more IT-related issues is available at the SDMX IT tools and SDMX tutorials site at http:~/~/sdmx.org/?page_id=13. The SDMX Tools Repository can be accessed at http:~/~/www.sdmxtools.org/. Many of the SDMX tools listed and described there are available free of charge. 22 22 23 23 This document is structured as follows. Section 2 outlines general design principles of DSDs. Section 3 discusses different usage contexts of DSDs in more detail. Section 4 gives an overview of different data structuring approaches including benefits, drawbacks, and contextspecific recommendations. General minimum structural and semantic requirements are discussed in section 5. Section 6 provides a step-by-step guide to designing DSDs including a checklist for DSD designers. The three annexes include a glossary in Annex 1, a definition and brief introduction of the core components of a DSD in Annex 2, and a list of references in Annex 3. 24 24 25 25 = 2 GENERAL DESIGN PRINCIPLES = 26 26 27 -Besides the evident requirement of //standard compliance//, a couple of general design principles apply to SDMX DSD development independently of the domain and the particular usage context the DSD is embedded in. Examples include //flexibility in changing requirements//; //stability//; //usage of existing// code lists or even DSDs; and //parsimony//, //simplicity//, //unambiguousness//, and //density// of the dimensional model. Please note that the SDMX-ML Standards do not impose an order on concepts (i.e., dimensions and attributes). Strictly speaking, standard compliance of a DSD only entails technical compliance with the SDMX technical standard. However, //adherence to// SDMX content recommendations, principles, and best practices as provided in the //SDMX Content-Oriented Guidelines// (see [[http:~~/~~/sdmx.org/?page_id=11>>https://http:sdmx.org?page_id=11]]) is strongly recommended. It should be kept in mind that one major aim of SDMX is to have transparency and agreement on the meaning of statistical concepts in order to allow their flawless communication.27 +Besides the evident requirement of //standard compliance//, a couple of general design principles apply to SDMX DSD development independently of the domain and the particular usage context the DSD is embedded in. Examples include //flexibility in changing requirements//; //stability//; //usage of existing// code lists or even DSDs; and //parsimony//, //simplicity//, //unambiguousness//, and //density// of the dimensional model. Please note that the SDMX-ML Standards do not impose an order on concepts (i.e., dimensions and attributes). Strictly speaking, standard compliance of a DSD only entails technical compliance with the SDMX technical standard. However, //adherence to// SDMX content recommendations, principles, and best practices as provided in the //SDMX Content-Oriented Guidelines// (see http:~/~/sdmx.org/?page_id=11) is strongly recommended. It should be kept in mind that one major aim of SDMX is to have transparency and agreement on the meaning of statistical concepts in order to allow their flawless communication. 28 28 29 29 == 2.1 Reuse of existing DSDs and code lists == 30 30 ... ... @@ -61,7 +61,7 @@ 61 61 62 62 === 2.1.3 Suitability of available DSDs and code lists === 63 63 64 -In case an existing DSD is close to but differs from what is needed, it may: {{{(i)}}}contain irrelevant concepts, (ii) lack some required concepts, (iii) use the concepts in different roles than required, (iv) deviate with respect to some of the code lists, or (v) contain pure dimensions when mixed dimensions would make more sense or vice versa. More complex situations that are combinations of several (or even all) of these five cases may occur as well. For example, an existing DSD could contain unnecessary concepts and lack other concepts at the same time.64 +In case an existing DSD is close to but differs from what is needed, it may: (i) contain irrelevant concepts, (ii) lack some required concepts, (iii) use the concepts in different roles than required, (iv) deviate with respect to some of the code lists, or (v) contain pure dimensions when mixed dimensions would make more sense or vice versa. More complex situations that are combinations of several (or even all) of these five cases may occur as well. For example, an existing DSD could contain unnecessary concepts and lack other concepts at the same time. 65 65 66 66 ==== 2.1.3.1 Irrelevant concepts ==== 67 67 ... ... @@ -243,7 +243,7 @@ 243 243 244 244 The decision on content and number of concepts in a DSD usually leads to the question of how far the “//indicator//” dimension should be decomposed. There are some (cross-domain) concepts, such as geographical and temporal reference and unit of measure, that are relevant in most DSDs. Once those are defined (the usage of the SDMX COG is highly recommended!) the actual “//subject-matter//” or “//domain//” concepts remain. One option is to combine all those concepts into one “indicator” dimension which may make sense in certain scenarios, for example for smaller single-domain, single-purpose DSDs with few or no crossclassifications or for display in an end-user dissemination tool. The other extreme strategy is to decompose into as many components as possible by splitting any breakdown concepts from the core indicator concept. 245 245 246 -The range of options between the “//just one//” (mixed) and “//all component//” subject-matter dimensions approaches is subject to the comprehensiveness (i.e. size, coverage) of the data exchange that the DSD is being developed for. If using a “mixed dimensions” approach, rules for the composition of the mixed dimension(s) may be specified (e.g. concatenate concepts A, B, and C to get mixed dimension X), allowing their easy re-decomposition. In general composite dimensions should be avoided as previously recommended by the SDMX Technical Notes, but there are cases that suggest the usage of composite dimensions. Table 4 juxtaposes general pros and cons of the “//many pure concepts//” and “//fewer composite concepts//” approaches. 246 +The range of options between the “//just one//”// //(mixed) and “//all component//” subject-matter dimensions approaches is subject to the comprehensiveness (i.e. size, coverage) of the data exchange that the DSD is being developed for. If using a “mixed dimensions” approach, rules for the composition of the mixed dimension(s) may be specified (e.g. concatenate concepts A, B, and C to get mixed dimension X), allowing their easy re-decomposition. In general composite dimensions should be avoided as previously recommended by the SDMX Technical Notes, but there are cases that suggest the usage of composite dimensions. Table 4 juxtaposes general pros and cons of the “//many pure concepts//” and “//fewer composite concepts//” approaches. 247 247 248 248 **Table 4. General comparison of data structuring approaches** 249 249 ... ... @@ -315,7 +315,7 @@ 315 315 316 316 The “one DSD” approach works best for single-domain and/or single-purpose scenarios. In more complex scenarios, more complex approaches are more suitable. Usage of the “one DSD” approach in a multi-domain or multi-purpose scenario actually means that one master DSD containing all concepts, code lists, and codes relevant in any (but most likely not all) domains and/or purposes is used by all domains and/or purposes without constraints. If a “many pure concepts” approach is used, the DSD will be sparse and require many “not applicable” values or structure maps. 317 317 318 -In those more complex scenarios, multi-DSD approaches have more potential. The “master DSD + satellite DSDs” approach imposes more restrictions and aims at a higher degree of content harmonization than the more loosely coupled (or even independent) multi-DSD approach. While the former specifies the concepts and code lists to be used by all derived DSDs, the latter is more flexible. Therefore, the master + satellites approach is suggested for data exchange scenarios with a high degree of harmonization/standardization required such as at the international level or between national and international organizations. Please note that what is termed “master DSD + satellite DSDs” approach here may also be implemented as master DSD plus constrained data flows with or without using structure maps. 318 +In those more complex scenarios, multi-DSD approaches have more potential. The “master DSD + satellite DSDs” approach imposes more restrictions and aims at a higher degree of content harmonization than the more loosely coupled (or even independent) multi-DSD approach. While the former specifies the concepts and code lists to be used by all derived DSDs, the latter is more flexible. Therefore, the master + satellites approach is suggested for data exchange scenarios with a high degree of harmonization / standardization required such as at the international level or between national and international organizations. Please note that what is termed “master DSD + satellite DSDs” approach here may also be implemented as master DSD plus constrained data flows with or without using structure maps. 319 319 320 320 Even in the multiple independent DSDs approach, sharing of concepts and code lists by reference is recommended. This may be problematic if additional codes are needed by certain DSDs, as neither the addition of codes to a code list used by reference nor the concatenation of multiple code lists included by reference is supported by the current SDMX Technical Standards. The only way of implementing “combined” code lists by reference is to reference each single code from each relevant partial code list. 321 321 ... ... @@ -332,7 +332,7 @@ 332 332 )))|(% colspan="2" %)use if harmonization is important in covered domains or purposes or if such a set of DSDs is already available at international level|easier to do than master + satellite approach each domain/purpose can maintain DSDs independently can be created on the fly from structured databases 333 333 |**between national organizations**|(% colspan="4" %)the same applies as to the “within organization” scenario 334 334 |**between int. organization and national organizations**|(% colspan="2" %)best for single domain, single purpose scenarios that are usually rather restricted with very clear specification of what needs to be exchanged|preferable over multiDSD approach in case of multi-domain and/or multi-purpose scenarios with highly correlated data flows for maintenance reasons|((( 335 -for multi-domain and/or multipurpose scenarios; only recommended if overlap of domains/purposes is minor (e.g. just w.r.t. cross-domain concepts) equivalent to multiple “one DSD” solutions, one for each domain/purpose 335 +for multi-domain and/or multipurpose scenarios; only recommended if overlap of domains/purposes is minor (e.g. just w.r.t. cross-domain concepts) equivalent to multiple “one DSD” solutions, one for each domain / purpose 336 336 ))) 337 337 |**between international organizations**|(% colspan="3" %)comparable to “national to international” scenario| 338 338 |**dissemination to public**|(% colspan="2" %)for single-domain, single-purpose cases in more complex cases this may be the preferable approach for data discovery tools (one data structure to find and access all data)|(% colspan="2" %)((( ... ... @@ -340,7 +340,7 @@ 340 340 341 341 * if it is relevant for the public to see the relationship between the data structures: use master + satellites approach 342 342 * otherwise the multi-DSD option is preferable, although with the highest possible degree of re-use of code lists and concepts 343 -* in both cases: important to include only concepts, code lists, and codes actually available/used by the data 343 +* in both cases: important to include only concepts, code lists, and codes actually available / used by the data 344 344 ))) 345 345 346 346 In general, finding the “perfect” data structure is less important for bilateral data exchange. Independent, custom-tailored DSDs may do the job quite well, as harmonization and standardization are typically not of high importance. If the data exchange is just a part of a more comprehensive scenario (e.g. multi-purpose, multi-domain, gateway, or data-sharing scenarios), a master DSD with satellite DSDs is preferable. ... ... @@ -367,7 +367,7 @@ 367 367 368 368 Certain concepts can be broadly agreed upon as being relevant in any data exchange, although their roles may differ between scenarios. The SDMX Content-Oriented Guidelines define many of these cross-domain concepts and, thus, should be referred to for further details on their specification. 369 369 370 -In general, multi-purpose and multi-domain scenarios may require more concepts than single-purpose and/or – domain scenarios. This mainly applies to subject-matter (or domainspecific) concepts and concepts that inform about the data source, provider, or process.370 +In general, multi-purpose and multi-domain scenarios may require more concepts than single-purpose and/or –domain scenarios. This mainly applies to subject-matter (or domainspecific) concepts and concepts that inform about the data source, provider, or process. 371 371 372 372 Exchanges between organizations, especially on an international level, typically require more concepts to cover context information, as data are transferred out of their usual context, meaning that users in the new context do not have the same knowledge of the data and may need additional background information. For exchanges of data within an organization, some context information may be common (implicit) knowledge so that it does not need to be made explicit in the data structure. 373 373 ... ... @@ -389,20 +389,19 @@ 389 389 390 390 **Table 9. Minimum requirements for DSDs~*~*** 391 391 392 -(% style="width:1308.83px" %) 393 -|(% style="width:205px" %)**Question**|(% style="width:272px" %)**Concept**|(% style="width:178px" %)**COG**|(% style="width:270px" %)**Code list**|(% style="width:290px" %)**Time series**|(% style="width:221px" %)**Cross-section** 394 -|(% style="width:205px" %)Where?|(% style="width:272px" %)reference area|(% style="width:178px" %)X|(% style="width:270px" %)revision|(% colspan="2" rowspan="1" style="width:478px" %)mand. attribute or dimension 395 -|(% style="width:205px" %)What?|(% style="width:272px" %)“indicator”|(% style="width:178px" %)-|(% style="width:270px" %)domain|(% colspan="2" rowspan="1" style="width:478px" %)one or multiple dimensions 396 -|(% style="width:205px" %)How?|(% style="width:272px" %)unit of measure|(% style="width:178px" %)X|(% style="width:270px" %)development|(% colspan="2" rowspan="1" style="width:478px" %)mand. attribute or dimension 397 -|(% style="width:205px" %)How?|(% style="width:272px" %)unit multiplier|(% style="width:178px" %)X|(% style="width:270px" %)available|(% colspan="2" rowspan="1" style="width:478px" %)mandatory attribute 398 -|(% style="width:205px" %)How?|(% style="width:272px" %)decimals|(% style="width:178px" %)X|(% style="width:270px" %)available|(% colspan="2" rowspan="1" style="width:478px" %)mandatory attribute 399 -|(% style="width:205px" %)How?|(% style="width:272px" %)//adjustment//|(% style="width:178px" %)X|(% style="width:270px" %)development|(% style="width:290px" %)mand. att.|(% style="width:221px" %) not relevant 400 -|(% style="width:205px" %)When?|(% style="width:272px" %)time period|(% style="width:178px" %)X|(% style="width:270px" %)format|(% style="width:290px" %)dimension|(% style="width:221px" %)mand. att. 401 -|(% style="width:205px" %)When?|(% style="width:272px" %)time format|(% style="width:178px" %)X|(% style="width:270px" %)available|(% colspan="2" rowspan="1" style="width:478px" %)mandatory attribute 402 -|(% style="width:205px" %)When?|(% style="width:272px" %)time period – collection|(% style="width:178px" %)X|(% style="width:270px" %)development|(% style="width:290px" %)mand. att.|(% style="width:221px" %)cond. att. 403 -|(% style="width:205px" %)When?|(% style="width:272px" %)data update – last update|(% style="width:178px" %)X|(% style="width:270px" %)time stamp|(% colspan="2" rowspan="1" style="width:478px" %)mandatory attribute 404 -|(% style="width:205px" %)How often?|(% style="width:272px" %)//frequency//|(% style="width:178px" %)X|(% style="width:270px" %)available|(% style="width:290px" %)mand. att. or|(% style="width:221px" %)not relevant 405 -|(% style="width:205px" %)How much?|(% style="width:272px" %)observation value|(% style="width:178px" %)-|(% style="width:270px" %)numeric|(% colspan="2" rowspan="1" style="width:290px" %) measure 392 +|**Question**|**Concept**|**COG**|**Code list**|**Time series Cross-section** 393 +|Where?|reference area|X|revision|mand. attribute or dimension 394 +|What?|“indicator”|-|domain|one or multiple dimensions 395 +|How?|unit of measure|X|development|mand. attribute or dimension 396 +|How?|unit multiplier|X|available|mandatory attribute 397 +|How?|decimals|X|available|mandatory attribute 398 +|How?|//adjustment//|X|development|mand. att. not relevant 399 +|When?|time period|X|format|dimension mand. att. 400 +|When?|time format|X|available|mandatory attribute 401 +|When?|time period – collection|X|development|mand. att. cond. att. 402 +|When?|data update – last update|X|time stamp|mandatory attribute 403 +|How often?|//frequency//|X|available|mand. att. or not relevant 404 +|(% colspan="2" %)How much? observation value|-|numeric|dimension measure 406 406 407 407 ~*~*Concepts in //italics// are only relevant for time series DSDs. An “X” in the COG column means the concept is defined in the COG. Code list “development” means that the SWG will develop a code list to be recommended in the COG; “revision” means that the code list is recommended by the COG and under revision by the SWG; “format” means that a format is defined by another concept; “text”, “time stamp”, and “numeric” provide data types used for uncoded concepts. 408 408 ... ... @@ -410,19 +410,25 @@ 410 410 411 411 **Table 10. Suggested additional concepts for certain scenarios~*~*** 412 412 413 -|**Question**|**Concept**|**COG**|**Code list**|**TS **|**CS**|**Scenario**412 +|**Question**|**Concept**|**COG**|**Code list**|**TS CS**|**Scenario** 414 414 |Who?|compiling agency|X|development|((( 415 -conditional (sibling) 416 -)))|conditional (obs. level)|data provider different from data compiler 414 +conditional conditional 415 + 416 + (sibling) (obs. level) 417 +)))|data provider different from data compiler 417 417 |Who?|((( 418 -confidentiality status – observation 419 -)))|X|available|(% colspan="2" rowspan="1" %)mandatory (obs. level)|except dissemination 420 -|How?|observation status|X|available|(% colspan="2" rowspan="1" %)conditional (obs. level)|except orig. collection 419 +confidentiality 420 + 421 +status – observation 422 +)))|X|available|mandatory (obs. level)|except dissemination 423 +|How?|observation status|X|available|conditional (obs. level)|except orig. collection 421 421 |How much?|((( 422 -//observation pre-break value// 423 -)))|-|numeric|cond. (obs.)|not relevant|except orig. collection 424 -|What and how?|//time series title//|X|text|cond. (TS)|not relevant|dissemination 425 +//observation pre-// 425 425 427 +//break value// 428 +)))|-|numeric|cond. (obs.) not relevant|except orig. collection 429 +|What and how?|//time series title//|X|text|cond. (TS) not relevant|dissemination 430 + 426 426 ~** The legend of Table 9 applies to Table 10 as well. The suggested attachment level of attributes (if any) is provided in parentheses in the TS (time series) or CS (cross-section) columns. In case an attribute does not vary at that level in a certain use case, it should be attached at the highest possible level. 427 427 428 428 == 5.2 Attribute attachment levels and definition of groups == ... ... @@ -444,8 +444,10 @@ 444 444 * //ID//: a unique identifier of the message 445 445 * //Test//: a Boolean attribute that indicates whether the message is for test purposes or not 446 446 * //Prepared//: the date the message was prepared 447 -* //Sender//: the identification of the organization that is transmitting the message (recommended: code from the agency code list in the SDMX COG)452 +* //Sender//: the identification of the organization that is transmitting the message 448 448 454 +(recommended: code from the agency code list in the SDMX COG) 455 + 449 449 From a business perspective, the inclusion of the //Name// element is highly recommended, as it can help to understand the purpose of the exchange message. Other header elements such as //Receiver// are optional. 450 450 451 451 = 6 STEP-BY-STEP GUIDE = ... ... @@ -456,15 +456,13 @@ 456 456 457 457 Figure 1 provides an overview of the overall process. As a first step, the context of the data exchange(s) that should be covered by the DSD(s) is defined in terms of purpose, domains, level of exchange, type of data, type of recipient, role of in data exchange, process pattern, and GSBPM phase (see Figure 2). Since reusing existing artefacts is one of the guiding principles, the second step identifies existing DSDs that may be reused (see Figure 3). In case relevant DSDs are available, their suitability in the present context is evaluated in step 3. Aspects to be taken into account are concept coverage, concept roles, attribute attachment levels, and code lists (see Figure 4). Step 4 is subject to the outcome of step 3. In case of a favorable assessment, the DSDs are simply reused. If the DSDs are partly suitable, modified versions can be derived. See section 2. for a summary of possible DSD modification scenarios. If the DSDs are not suitable or if no relevant DSDs are available at all, new DSDs will be defined as described in section 3. Finally, supporting artefacts such as data flow definitions and data provision agreements are defined (see Figure 5). 458 458 459 -(% class="wikigeneratedid" %) 460 -[[image:1768470533088-795.png]] 461 461 462 462 (% class="wikigeneratedid" id="HFigure1.OverviewoftheDSDdesignprocess" %) 463 463 Figure 1. Overview of the DSD design process 464 464 470 + 465 465 Figure 2 summarizes the characteristics of the data exchange context that is defined in step 1. These characteristics affect the decision on the data structuring approach that is part of the process of defining the concepts of a new DSD (step 4.3. in Figure 1; see Figure 7 in section 2.). 466 466 467 -[[image:1768470575978-226.png]] 468 468 469 469 (% class="wikigeneratedid" id="HFigure2.Characteristicsofdataexchangecontext" %) 470 470 Figure 2. Characteristics of data exchange context ... ... @@ -471,23 +471,20 @@ 471 471 472 472 Figure 3 recaps the priorities given to different types of existing DSDs when searching for candidates for reuse in step 2. Global DSDs maintained by the SDMX consortium are ranked the highest. They can be found via the Global SDMX Registry. 473 473 474 -(% class="wikigeneratedid" %) 475 -[[image:1768470596130-305.png]] 476 476 477 477 (% class="wikigeneratedid" id="HFigure3.PriorityrankingofexistingDSDsforreuse" %) 478 478 Figure 3. Priority ranking of existing DSDs for reuse 479 479 483 + 480 480 Figure 4 summarizes the aspects to be considered in the assessment of the suitability of existing DSDs in step 3. For a detailed description of the cases of partial unsuitability see section 2.1. above. 481 481 482 -(% class="wikigeneratedid" %) 483 -[[image:1768470626558-321.png]] 484 484 485 485 (% class="wikigeneratedid" id="HFigure4.AspectsofDSDsuitability" %) 486 486 Figure 4. Aspects of DSD suitability 487 487 490 + 488 488 Figure 5 lists the most relevant artefacts required in addition to a DSD, its concept scheme, and code lists. 489 489 490 -[[image:1768470646456-652.png]] 491 491 492 492 Figure 5. Supporting artefacts 493 493 ... ... @@ -495,83 +495,48 @@ 495 495 496 496 Figure 6 briefly recapitulates the actions that can be taken to overcome partial unsuitability of DSDs. As far as possible, existing artefacts should be reused in this case. This means that even if a DSD cannot be reused as a whole, concepts and code lists from that DSD can be included in the new DSD by reference. 497 497 498 - [[image:1768470678965-391.png]]500 +**Figure 6. DSD modification scenarios** 499 499 500 -Figure 6. DSD modification scenarios 501 - 502 502 == 6.3 Defining new DSDs == 503 503 504 504 In case no (suitable) DSD is available, the actual process of specifying a new DSD is started. Figure 7 depicts this process (step 4.3. in Figure 1). It encompasses the specification of concepts, code lists, and data formats. All three specification steps include the identification of already existing artefacts that could be reused or modified to satisfy the requirements at hand and the definition of new artefacts in case no suitable artefacts are detected. Several iterations of steps 1 (specification of concepts; see Figure 8) and 2 (specification of code lists; see Figure°13) may be necessary, including revisions of the decision concerning the data structuring approach. Finally all artefacts defined in the previous steps are put together into a DSD. 505 505 506 -(% class="wikigeneratedid" %) 507 -[[image:1768470705894-724.png]] 506 +==== Figure 7. New DSD specification process ==== 508 508 509 -(% class="wikigeneratedid" id="HFigure7.NewDSDspecificationprocess" %) 510 -Figure 7. New DSD specification process 511 - 512 512 Figure 8 outlines step 4.3.1, the process of concept specification. It covers the decision on the structuring approach, the identification of relevant concepts and the assessment of their suitability, the definition of new concepts, concept roles, and attribute attachment levels. 513 513 514 -(% class="wikigeneratedid" %) 515 -[[image:1768470729899-225.png]] 510 +==== Figure 8. Concept specification process ==== 516 516 517 -(% class="wikigeneratedid" id="HFigure8.Conceptspecificationprocess" %) 518 -Figure 8. Concept specification process 519 - 520 520 Both, the decision on reuse of existing concepts as well as the definition of new ones, may lead back to a revision of the data structuring approach. For example, it could turn out that a certain concept needs to be broken down further which may lead from a “few composite dimensions” to a “many pure dimensions” approach. Figure 9 provides the design options involved in the decision on a data structuring approach. The options are defined in terms of the number of DSDs and the number of concepts (especially dimensions). The reasonability and feasibility of these options depend on the context of the present data exchange(s) as defined in the first step of the overall design process and on the content of the data exchange with respect to concepts. 521 521 522 -(% class="wikigeneratedid" %) 523 -[[image:1768470752201-691.png]] 514 +==== Figure 9. DSD design options ==== 524 524 525 -(% class="wikigeneratedid" id="HFigure9.DSDdesignoptions" %) 526 -Figure 9. DSD design options 527 - 528 528 In the second step of new DSD design, relevant existing concepts are identified. Figure 10 indicates potential sources of those concepts such as the SDMX COG for cross-domain concepts, global or other DSDs as already identified earlier in the process, and domain standards such as the UN's System of National Accounts Manual 2008 for domain-specific concepts. 529 529 530 -(% class="wikigeneratedid" %) 531 -[[image:1768470775109-874.png]] 518 +==== Figure 10. Potential sources of concepts and definitions ==== 532 532 533 -(% class="wikigeneratedid" id="HFigure10.Potentialsourcesofconceptsanddefinitions" %) 534 -Figure 10. Potential sources of concepts and definitions 535 - 536 536 The definition of new concepts (step 4.3.1.4.2.) is necessary if no (suitable) concept can be reused. It entails giving each concept a name, a code, and a definition. Further details about the usage of the concepts in the DSD are specified in steps 4.3.1.5. (concept roles), 4.3.1.6. (dimension groups), and 4.3.1.7. (attribute attachment levels). Figure 11 and 12 summarize the possible concept roles and attribute attachment levels. 537 537 538 538 The second step in the process of defining a new DSD is the specification of code lists for all coded concepts. All dimensions must be coded (with time being an exception to this rule); attributes may be coded. For uncoded concepts, a data format has to be specified. Existing formats may be reused or new ones defined. An example is the time format that is specified in the SDMX COG. Figure 13 illustrates the code list specification process. If no relevant and suitable code list exists, a new one will be defined or a partially suitable one will be adapted (see Figure 16). Suitable code lists can simply be reused via reference. 539 539 540 -[[image:1768470796725-270.png]] 541 541 542 -(% class="wikigeneratedid" %) 543 -Figure 11. Possible concept roles 544 - 545 -(% class="wikigeneratedid" %) 546 -[[image:1768470829131-599.png]] 547 - 548 -(% class="wikigeneratedid" %) 549 -Figure 12. Possible attribute attachment levels 550 - 551 -(% class="wikigeneratedid" %) 552 -[[image:1768470860119-204.png]] 553 - 554 554 (% class="wikigeneratedid" id="HFigure13.Codelistspecificationprocess" %) 555 555 Figure 13. Code list specification process 556 556 557 - (% class="wikigeneratedid" %)528 + 558 558 Figure 14 recaps the priorities given to different types of existing code lists when searching for candidates for reuse (step 4.3.2.1.). Code lists recommended by the SDMX COG (and maintained by the SDMX consortium) are ranked the highest. 559 559 560 -[[image:1768470878394-873.png]] 561 561 562 562 (% class="wikigeneratedid" id="HFigure14.Priorityrankingofexistingcodelistsforreuse" %) 563 563 Figure 14. Priority ranking of existing code lists for reuse 564 564 565 - (% class="wikigeneratedid" %)535 + 566 566 Figure 15 summarizes the aspects to be considered in the evaluation of the suitability of existing code lists (step 4.3.2.2.). Figure 16 summarizes the scenarios of adapting existing code lists that do not fully meet the specified needs (step 4.3.2.3.2). For a detailed description of the cases of partial unsuitability see section 2.1. above. 567 567 568 -[[image:1768470896763-366.png]] 569 569 570 570 (% class="wikigeneratedid" id="HFigure15.Aspectsofcodelistsuitability" %) 571 571 Figure 15. Aspects of code list suitability 572 572 573 -(% class="wikigeneratedid" %) 574 -[[image:1768470911321-123.png]] 575 575 576 576 (% class="wikigeneratedid" id="HFigure16.Codelistmodificationscenarios" %) 577 577 Figure 16. Code list modification scenarios ... ... @@ -584,11 +584,8 @@ 584 584 585 585 Figure 17 provides an overview of all steps in the DSD design process as described in the previous subsections 1. to 3. Figure 18 compiles those steps into a checklist for DSD designers to help them make sure all aspects are considered. 586 586 587 -[[image:1768471052577-528.png]] 588 - 589 589 Figure 17. DSD design process 590 590 591 -[[image:1768470939545-136.png]] 592 592 593 593 Figure 18. Checklist for DSD design process 594 594 ... ... @@ -614,7 +614,7 @@ 614 614 615 615 == 9.1 SDMX Documents == 616 616 617 -The SDMX documents referred to in these guidelines as well as the complete technical specification of the SDMX Technical Standard 2.1 (and earlier versions) are available online at [[http:~~/~~/sdmx.org/>>https://http:sdmx.org]].The SDMX documents currently under development by the Statistical and Technical Working Groups will also be made available on the SDMX website.581 +The SDMX documents referred to in these guidelines as well as the complete technical specification of the SDMX Technical Standard 2.1 (and earlier versions) are available online at http:~/~/sdmx.org/. The SDMX documents currently under development by the Statistical and Technical Working Groups will also be made available on the SDMX website. 618 618 619 619 === 9.1.1 Existing documents === 620 620 ... ... @@ -638,12 +638,10 @@ 638 638 639 639 == 9.2 Non-SDMX Documents == 640 640 641 -6th Edition of the IMF's Balance of Payments Manual (BPM6). Available online at [[http:~~/~~/www.imf.org/external/pubs/ft/bop/2007/bopman6.htm>>https://http:www.imf.orgexternalpubsftbop2007bopman6.htm||rel="noopener noreferrer" target="_blank"]].605 +6th Edition of the IMF's Balance of Payments Manual (BPM6). Available online at http:~/~/www.imf.org/external/pubs/ft/bop/2007/bopman6.htm. 642 642 643 -METIS: Generic Statistical Business Process Model (GSBPM). Available online at [[http:~~/~~/www1.unece.org/stat/platform/display/metis/The+Generic+Statistical+Business+Process+Model>>https://http:www1.unece.orgstatplatformdisplaymetisThe+Generic+Statistical+Business+Process+Model||rel="noopener noreferrer" target="_blank"]].607 +METIS: Generic Statistical Business Process Model (GSBPM). Available online at http:~/~/www1.unece.org/stat/platform/display/metis/The+Generic+Statistical+Business+Process+Model. UN's System of National Accounts Manual 2008 (SNA2008). Available online at http:~/~/unstats.un.org/unsd/nationalaccount/sna2008.asp. 644 644 645 -UN's System of National Accounts Manual 2008 (SNA2008). Available online at [[http:~~/~~/unstats.un.org/unsd/nationalaccount/sna2008.asp>>https://http:unstats.un.orgunsdnationalaccountsna2008.asp||rel="noopener noreferrer" target="_blank"]]. 646 - 647 647 ---- 648 648 649 649 {{putFootnotes/}}
- 1768470533088-795.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -48.6 KB - Content
- 1768470575978-226.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -95.8 KB - Content
- 1768470596130-305.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -44.4 KB - Content
- 1768470611326-907.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -51.5 KB - Content
- 1768470626558-321.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -51.5 KB - Content
- 1768470646456-652.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -32.7 KB - Content
- 1768470678965-391.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -117.9 KB - Content
- 1768470705894-724.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -23.9 KB - Content
- 1768470729899-225.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -66.5 KB - Content
- 1768470752201-691.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -38.0 KB - Content
- 1768470775109-874.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -36.5 KB - Content
- 1768470796725-270.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -30.7 KB - Content
- 1768470829131-599.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -30.8 KB - Content
- 1768470860119-204.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -37.9 KB - Content
- 1768470878394-873.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -49.7 KB - Content
- 1768470896763-366.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -29.9 KB - Content
- 1768470911321-123.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -49.2 KB - Content
- 1768470939545-136.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -143.4 KB - Content
- 1768471052577-528.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -xwiki:XWiki.helena - Size
-
... ... @@ -1,1 +1,0 @@ 1 -97.4 KB - Content