Changes for page Guidelines for SDMX Data Structure Definitions
Last modified by Artur K. on 2026/05/29 14:28
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -296,14 +296,15 @@ 296 296 297 297 **Table 6. Data structuring approaches by role in data exchange** 298 298 299 -| (% style="width:215px" %)**Role in data exchange**|(% style="width:1400px" %)**Pure vs. composite concepts approach**300 -| (% style="width:215px" %)**Data provider**|(% style="width:1400px" %)(((299 +|**Role in data exchange**|**Pure vs. composite concepts approach** 300 +|**Data provider**|((( 301 301 If the composition of the concepts in the data provider's production system largely differs from the one in the DSD, mapping it to a few composite concepts may be more complex than mapping it to many pure concepts. (Mapping to just one mixed concept is straightforward, though.) This is due to the need to decompose and recombine concepts in case of a “mixed concepts” DSD. If the data provider’s internal data structure is very granular or very similar to the DSD, it does not make a huge difference if the concepts in that DSD are pure or not. 302 + 302 302 For a “final” data provider disseminating data to the public, the flexibility offered by a pure data structure in terms of defining different output formats may be beneficial. 303 303 ))) 304 -| (% style="width:215px" %)**Data collector**|(% style="width:1400px" %)Defining constraints for data validation is more complex for a highdimensional, pure DSD. But such a DSD provides more flexibility in terms of consumption and reuse, i.e. mapping to the data collector’s internal data model mapping easier.305 -| (% style="width:215px" %)**DSD maintenance**|(% style="width:1400px" %)Pure concepts usually have shorter, less complex code lists and are thus easier to maintain. In contrast, the maintenance of constraints, hierarchical code lists, and derived, composite concepts (e.g. for dissemination) requires more effort.306 -| (% style="width:215px" %)**End user (“the public”)**|(% style="width:1400px" %)Consumption and reuse are more flexible in a pure data structure, but it is more difficult to identify observation keys that actually have data because of the created sparseness. (Constraints may help in this respect.) Frequent occurrences of “non applicable” values may also make data usage cumbersome.305 +|**Data collector**|Defining constraints for data validation is more complex for a highdimensional, pure DSD. But such a DSD provides more flexibility in terms of consumption and reuse, i.e. mapping to the data collector’s internal data model mapping easier. 306 +|**DSD maintenance**|Pure concepts usually have shorter, less complex code lists and are thus easier to maintain. In contrast, the maintenance of constraints, hierarchical code lists, and derived, composite concepts (e.g. for dissemination) requires more effort. 307 +|**End user (“the public”)**|Consumption and reuse are more flexible in a pure data structure, but it is more difficult to identify observation keys that actually have data because of the created sparseness. (Constraints may help in this respect.) Frequent occurrences of “non applicable” values may also make data usage cumbersome. 307 307 308 308 == 4.2 Number and relations of DSDs == 309 309 ... ... @@ -325,22 +325,36 @@ 325 325 326 326 **Table 7. Data structuring approaches by level of data exchange** 327 327 328 -|(% colspan="1" rowspan="2" %)**Level of data exchange**|(% colspan="4" rowspan="1" %)**Data structuring approach** 329 -|**one DSD**|(% colspan="2" %)**master + satellite DSDs**|**multiple, indep. DSDs** 329 +|**Level of data exchange**|**Data structuring approa one DSD**|(% colspan="2" %)((( 330 +**ch** 331 + 332 +**master + satellite DSDs** 333 +)))|**multiple, indep. DSDs** 330 330 |**within organization**|((( 331 -best for single-domain, single-purpose can be created on the fly from structured databases 335 +best for single-domain, single-purpose can be created on the 336 + 337 +fly from structured databases 332 332 )))|(% colspan="2" %)use if harmonization is important in covered domains or purposes or if such a set of DSDs is already available at international level|easier to do than master + satellite approach each domain/purpose can maintain DSDs independently can be created on the fly from structured databases 333 333 |**between national organizations**|(% colspan="4" %)the same applies as to the “within organization” scenario 340 +|**Level of data exchange**|(% colspan="3" %)((( 341 +**Data structuring approach** 342 + 343 +**one DSD master + satellite DSDs** 344 +)))|**multiple, indep. DSDs** 334 334 |**between int. organization and national organizations**|(% colspan="2" %)best for single domain, single purpose scenarios that are usually rather restricted with very clear specification of what needs to be exchanged|preferable over multiDSD approach in case of multi-domain and/or multi-purpose scenarios with highly correlated data flows for maintenance reasons|((( 335 -for multi-domain and/or multipurpose scenarios; only recommended if overlap of domains/purposes is minor (e.g. just w.r.t. cross-domain concepts) equivalent to multiple “one DSD” solutions, one for each domain / purpose 346 +for multi-domain and/or multipurpose scenarios; only recommended if overlap of domains/purposes is minor (e.g. just w.r.t. cross-domain concepts) 347 + 348 +equivalent to multiple “one DSD” solutions, one for each domain / purpose 336 336 ))) 337 337 |**between international organizations**|(% colspan="3" %)comparable to “national to international” scenario| 338 338 |**dissemination to public**|(% colspan="2" %)for single-domain, single-purpose cases in more complex cases this may be the preferable approach for data discovery tools (one data structure to find and access all data)|(% colspan="2" %)((( 339 339 in multi-purpose or –domain scenarios: 340 340 341 -* if it is relevant for the public to see the relationship between the data structures: use master + satellites approach 342 -* otherwise the multi-DSD option is preferable, although with the highest possible degree of re-use of code lists and concepts 343 -* in both cases: important to include only concepts, code lists, and codes actually available / used by the data 354 +if it is relevant for the public to see the relationship between the data structures: use master + satellites approach 355 + 356 +otherwise the multi-DSD option is preferable, although with the highest possible degree of re-use of code lists and concepts 357 + 358 +in both cases: important to include only concepts, code lists, and codes actually available / used by the data 344 344 ))) 345 345 346 346 In general, finding the “perfect” data structure is less important for bilateral data exchange. Independent, custom-tailored DSDs may do the job quite well, as harmonization and standardization are typically not of high importance. If the data exchange is just a part of a more comprehensive scenario (e.g. multi-purpose, multi-domain, gateway, or data-sharing scenarios), a master DSD with satellite DSDs is preferable. ... ... @@ -349,17 +349,20 @@ 349 349 350 350 **Table 8. Data structuring approaches by role in data exchange** 351 351 352 -| (% style="width:216px" %)**Role in data exchange**|(% style="width:1399px" %)**One DSD vs. master + satellite DSDs vs. multiple, indep. DSDs**353 -| (% style="width:216px" %)**Data provider**|(% style="width:1399px" %)It is easier to set up a data submission process against a single DSD (= less initial costs) than against multiple DSDs.354 -| (% style="width:216px" %)**Data collector**|(% style="width:1399px" %)(((367 +|**Role in data exchange**|**One DSD vs. master + satellite DSDs vs. multiple, indep. DSDs** 368 +|**Data provider**|It is easier to set up a data submission process against a single DSD (= less initial costs) than against multiple DSDs. 369 +|**Data collector**|((( 355 355 Data validation is easier with DSDs that only cover what needs to be collected. This is achieved via constraints in the master + satellites approach or via tailor-made independent DSDs. If a single DSD is used in a multi-domain or –purpose scenario, necessary constraints can be specified in the data flow definition or data provision agreement. 371 + 356 356 Further processing of collected data is more flexible and easier if relations are transparent and code lists are shared as in the one DSD or master + satellite DSDs approaches. The “shared context” created through the master DSD increases harmonization and standardization and this way facilitates combined usage of data. 357 357 ))) 358 -|(% style="width:216px" %)**DSD maintenance**|(% style="width:1399px" %)((( 374 +|**Role in data exchange**|**One DSD vs. master + satellite DSDs vs. multiple, indep. DSDs** 375 +|**DSD maintenance**|((( 359 359 The complexity and initial costs for developing and maintaining master + satellite DSDs are higher than for independent DSDs as this involves managing constraints and managing impacts of changes in shared code lists to all DSDs. 377 + 360 360 In the multiple independent DSDs approach, development and maintenance efforts may be distributed. This can be seen as an advantage, but on the other hand requires coordination in case the DSDs are only partially independent (i.e. share some code lists). 361 361 ))) 362 -| (% style="width:216px" %)**End user (“the public”)**|(% style="width:1399px" %)For data discovery and retrieval the user needs to know what data is actually available (instead of what might be collected/disseminated with a certain data structure). This means that the potential sparseness should be hidden from the user. A reduced DSD derived from the data structure used in the background is more useful in most cases. Whether this is done via one DSD and constraints, master + satellite DSDs, or independent DSDs does not matter that much for the user.380 +|**End user (“the public”)**|For data discovery and retrieval the user needs to know what data is actually available (instead of what might be collected/disseminated with a certain data structure). This means that the potential sparseness should be hidden from the user. A reduced DSD derived from the data structure used in the background is more useful in most cases. Whether this is done via one DSD and constraints, master + satellite DSDs, or independent DSDs does not matter that much for the user. 363 363 364 364 = 5 MINIMUM STRUCTURAL AND SEMANTIC REQUIREMENTS = 365 365