Last modified by Helena on 2025/09/10 11:19

From version 16.9
edited by Helena
on 2025/05/16 13:24
Change comment: There is no comment for this version
To version 15.6
edited by Helena
on 2025/05/16 13:16
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -247,8 +247,8 @@
247 247  
248 248  Reference metadata has been substantially re-designed for version 3.0 to simplify the model and better support practical use cases.
249 249  
250 -(% class="wikigeneratedid" id="HSimplifyMetadataStructureDefinition" %)
251 -**Simplify Metadata Structure Definition**
250 +=== Simplify Metadata Structure Definition ===
251 +
252 252  The Metadata Structure Definition (MSD) has been simplified to remove target information, and the support of multiple report structures. The MSD now only contains Metadata Attributes which are used to define the structure of a report.
253 253  
254 254  [[image:SDMX 3-0-0 Major Changes FINAL-1.0_en_ad5f5c97.png||height="346" width="494"]]
... ... @@ -259,8 +259,8 @@
259 259  
260 260  //Figure 3 the simplified version 3.0 MSD//
261 261  
262 -(% class="wikigeneratedid" id="HChangetoreferencemetadatareportedagainstdata" %)
263 -**Change to reference metadata reported against data**
262 +=== Change to reference metadata reported against data ===
263 +
264 264  Reference metadata associated with datasets, data series or observations are now reported with the data. The dataset’s DSD must reference an MSD to define the structure of its reference metadata. In practice reference metadata for data are transmitted as part of the data message. The metadata attributes are treated in a similar way to the data attributes appearing in the message at the dataset, data series or individual observation level as appropriate. In contrast to simple data attributes, metadata attributes defined by an MSD can be organised into a hierarchical structure as illustrated in Figure 3 above. For this reason, metadata attributes appear in data messages structured in the same way as metadata messages.
265 265  
266 266  The SDMX-ML example below is an excerpt from a structure specific data message illustrating reporting of reference metadata with a hierarchical structure at the observation level.
... ... @@ -363,12 +363,12 @@
363 363  
364 364  The version 3.0 model has been extended to provide explicit support for geospatial data.
365 365  
366 -(% class="wikigeneratedid" id="HGeospatialInformationtype" %)
367 -**GeospatialInformation type**
366 +=== GeospatialInformation type ===
367 +
368 368  A new GeospatialInformation string type has been added which can be used as the 214 representation for any dimension, attribute or measure component. The value which is a 215 string expression conforming to the syntax defined in Section 6 of the technical 216 specifications precisely defines a ‘Geo Feature Set’ – a collection of geographical 217 features like points, lines or polygons. Its use is recommended in conjunction with the “GEO_FEATURE_SET” concept role.
369 369  
370 -(% class="wikigeneratedid" id="HGeospatialcodelists" %)
371 -**Geospatial code lists**
370 +=== Geospatial code lists ===
371 +
372 372  Two new specialised types of code list have been added where the definition of each code includes additional geospatial information in addition to the standard ID, name and description:
373 373  
374 374  * GeographicCodelist – each item includes an element to represent a specific Geo Feature Set which is described using the same expression syntax as for GeospatialInformation type.
... ... @@ -451,6 +451,7 @@
451 451  Examples:
452 452  
453 453  SDMX:CL_AREA(1.0.0)
454 +
454 454  SDMX:CL_AREA(2.3.2)
455 455  
456 456  == Dependency management ==
... ... @@ -457,9 +457,10 @@
457 457  
458 458  Additional constructs are possible for dependency management when referencing structures. For instance:
459 459  
460 -2.3+.1  Means the currently latest available version >= “2.3.1” and < “3.0.0” (all backwards compatible versions >= “2.3.1”).
461 -2+.3.1  Means the currently latest available version >= “2.3.1” (even if not backwards compatible).
461 +2.3+.1 Means the currently latest available version >= “2.3.1” and < “3.0.0” (all backwards compatible versions >= “2.3.1”).
462 462  
463 +2+.3.1 Means the currently latest available version >= “2.3.1” (even if not backwards compatible).
464 +
463 463  == Draft structures ==
464 464  
465 465  A key principle is that semantically versioned structures are immutable and must not be changed without a corresponding change to the version number, except where explicitly marked as draft using extensions to the version number.
... ... @@ -466,10 +466,12 @@
466 466  
467 467  MAJOR.MINOR.PATCH-EXTENSION
468 468  
469 -1.10.0-draft  Means that version 1.10.0 is still being modified and may change – equivalent to setting isFinal=false in SDMX 2.1.
470 -1.10.0-unstable  Alternative to -draft.
471 -1.10.0-notfinal  Alternative to -draft.
471 +1.10.0-draft Means that version 1.10.0 is still being modified and may change – equivalent to setting isFinal=false in SDMX 2.1.
472 472  
473 +1.10.0-unstable Alternative to -draft.
474 +
475 +1.10.0-notfinal Alternative to -draft.
476 +
473 473  The SDMX 2.1 isFinal property is deprecated in 3.0.
474 474  
475 475  = 5 REST Web Services API =
... ... @@ -492,8 +492,8 @@
492 492  
493 493  Data queries have been changed to provide more granular selections from contexts wider than just a Dataflow.
494 494  
495 -(% class="wikigeneratedid" id="HExtendthecontextofdataretrieval" %)
496 -**Extend the context of data retrieval**
499 +=== Extend the context of data retrieval ===
500 +
497 497  Version 2.1 data queries always retrieved data from a single specific Dataflow. In version 3.0, the query context may be specified as:
498 498  
499 499  * Dataflow;
... ... @@ -502,20 +502,18 @@
502 502  
503 503  Data queries may also search across datasets, for instance “retrieve all data about a country”.
504 504  
505 -(% class="wikigeneratedid" id="HComponent-basedfilters" %)
506 -**Component-based filters**
509 +=== Component-based filters ===
510 +
507 507  Expressions filtering on individual components can now be included as part of the data query URL.
508 508  
509 509  /data/dataflow/ESTAT/ICP?c[REF_AREA]=CH&c[CONF_STATUS]=F
510 510  
511 -(% class="wikigeneratedid" id="HSupportforoperators" %)
512 -**Support for operators**
515 +=== Support for operators ===
516 +
513 513  Filter expressions can also include operators.
514 514  
515 -/data/dataflow/ESTAT/ICP?c[REF_AREA]=DE&c[ICP_ITEM]=sw:01&c[TIME_PERIOD]=ge:2015
519 +/data/dataflow/ESTAT/ICP?c[REF_AREA]=DE&c[ICP_ITEM]=sw:01&c[TIME_PERIOD]=ge:2015 Operators include:
516 516  
517 -Operators include:
518 -
519 519  (% style="width:531.039px" %)
520 520  |(% style="width:151px" %)eq|(% style="width:378px" %)Equals
521 521  |(% style="width:151px" %)ne|(% style="width:378px" %)Not equal to
... ... @@ -523,11 +523,10 @@
523 523  |(% style="width:151px" %)ge|(% style="width:378px" %)Greater than or equal to
524 524  |(% style="width:151px" %)sw|(% style="width:378px" %)Starts with
525 525  
526 -(% class="wikigeneratedid" id="HSupportformultiplekeys" %)
527 -**Support for multiple keys**
528 +=== Support for multiple keys ===
529 +
528 528  Queries can now specify multiple series keys.
529 529  
530 -(% class="wikigeneratedid" %)
531 531  /data/dataflow/ESTAT/ICP/1.0.0/M…A.ANR,M…A.INX,M…B.CTG
532 532  
533 533  == 5.3 Improved reference metadata queries ==
... ... @@ -558,8 +558,8 @@
558 558  
559 559  The SDMX-ML XML messages have been modified and updated for version 3.0. While they broadly follow the same principles, there have been significant changes which break backward compatibility.
560 560  
561 -(% class="wikigeneratedid" id="HStructuremessage" %)
562 -**Structure message**
562 +=== Structure message ===
563 +
563 563  The SDMX-ML structure message is used for transmission of structural metadata. It closely reflects the SDMX information model and has therefore been significantly updated for version 3.0 with the addition of new structures, modifications where structures have changed, and removal of deprecated structures like Structure Set.
564 564  
565 565  Additionally, the way the individual artefacts are organised into ‘collections’ within the message has been significantly revised with a simpler flat structure adopted as set out in the following table:
... ... @@ -610,8 +610,8 @@
610 610  
611 611  From version 3.0, collections can appear in any order within a structure message.
612 612  
613 -(% class="wikigeneratedid" id="HDatamessages" %)
614 -**Data messages**
614 +=== Data messages ===
615 +
615 615  All legacy SDMX-ML data messages have been deprecated with the exception of Structure Specific Data which becomes the sole standard format for transmission of SDMX data in XML in version 3.0.
616 616  
617 617  Specifically, the following data messages are not supported in version 3.0:
... ... @@ -628,16 +628,16 @@
628 628  
629 629  The time series variant of the Structure Specific Data message is no longer used.
630 630  
631 -(% class="wikigeneratedid" id="HReferencemetadatamessage" %)
632 -**Reference metadata message**
632 +=== Reference metadata message ===
633 +
633 633  The Generic Metadata message remains the standard format for transmission of reference metadata sets in XML but has been modified to support the revised version 3.0 reference metadata model.
634 634  
635 -(% class="wikigeneratedid" id="HRegistrystructuralmetadata2018query2019messages" %)
636 -**Registry structural metadata ‘query’ messages**
636 +=== Registry structural metadataquerymessages ===
637 +
637 637  As a consequence of the deprecation of the SOAP API and standardisation on REST, the structural metadata ‘query’ messages have all been removed. In version 3.0, querying an SDMX Registry for structural metadata is performed solely using REST GET.
638 638  
639 -(% class="wikigeneratedid" id="HStructurereferencing" %)
640 -**Structure referencing**
640 +=== Structure referencing ===
641 +
641 641  The option to reference structures using Agency, ID and Version has been removed. From SDMX version 3.0 URN is used for all referencing purposes with the exception of local references such as where groups reference dimensions within a DSD.
642 642  
643 643  == 6.2 SDMX-JSON ==
... ... @@ -644,20 +644,20 @@
644 644  
645 645  Like SDMX-ML, the SDMX-JSON messages have been significantly modified and updated for version 3.0. They are not backwardly compatible with version 2.1.
646 646  
647 -(% class="wikigeneratedid" id="HStructuremessage-1" %)
648 -**Structure message**
648 +=== Structure message ===
649 +
649 649  The SDMX-JSON structure message closely replicates the SDMX-ML equivalent. Like that of SDMX-ML it has been updated to align it with the version 3.0 information model with addition, deletion and modification of artefacts as required. The organisation of the structure collections has also been revised as detailed in paragraph 6.1.
650 650  
651 -(% class="wikigeneratedid" id="HDatamessage" %)
652 -**Data message**
652 +=== Data message ===
653 +
653 653  The SDMX-JSON data message has similarly be updated. Additional changes have been made to allow a single message to carry data from multiple datasets with potentially different Data Structure Definitions to support REST data queries of the form “retrieve all data about a country”. For this reason, the version 3.0 SDMX-JSON is not backwardly compatible with version 2.1 data messages. Support has been added for the transmission of microdata and reporting of reference metadata on data as an integral part of the dataset.
654 654  
655 -(% class="wikigeneratedid" id="HReferencemetadatamessage-1" %)
656 -**Reference metadata message**
656 +=== Reference metadata message ===
657 +
657 657  The SDMX-JSON metadata message has also been updated to support the version 3.0 reference metadata and Metadataset specifications.
658 658  
659 -(% class="wikigeneratedid" id="HStructurereferencing-1" %)
660 -**Structure referencing**
660 +=== Structure referencing ===
661 +
661 661  As for SDMX-ML, the option to reference structures using Agency, ID and Version has been removed with URN used for all non-local referencing purposes.
662 662  
663 663  == 6.3 SDMX-CSV ==