Changes for page SDMX 3.0 Standards. Summary of Major Changes and New Functionality
Last modified by Helena on 2025/09/10 11:19
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -363,12 +363,12 @@ 363 363 364 364 The version 3.0 model has been extended to provide explicit support for geospatial data. 365 365 366 - (% class="wikigeneratedid" id="HGeospatialInformationtype"%)367 - **GeospatialInformation type**366 +=== GeospatialInformation type === 367 + 368 368 A new GeospatialInformation string type has been added which can be used as the 214 representation for any dimension, attribute or measure component. The value which is a 215 string expression conforming to the syntax defined in Section 6 of the technical 216 specifications precisely defines a ‘Geo Feature Set’ – a collection of geographical 217 features like points, lines or polygons. Its use is recommended in conjunction with the “GEO_FEATURE_SET” concept role. 369 369 370 - (% class="wikigeneratedid" id="HGeospatialcodelists"%)371 - **Geospatial code lists**370 +=== Geospatial code lists === 371 + 372 372 Two new specialised types of code list have been added where the definition of each code includes additional geospatial information in addition to the standard ID, name and description: 373 373 374 374 * GeographicCodelist – each item includes an element to represent a specific Geo Feature Set which is described using the same expression syntax as for GeospatialInformation type. ... ... @@ -451,6 +451,7 @@ 451 451 Examples: 452 452 453 453 SDMX:CL_AREA(1.0.0) 454 + 454 454 SDMX:CL_AREA(2.3.2) 455 455 456 456 == Dependency management == ... ... @@ -457,9 +457,10 @@ 457 457 458 458 Additional constructs are possible for dependency management when referencing structures. For instance: 459 459 460 -2.3+.1 Means the currently latest available version >= “2.3.1” and < “3.0.0” (all backwards compatible versions >= “2.3.1”). 461 -2+.3.1 Means the currently latest available version >= “2.3.1” (even if not backwards compatible). 461 +2.3+.1 Means the currently latest available version >= “2.3.1” and < “3.0.0” (all backwards compatible versions >= “2.3.1”). 462 462 463 +2+.3.1 Means the currently latest available version >= “2.3.1” (even if not backwards compatible). 464 + 463 463 == Draft structures == 464 464 465 465 A key principle is that semantically versioned structures are immutable and must not be changed without a corresponding change to the version number, except where explicitly marked as draft using extensions to the version number. ... ... @@ -466,10 +466,12 @@ 466 466 467 467 MAJOR.MINOR.PATCH-EXTENSION 468 468 469 -1.10.0-draft Means that version 1.10.0 is still being modified and may change – equivalent to setting isFinal=false in SDMX 2.1. 470 -1.10.0-unstable Alternative to -draft. 471 -1.10.0-notfinal Alternative to -draft. 471 +1.10.0-draft Means that version 1.10.0 is still being modified and may change – equivalent to setting isFinal=false in SDMX 2.1. 472 472 473 +1.10.0-unstable Alternative to -draft. 474 + 475 +1.10.0-notfinal Alternative to -draft. 476 + 473 473 The SDMX 2.1 isFinal property is deprecated in 3.0. 474 474 475 475 = 5 REST Web Services API = ... ... @@ -492,8 +492,8 @@ 492 492 493 493 Data queries have been changed to provide more granular selections from contexts wider than just a Dataflow. 494 494 495 - (% class="wikigeneratedid" id="HExtendthecontextofdataretrieval"%)496 - **Extend the context of data retrieval**499 +=== Extend the context of data retrieval === 500 + 497 497 Version 2.1 data queries always retrieved data from a single specific Dataflow. In version 3.0, the query context may be specified as: 498 498 499 499 * Dataflow; ... ... @@ -502,20 +502,18 @@ 502 502 503 503 Data queries may also search across datasets, for instance “retrieve all data about a country”. 504 504 505 - (% class="wikigeneratedid" id="HComponent-basedfilters"%)506 - **Component-based filters**509 +=== Component-based filters === 510 + 507 507 Expressions filtering on individual components can now be included as part of the data query URL. 508 508 509 509 /data/dataflow/ESTAT/ICP?c[REF_AREA]=CH&c[CONF_STATUS]=F 510 510 511 - (% class="wikigeneratedid" id="HSupportforoperators"%)512 - **Support for operators**515 +=== Support for operators === 516 + 513 513 Filter expressions can also include operators. 514 514 515 -/data/dataflow/ESTAT/ICP?c[REF_AREA]=DE&c[ICP_ITEM]=sw:01&c[TIME_PERIOD]=ge:2015 519 +/data/dataflow/ESTAT/ICP?c[REF_AREA]=DE&c[ICP_ITEM]=sw:01&c[TIME_PERIOD]=ge:2015 Operators include: 516 516 517 -Operators include: 518 - 519 519 (% style="width:531.039px" %) 520 520 |(% style="width:151px" %)eq|(% style="width:378px" %)Equals 521 521 |(% style="width:151px" %)ne|(% style="width:378px" %)Not equal to ... ... @@ -523,11 +523,10 @@ 523 523 |(% style="width:151px" %)ge|(% style="width:378px" %)Greater than or equal to 524 524 |(% style="width:151px" %)sw|(% style="width:378px" %)Starts with 525 525 526 - (% class="wikigeneratedid" id="HSupportformultiplekeys"%)527 - **Support for multiple keys**528 +=== Support for multiple keys === 529 + 528 528 Queries can now specify multiple series keys. 529 529 530 -(% class="wikigeneratedid" %) 531 531 /data/dataflow/ESTAT/ICP/1.0.0/M…A.ANR,M…A.INX,M…B.CTG 532 532 533 533 == 5.3 Improved reference metadata queries == ... ... @@ -558,8 +558,8 @@ 558 558 559 559 The SDMX-ML XML messages have been modified and updated for version 3.0. While they broadly follow the same principles, there have been significant changes which break backward compatibility. 560 560 561 - (% class="wikigeneratedid" id="HStructuremessage"%)562 - **Structure message**562 +=== Structure message === 563 + 563 563 The SDMX-ML structure message is used for transmission of structural metadata. It closely reflects the SDMX information model and has therefore been significantly updated for version 3.0 with the addition of new structures, modifications where structures have changed, and removal of deprecated structures like Structure Set. 564 564 565 565 Additionally, the way the individual artefacts are organised into ‘collections’ within the message has been significantly revised with a simpler flat structure adopted as set out in the following table: ... ... @@ -610,8 +610,8 @@ 610 610 611 611 From version 3.0, collections can appear in any order within a structure message. 612 612 613 - (% class="wikigeneratedid" id="HDatamessages"%)614 - **Data messages**614 +=== Data messages === 615 + 615 615 All legacy SDMX-ML data messages have been deprecated with the exception of Structure Specific Data which becomes the sole standard format for transmission of SDMX data in XML in version 3.0. 616 616 617 617 Specifically, the following data messages are not supported in version 3.0: ... ... @@ -628,16 +628,16 @@ 628 628 629 629 The time series variant of the Structure Specific Data message is no longer used. 630 630 631 - (% class="wikigeneratedid" id="HReferencemetadatamessage"%)632 - **Reference metadata message**632 +=== Reference metadata message === 633 + 633 633 The Generic Metadata message remains the standard format for transmission of reference metadata sets in XML but has been modified to support the revised version 3.0 reference metadata model. 634 634 635 - (% class="wikigeneratedid" id="HRegistrystructuralmetadata2018query2019messages"%)636 - **Registry structural metadata ‘query’ messages**636 +=== Registry structural metadata ‘query’ messages === 637 + 637 637 As a consequence of the deprecation of the SOAP API and standardisation on REST, the structural metadata ‘query’ messages have all been removed. In version 3.0, querying an SDMX Registry for structural metadata is performed solely using REST GET. 638 638 639 - (% class="wikigeneratedid" id="HStructurereferencing"%)640 - **Structure referencing**640 +=== Structure referencing === 641 + 641 641 The option to reference structures using Agency, ID and Version has been removed. From SDMX version 3.0 URN is used for all referencing purposes with the exception of local references such as where groups reference dimensions within a DSD. 642 642 643 643 == 6.2 SDMX-JSON == ... ... @@ -644,20 +644,20 @@ 644 644 645 645 Like SDMX-ML, the SDMX-JSON messages have been significantly modified and updated for version 3.0. They are not backwardly compatible with version 2.1. 646 646 647 - (% class="wikigeneratedid" id="HStructuremessage-1"%)648 - **Structure message**648 +=== Structure message === 649 + 649 649 The SDMX-JSON structure message closely replicates the SDMX-ML equivalent. Like that of SDMX-ML it has been updated to align it with the version 3.0 information model with addition, deletion and modification of artefacts as required. The organisation of the structure collections has also been revised as detailed in paragraph 6.1. 650 650 651 - (% class="wikigeneratedid" id="HDatamessage"%)652 - **Data message**652 +=== Data message === 653 + 653 653 The SDMX-JSON data message has similarly be updated. Additional changes have been made to allow a single message to carry data from multiple datasets with potentially different Data Structure Definitions to support REST data queries of the form “retrieve all data about a country”. For this reason, the version 3.0 SDMX-JSON is not backwardly compatible with version 2.1 data messages. Support has been added for the transmission of microdata and reporting of reference metadata on data as an integral part of the dataset. 654 654 655 - (% class="wikigeneratedid" id="HReferencemetadatamessage-1"%)656 - **Reference metadata message**656 +=== Reference metadata message === 657 + 657 657 The SDMX-JSON metadata message has also been updated to support the version 3.0 reference metadata and Metadataset specifications. 658 658 659 - (% class="wikigeneratedid" id="HStructurereferencing-1"%)660 - **Structure referencing**660 +=== Structure referencing === 661 + 661 661 As for SDMX-ML, the option to reference structures using Agency, ID and Version has been removed with URN used for all non-local referencing purposes. 662 662 663 663 == 6.3 SDMX-CSV == ... ... @@ -664,8 +664,8 @@ 664 664 665 665 CSV in SDMX is used transmission of data and reference metadata only. 666 666 667 - (% class="wikigeneratedid" id="HDatamessage-1"%)668 - **Data message**668 +=== Data message === 669 + 669 669 The SDMX-CSV data message has been modified to align with the version 3.0 information model, support the enhanced REST API and ensure that data can be freely converted to and from the XML and JSON formats without loss. These changes include: 670 670 671 671 * An additional column identifying the type if the artefact defining the structure of the data: “dataflow”, “datastructure” or “dataprovision”; • A column for the structure artefact’s identification of the form ... ... @@ -674,8 +674,8 @@ 674 674 675 675 * A column for the dataset action: information, append, replace or delete, which is consistent with both the the SDMX-ML and SDMX-JSON data messages. 676 676 677 - (% class="wikigeneratedid" id="HReferencemetadatamessage-2"%)678 - **Reference metadata message**678 +=== Reference metadata message === 679 + 679 679 The SDMX-CSV metadata message is new for version 3.0 and, like the SDMX-ML and SDMX-JSON equivalents, is used for the transmission reference metadata sets. 680 680 681 681 === 6.4 EDI deprecation ===