Changes for page Guidelines for Confidentiality and Embargo in SDMX
Last modified by Artur K. on 2026/05/29 14:28
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -70,12 +70,13 @@ 70 70 71 71 The forwarding of confidential data is represented as follows in SDMX: 72 72 73 -{{box}} 74 -**SDMX representation** 73 +|((( 74 +(% class="wikigeneratedid" id="HSDMXrepresentation-1" %) 75 +SDMX representation 75 75 76 76 * **CONF_STATUS**: N; 77 77 * **CONF_REDIST **(Observation, Conditional): [Organisation(s)]; 78 - {{/box}}79 +))) 79 79 80 80 === Adding embargo information to a data message === 81 81 ... ... @@ -90,12 +90,13 @@ 90 90 91 91 If the goal is to allow the data recipient to have privileged access to embargoed observations in a data message (message), the embargoed observation’s CONF_STATUS attribute should be coded as “E: Not for publication until the embargo time expires; free for publication after the embargo time expires.” with an observation level attribute EMBARGO_TIME (date/time/time zone). 92 92 93 -{{box}} 94 -**SDMX representation** 94 +|((( 95 +(% class="wikigeneratedid" id="HSDMXrepresentation-2" %) 96 +SDMX representation 95 95 96 96 * **CONF_STATUS**: E; 97 97 * **EMBARGO**_**TIME** (Observation, Conditional): [timestamp] 98 - {{/box}}100 +))) 99 99 100 100 Including a time zone is strongly recommended and the best case is to use the UTC (Coordinated Universal Time) time standard. However, if no time zone is provided then the time zone of the recipient is assumed. 101 101 ... ... @@ -104,7 +104,7 @@ 104 104 * (Recommended) With UTC indicator: 2017-12-15T14:02:29Z 105 105 * With timezone indicator: 2017-12-15T15:02:29+01:00 106 106 107 - ===//Enabling the frontloading of data into systems//===109 +**//Enabling the frontloading of data into systems//** 108 108 109 109 If the goal is to allow frontloading of a whole data message into systems so that the data can be made visible to users at the expiry of the embargo date/time, the header section of the message should contain an embargo date/time attribute. This implies that all information in the data message is under the embargo date/time set in the header. The header attribute EmbargoDate with format date/time/time zone indicates until when the whole data message received cannot be shared with any recipient users. 110 110 ... ... @@ -112,11 +112,12 @@ 112 112 113 113 Note that this scenario presumes that all data in the message cannot be viewed before the header EmbargoDate, and that there is no privileged access before this time. However, observations may be marked with any other confidentiality status that is valid after the frontloading EmbargoDate elapses. 114 114 115 -{{box}} 117 +|((( 118 +(% class="wikigeneratedid" id="HSDMXRepresentation" %) 116 116 SDMX Representation 117 117 118 118 * **CONF_STATUS**: <Set to the required confidentiality status after the embargo time elapses>; <Header>\<EmbargoDate>: [timestamp] 119 - {{/box}}122 +))) 120 120 121 121 The two ways of representing embargoed data exist to provide efficiency in the exchange, allow for differentiating data intended to be frontloaded and data aimed to be provided in advance to a restricted audience, and provide flexibility when few observations need to be embargoed in a large data message. The trade-off is the complication of system implementation to support the two representations of embargo, which has to be done locally on a case-by-case basis. 122 122 ... ... @@ -124,34 +124,38 @@ 124 124 125 125 In data flows that feature confidential data, CONF_STATUS is highly recommended to be a mandatory attribute. However, if CONF_STATUS is optional in the DSD and missing from an observation, it is always implied to be “F” (free). 126 126 127 -== Use of the CONF_REDIST attribute == 130 +=== Use of the CONF_REDIST attribute === 128 128 129 129 The CONF_REDIST attribute defines the secondary recipient(s) to whom the sender allows the primary recipient to forward confidential data. It is recommended to be an optional attribute at observation level. Ideally it should reference a shared code list containing standard organisation codes. To allow several secondary recipients there are these possibilities: 130 130 131 -1. Use a code that represents multiple organisations, or; 132 -1. Use several CONF_REDIST attributes to portray the multiple recipients. Each attribute represents one recipient and references the same codelist. This implementation is cleaner than the above point 1, though this will require adding as many attributes to your DSD as there are potential recipients of the redistributed confidential data. 134 +Use a code that represents multiple organisations, or; 133 133 136 +Use several CONF_REDIST attributes to portray the multiple recipients. Each attribute represents one recipient and references the same codelist. This implementation is cleaner than the above point 1, though this will require adding as many attributes to your DSD as there are potential recipients of the redistributed confidential data. 137 + 134 134 If the EMBARGO_TIME and CONF_REDIST attributes are both used: 135 135 136 136 1. Data is available only to the organisations in CONF_REDIST until EMBARGO_TIME 137 137 1. Data is available to the public after EMBARGO_TIME 138 138 139 -(% style="width:768.957px" %) 140 -|(% colspan="3" style="width:766px" %)((( 143 +|(% colspan="3" %)((( 141 141 (% class="wikigeneratedid" id="HPrivilegedAccess" %) 142 - **Privileged Access**145 +Privileged Access 143 143 ))) 144 -| (% style="width:202px" %)**Use case**|(% style="width:207px" %)**No forwarding**|(% style="width:357px" %)**Forwarding**145 -| (% style="width:202px" %)**Embargo**|(% style="width:207px" %)(((147 +|**Use case**|**No forwarding**|**Forwarding** 148 +|**Embargo**|((( 146 146 CONF_STATUS: E 150 + 147 147 EMBARGO_TIME 148 -)))|( % style="width:357px" %)(((152 +)))|((( 149 149 CONF_STATUS: E 154 + 150 150 EMBARGO_TIME 156 + 151 151 CONF_REDIST 152 152 ))) 153 -| (% style="width:202px" %)**No embargo**|(% style="width:207px" %)CONF_STATUS: N|(% style="width:357px" %)(((159 +|**No embargo**|CONF_STATUS: N|((( 154 154 CONF_STATUS:N 161 + 155 155 CONF_REDIST 156 156 ))) 157 157 ... ... @@ -164,48 +164,49 @@ 164 164 * The national statistical institutes send data to Eurostat, and allow the data to be shared with the ECB for statistical coproduction 165 165 * The data may only be shared with the public on the next day 166 166 167 -* **CONF_STATUS:**E**;** 168 -* **CONF_REDIST: **ECB**;** 169 -* **EMBARGO_TIME=<**T+1 day**, **e.g.** **2017-12-15T10:00:00Z> 174 +**CONF_STATUS:**E**;** 170 170 176 +**CONF_REDIST: **ECB**;** 177 + 178 +**EMBARGO_TIME=<**T+1 day**, **e.g.** **2017-12-15T10:00:00Z> 179 + 171 171 The solutions suggested above aim at covering the most common confidentiality and embargo use cases within a single transmission from the primary reporter to the primary recipient. However, for some more complex scenarios it might still be required to make multiple transmissions. 172 172 173 173 It is strongly recommended that use cases are specified in an agreement between organisations involved in regular transmissions up-front in order to avoid unnecessary delay in data publication or – much worse – confidentiality breaches. 174 174 175 - =Annex 1: SDMX Representation of the confidentiality use cases=184 +**Annex 1: SDMX Representation of the confidentiality use cases** 176 176 177 177 |((( 178 178 (% class="wikigeneratedid" id="HUsecase" %) 179 - **Use case**180 -)))|( % style="width:283px" %)(((188 +Use case 189 +)))|((( 181 181 (% class="wikigeneratedid" id="HCONF_STATUS28Observation29" %) 182 - **CONF_STATUS (Observation)**183 -)))|( % style="width:369px" %)(((191 +CONF_STATUS (Observation) 192 +)))|((( 184 184 (% class="wikigeneratedid" id="HAdditionalattributes" %) 185 - **Additional attributes**194 +Additional attributes 186 186 )))|((( 187 187 (% class="wikigeneratedid" id="HRemarks" %) 188 - **Remarks**197 +Remarks 189 189 ))) 190 190 |((( 191 191 (% class="wikigeneratedid" id="HNon-confidentialdata" %) 192 - **Non-confidential data**193 -)))|( % style="width:283px" %)(((201 +Non-confidential data 202 +)))|((( 194 194 (% class="wikigeneratedid" id="HF" %) 195 195 F 196 -)))|(% style="width:369px" %)((( 197 -(% class="wikigeneratedid" id="H" %) 198 - 199 199 )))|((( 200 200 == == 207 +)))|((( 208 +== == 201 201 ))) 202 202 |((( 203 203 (% class="wikigeneratedid" id="HConfidentialdatawithnoembargo" %) 204 - **Confidential data with no embargo**205 -)))|( % style="width:283px" %)(((212 +Confidential data with no embargo 213 +)))|((( 206 206 (% class="wikigeneratedid" id="HC3BD3BS3BA3BO3BT3BG3BM3BN" %) 207 207 C;D;S;A;O;T;G;M;N 208 -)))|( % style="width:369px" %)(((216 +)))|((( 209 209 (% class="wikigeneratedid" id="H-2" %) 210 210 211 211 )))|((( ... ... @@ -214,18 +214,20 @@ 214 214 ))) 215 215 |((( 216 216 **Forwarding of confidential data** 217 -)))|( % style="width:283px" %)(((225 +)))|((( 218 218 N 219 -)))|( % style="width:369px" %)(((227 +)))|((( 220 220 CONF_REDIST: (Observation, Conditional) 229 + 230 + 221 221 )))|CONF_REDIST may represent multiple organisations 222 222 |((( 223 223 (% class="wikigeneratedid" id="HEmbargo:Privilegedaccess" %) 224 - **Embargo: Privileged access**225 -)))|( % style="width:283px" %)(((234 +Embargo: Privileged access 235 +)))|((( 226 226 (% class="wikigeneratedid" id="HE" %) 227 227 E 228 -)))|( % style="width:369px" %)(((238 +)))|((( 229 229 (% class="wikigeneratedid" id="HEMBARGO_TIME28Observation2CConditional29" %) 230 230 EMBARGO_TIME (Observation, Conditional) 231 231 ... ... @@ -233,25 +233,29 @@ 233 233 )))|Only the observations with an EMBARGO_TIME attribute are embargoed. After the embargo time elapses, the data are free for publication (equivalent to F status). 234 234 |((( 235 235 (% class="wikigeneratedid" id="HEmbargo:Privilegedaccesswithforwarding" %) 236 - **Embargo: Privileged access with forwarding**237 -)))|( % style="width:283px" %)(((246 +Embargo: Privileged access with forwarding 247 +)))|((( 238 238 (% class="wikigeneratedid" id="HE-1" %) 239 239 E 240 -)))|( % style="width:369px" %)(((250 +)))|((( 241 241 EMBARGO_TIME (Observation, Conditional) 252 + 253 +(% class="wikigeneratedid" id="HCONF_REDIST:28Observation2CConditional29" %) 242 242 CONF_REDIST: (Observation, Conditional) 243 243 )))|((( 244 244 (% class="wikigeneratedid" id="HOnlytheobservationswithanEMBARGO_TIMEattributeareembargoed.Aftertheembargotimeelapses2Cthedataarefreeforpublication28equivalenttoFstatus29." %) 245 245 Only the observations with an EMBARGO_TIME attribute are embargoed. After the embargo time elapses, the data are free for publication (equivalent to F status). 258 + 259 +(% class="wikigeneratedid" id="HCONF_REDISTmayrepresentmultipleorganisations" %) 246 246 CONF_REDIST may represent multiple organisations 247 247 ))) 248 248 |((( 249 249 (% class="wikigeneratedid" id="HEmbargo:Frontloading" %) 250 - **Embargo: Frontloading**251 -)))|( % style="width:283px" %)(((264 +Embargo: Frontloading 265 +)))|((( 252 252 (% class="wikigeneratedid" id="HSettotherequiredconfidentialitystatusaftertheembargotimeelapses." %) 253 253 Set to the required confidentiality status after the embargo time elapses. 254 -)))|( % style="width:369px" %)(((268 +)))|((( 255 255 (% class="wikigeneratedid" id="H3CHeader5CEmbargoDate3E:5Btimestamp5D" %) 256 256 <Header\EmbargoDate>: [timestamp] 257 257 ... ... @@ -262,4 +262,4 @@ 262 262 263 263 ---- 264 264 265 -{{putFootnotes/}} 279 + {{putFootnotes/}}