The Future of International Statistical Data Sharing and New Issues of Interaction

The article deals with challenges and prospects of implementation of the Statistical Data and Metadata eXchange (SDMX) standard and using it in the international sharing of statistical data and metadata. The authors identified potential areas where this standard can be used, described a mechanism for data and metadata sharing according to SDMX standard. Major issues classified into three groups - general, statistical, information technology - were outlined by applying both domestic and foreign experience of implementation of the standard. These issues may arise at the national level (if the standard is implemented domestically), at the international level (when the standard is applied by international organizations), and at the national-international level (if the information is exchanged between national statistical data providers and international organizations). General issues arise at the regulatory level and are associated with establishing boundaries of responsibility of counterpart organizations at all three levels of interaction, as well as in terms of increasing the capacity to apply the SDMX standard. Issues of statistical nature are most often encountered due to the sharing of large amounts of data and metadata related to various thematic areas of statistics; there should be a unified structure of data and metadata generation and transmission. With the development of information sharing, arise challenges and issues associated with continuous monitoring and expanding SDMX code lists. At the same time, there is a lack of a universal data structure at the international level and, as a result, it is difficult to understand and apply at the national level the existing data structures developed by international organizations. Challenges of information technology are related to creating an IT infrastructure for data and metadata sharing using the SDMX standard. The IT infrastructure (depending on the participant status) includes the following elements: tools for the receiving organizations, tools for sending organization and the infrastructure for the IT professionals. For each of the outlined issues, the authors formulated some practical recommendations based on the complexity principle as applied to the implementation of the international SDMX standard for the exchange of data and metadata.

1. Boden M., Cagnin C., Carabias V., Haegeman K. Facing the Future: Time for the EU to Meet Global Challenges. European Commission Joint Research Centre Institute for Prospective Technological Studies European Union; 2010. p. 44. Available from: http://www.et2050.eu/docs/2010_IPTS_Facing_the_future. pdf (accessed 28.04.2019).

2. Berberov A.B. On the Way to Digitalization of the Russian Economy: Problems and Prospects. Economic Systems Management: electronic scientific journal. 2017;7(101). (In Russ.) Available from: http://cyberleninka.ru/article/n/na-p (accessed 28.04.2019).

3. Government of the Russian Federation. Digital Economy of the Russian Federation program. Approved by the Federal Government on July 28. 2017. No. 1632. (In Russ.) Available from: http://government.ru/docs/28653 (accessed 28.04.2019).

4. SDMX. IMF official website data. Available from: http://datahelp.imf.org/knowledgebase/articles/500102-sdmx (accessed 28.04.2019).

5. SDMX Content-Oriented Guidelines, 2016. SDMX. Available from: https://sdmx.org/wp-content/uploads/SDMX_COG_2016_Introduction.pdf (accessed 28.04.2019).

6. Kocheva S., Goncharov A. Selected Questions of Using SDMX Standard on a National and International Levels. Voprosy statistiki. 2013;(6):40-44. (In Russ.)

7. Guidelines for SDMX Data Structure Definitions, 2013. SDMX. Available from: https://sdmx.org/wp-content/uploads/SDMX_Guidelines_for_DSDs_1.0.pdf (accessed 28.04.2019).

8. Data Exchange in Business Statistics (part 2): SDMX, 2013. Eurostat. Available from: https://ec.europa.eu/eurostat/documents/54610/7779382/Data-exchange-in-business-statistics-SDMX.pdf (accessed 28.04.2019).

9. SDMX Guidelines for the Creation and Management of SDMX Code List, 2018. SDMX. Available from: https://sdmx.org/wp-content/uploads/SDMX_Guidelines_for_CDCL.docx (accessed 28.04.2019).

10. Karaiskos D.S., Xinidis D., Bonis V. R&D Statistics Information System: An Interoperability Tail Between CERIF and SDMX. Procedia Computer Science. 2017;(106):87-94.

11. Braaksma В., Zeelenberg К. Information Management as Tool for Standardization in Statistics. Statistics Netherlands; 2014. Available from: https://www.cbs.nl/-/media/imported/documents/2014/07/information%20management.pdf (accessed 28.04.2019).

12. SDMX Glossary, Version 2.0, 2018. Available from: https://sdmx.org/wp-content/uploads/SDMX_Glossary_Version_2_0_October_2018.docx (accessed 28.04.2019).

13. Capadisli S., Auer S., Riedl R. Towards Linked Statistical Data Analysis. Semantic Statistics, 2013. In: Proceedings of the 1st International Workshop on Semantic Statistics, Vol. 1549, urn:nbn:de:0074-1549-5. Available from: http://csarven.ca/linked-statistical-data-analysis (accessed 28.04.2019).

14. Sembiring J., Uluwiyah A. Data Exchange Design with SDMX Format for Interoperability Statistical Data. TELKOMNIKA Indonesian Journal of Electrical Engineering. 2015;14(2):343-352. Available from: doi: 10.11591/telkomnika.v14i2.7505.

15. Ward D. SDMX Started Kit for National Statistical Agencies. SDMX. 2015. Available from: https://sdmx.org/wp-content/uploads/SDMX_Starter_Kit_Version_23-9-2015.pdf (accessed 28.04.2019).

16. Kocheva S.N., Goncharova E.A., Volikova T.I. Recommendations on the Use of the SDMX Glossary in the Russian System of State Statistics. Moscow: 2018 (In Russ.)

17. Validation and Transformation Language (VTL): Part 2 - Reference Manual, 2018. SDMX. Available from: https://sdmx.org/wp-content/uploads/VTL-2.0-Reference-Manual-20180416-final.pdf (accessed 28.04.2019).