BIGDATA AND OFFICIAL STATISTICS: A REVIEW OF INTERNATIONAL EXPERIENCE WITH INTEGRATION OF NEW DATA SOURCES
Abstract
The growing use of digital devices and a massive increase in information flows in the modern world brought about new sources of information concerning our everyday life. These sources, collectively known as Big Data, provide unique opportunities for researchers to analyze quantitative data on various social and economic developments.
This paper provides a brief review of research and pilot projects, which have been carried out recently by national and international statistical organizations to analyze prospects of using Big Data sources in the official statistics. Results of surveyed projects indicate that use of Big Data in the official statistics is hindered by several serious impediments, such as unresolved questions concerning methodological approaches to new data collection and processing, data access and protection of data confidentiality, technical requirements to new IT infrastructure.
Therefore, the paper concludes that examples of statistical indicators calculated solely on the basis of Big Data sources are rare, and national statistical offices efforts are currently concentrated mainly on integration ofBig Data sources with traditional sources of information.
About the Author
D. A. Plekhanov
Institute for Complex Strategic Studies
Russian Federation
Russian Federation
Dmitrii A. Plekhanov
Moscow
References
1. Mayer-Schönberger V., Cukier K. Big data: Arevolution that will transform how we live, work, and think. Boston, MA: Houghton Mifflin Harcourt, 2013.
2. McAfee A., Brynjolfsson E. Big data: The management revolution. Harvard Business Review, October 2012, pp. 59-68.
3. Manyika J. et al. Big data: The next frontierforinnovation, competition, and productivity. McKinseyGlobal Institute, McKinsey& Company. May2011. Available at: http://www.mckinsey.com/business-functions/digital-mckinsey/our-insights/big-data-the-next-frontier-for-innovation.
4. Cavallo A. Scraped data and prices in macroeconomics. Harvard University- Phd Dissertation, 2010.
5. Vale S. International collaboration to understand the relevance ofbig data for official statistics. Statistical Journal of the IAOS, 2015, vol. 31, no. 2, pp. 159-163. DOI: 10.3233/sji-150889.
6. Norberg N., Sammar M., Tongur C. Astudy on scannerdata in the Swedish ConsumerPrice Index. Paper presented at the Ottawa Group Meeting on Prices. Wellington, 10-12 May2011. Available at: http://www.scb.se/Statistik/PR/PR0101/_dokument/KPI_namnden/A%20STUDY%20ON%20SCANNER%20DATA%20IN%20THE%20SWEDISH%20CPI.pdf.
7. Daas P.J.H. et al. Big data as a source for official statistics. Journal of Official Statistics, 2015, vol. 31, iss. 2, pp. 249-262. DOI: 10.1515/jos-2015-0016.
8. Braaksma B., Zeelenberg K. «Re-Make/Re-Model»: Should big data change the modelling paradigmin official statistics? Statistical Journal of the IAOS, 2015, vol. 31, no. 2, pp. 193-202. DOI: 10.3233/SJI-150892.
9. Hackle P. Big data: What can official statistics expect? Statistical Journal of the IAOS, 2016, vol. 32, no. 1, pp. 43-52. DOI: 10.3233/SJI-160965.
10. Dos Santos P.S., Lidonio F., Cardoso C. Scannerdata project: The experience of Statistics Portugal. Paper presented at the Workshop on Scanner Data. Stockholm, 7-8 June 2012. Available at: http://www.scb.se/Statistik/PR/PR0101/_dokument/ScannerDataProject-the-experience-of-Statistics-Portugal.pdf.
11. Florescu D. et al. Will ‘big data’ transform official statistics? Paper presented at the European Conference on the QualityofOfficial Statistics. Vienna, Austria, 2-5 June 2014. Available at: http://www.q2014.at/fileadmin/user_upload/ESTAT-Q2014-BigDataOS-v1a.pdf.
12. Struijs P., Braaksma B., Daas P.J.H. Official statistics and big data. Big Data & Society, 2014, vol. 1, iss. 1, pp. 1-6. DOI: 10.1177/2053951714538417.
Review
For citations:
Plekhanov D.A. BIGDATA AND OFFICIAL STATISTICS: A REVIEW OF INTERNATIONAL EXPERIENCE WITH INTEGRATION OF NEW DATA SOURCES. Voprosy statistiki. 2017;1(12):49-60. (In Russ.)
Views:
785
Email this article 