voprstatВопросы статистикиVoprosy Statistiki2313-63832658-5499The Federal State Budgetary Institution "Scientific Research Institute for Socio-Economic Statistics of the Federal State Statistics Service" (Statistics Research Institute of Rosstat)voprstat-603Research ArticleМЕЖДУНАРОДНАЯ СТАТИСТИКАINTERNATIONAL STATISTICSБОЛЬШИЕ ДАННЫЕ И ОФИЦИАЛЬНАЯ СТАТИСТИКА: ОБЗОР МЕЖДУНАРОДНОЙ ПРАКТИКИ ВНЕДРЕНИЯ НОВЫХ ИСТОЧНИКОВ ДАННЫХBIGDATA AND OFFICIAL STATISTICS: A REVIEW OF INTERNATIONAL EXPERIENCE WITH INTEGRATION OF NEW DATA SOURCESПлехановД. А.PlekhanovD. A.

Плеханов Дмитрий Александрович - ведущий специалист 

Москва

Dmitrii A. Plekhanov 

Moscow

plehanov@icss.ac.ruИнститут комплексных стратегических исследованийРоссияInstitute for Complex Strategic StudiesRussian Federation2017211220171124960Copyright © Плеханов Д.А., 20172017Плеханов Д.А.Plekhanov D.A.This work is licensed under a Creative Commons Attribution 4.0 License.https://voprstat.elpub.ru/jour/article/view/603

Революционный скачок в использовании компьютеров и прочих цифровых устройств и колоссальное увеличение информационных потоков привели к появлению новых источников информации об окружающей действительности. Эти источники, объединенные общим названием «большие данные», предоставляют исследователям уникальные возможности для проведения количественного анализа самых различных социально-экономических явлений.

В публикуемой статье представлен обзор исследовательских и пилотных проектов, которые были реализованы в последние годы международными организациями и национальными статистическими службами с целью изучения возможностей использования больших данных в официальной статистике. Анализ результатов проектов показывает, что внедрение больших данных в систему официальной статистики сталкивается с рядом серьезных ограничений, связанных с нерешенными вопросами в области методологии, обеспечения доступа к данным и сохранения конфиденциальности информации, технических требований к инфраструктуре.

По мнению автора, из-за существующих ограничений статистические показатели, которые рассчитывались бы исключительно на основе сбора и обработки больших данных, пока не получили распространения в официальной статистике. В настоящее время национальные статистические службы продолжают исследования возможностей совместного использования больших данных и традиционных источников информации.

The growing use of digital devices and a massive increase in information flows in the modern world brought about new sources of information concerning our everyday life. These sources, collectively known as Big Data, provide unique opportunities for researchers to analyze quantitative data on various social and economic developments.

This paper provides a brief review of research and pilot projects, which have been carried out recently by national and international statistical organizations to analyze prospects of using Big Data sources in the official statistics. Results of surveyed projects indicate that use of Big Data in the official statistics is hindered by several serious impediments, such as unresolved questions concerning methodological approaches to new data collection and processing, data access and protection of data confidentiality, technical requirements to new IT infrastructure.

Therefore, the paper concludes that examples of statistical indicators calculated solely on the basis of Big Data sources are rare, and national statistical offices efforts are currently concentrated mainly on integration ofBig Data sources with traditional sources of information.

официальная статистикабольшие данныеконфиденциальность информациистатистическая инфраструктураofficial statisticsbig datadata confidentialitystatistical infrastructureReferencesMayer-Schönberger V., Cukier K. Big data: A revo¬lution that will transformhow we live, work, and think. Boston, MA: Houghton Mifflin Harcourt; 2013.Mayer-Schönberger V., Cukier K. Big data: Arevolution that will transform how we live, work, and think. Boston, MA: Houghton Mifflin Harcourt, 2013.McAfee A., Brynjolfsson E. Big data: The manage¬ment revolution // Harvard Business Review. October 2012. P. 59-68.McAfee A., Brynjolfsson E. Big data: The management revolution. Harvard Business Review, October 2012, pp. 59-68.Manyika J. et al. Big data: The next frontier for innovation, competition, and productivity. McKinseyGlobal Institute, McKinsey& Company. May2011. URL: http://www.mckinsey.com/business-functions/digital-mckinsey/our-insights/big-data-the-next-frontier-for-innovation.Manyika J. et al. Big data: The next frontierforinnovation, competition, and productivity. McKinseyGlobal Institute, McKinsey& Company. May2011. Available at: http://www.mckinsey.com/business-functions/digital-mckinsey/our-insights/big-data-the-next-frontier-for-innovation.Cavallo A. Scraped data and prices in macroeconom¬ics. Harvard University- Phd Dissertation, 2010.Cavallo A. Scraped data and prices in macroeconomics. Harvard University- Phd Dissertation, 2010.Vale S. International collaboration to understand the relevance ofbig data for official statistics // Statistical Journal ofthe IAOS. 2015. Vol. 31. No. 2. P. 159-163. DOI: 10.3233/sji-150889.Vale S. International collaboration to understand the relevance ofbig data for official statistics. Statistical Journal of the IAOS, 2015, vol. 31, no. 2, pp. 159-163. DOI: 10.3233/sji-150889.Norberg N., Sammar M., Tongur C. A studyon scan¬ner data in the Swedish Consumer Price Index. Paper pre¬sented at the Ottawa Group Meeting on Prices. Wellington, 10-12 May2011. URL: http://www.scb.se/Statistik/PR/PR0101/_dokument/KPI_namnden/A%20STUDY%20ON%20SCANNER%20DATA%20IN%20THE%20SWEDISH%20CPI.pdf.Norberg N., Sammar M., Tongur C. Astudy on scannerdata in the Swedish ConsumerPrice Index. Paper presented at the Ottawa Group Meeting on Prices. Wellington, 10-12 May2011. Available at: http://www.scb.se/Statistik/PR/PR0101/_dokument/KPI_namnden/A%20STUDY%20ON%20SCANNER%20DATA%20IN%20THE%20SWEDISH%20CPI.pdf.Daas P.J.H. et al. Big data as a source for official statistics // Journal ofOfficial Statistics. 2015. Vol. 31. Iss. 2. P. 249-262. DOI: 10.1515/jos-2015-0016.Daas P.J.H. et al. Big data as a source for official statistics. Journal of Official Statistics, 2015, vol. 31, iss. 2, pp. 249-262. DOI: 10.1515/jos-2015-0016.Braaksma B., Zeelenberg K. «Re-Make/Re-Model»: Should big data change the modelling paradigmin official statistics? // Statistical Journal ofthe IAOS. 2015. Vol. 31. No. 2. P. 193-202. DOI: 10.3233/SJI-150892.Braaksma B., Zeelenberg K. «Re-Make/Re-Model»: Should big data change the modelling paradigmin official statistics? Statistical Journal of the IAOS, 2015, vol. 31, no. 2, pp. 193-202. DOI: 10.3233/SJI-150892.Hackle P. Big data: What can official statistics expect? //Statistical Journal ofthe IAOS. 2016. Vol. 32. No. 1. P. 43-52. DOI: 10.3233/SJI-160965.Hackle P. Big data: What can official statistics expect? Statistical Journal of the IAOS, 2016, vol. 32, no. 1, pp. 43-52. DOI: 10.3233/SJI-160965.Dos Santos P.S., Lidonio F., Cardoso C. Scanner data project: The experience ofStatistics Portugal. Paper presented at the Workshop on Scanner Data. Stockholm, 7-8 June 2012. URL:http://www.scb.se/Statistik/PR/PR0101/_dokument/ScannerDataProject-the-experience-of-Statistics-Portugal.pdf.Dos Santos P.S., Lidonio F., Cardoso C. Scannerdata project: The experience of Statistics Portugal. Paper presented at the Workshop on Scanner Data. Stockholm, 7-8 June 2012. Available at: http://www.scb.se/Statistik/PR/PR0101/_dokument/ScannerDataProject-the-experience-of-Statistics-Portugal.pdf.Florescu D. et al. Will ‘big data’ transformofficial statistics? Paper presented at the European Conference on the QualityofOfficial Statistics. Vienna, Austria, 2-5 June 2014. URL:http://www.q2014.at/fileadmin/user_upload/ESTAT-Q2014-BigDataOS-v1a.pdf.Florescu D. et al. Will ‘big data’ transform official statistics? Paper presented at the European Conference on the QualityofOfficial Statistics. Vienna, Austria, 2-5 June 2014. Available at: http://www.q2014.at/fileadmin/user_upload/ESTAT-Q2014-BigDataOS-v1a.pdf.Struijs P., Braaksma B., Daas P.J.H. Official sta¬tistics and big data // Big Data & Society. 2014. Vol. 1. Iss. 1. P. 1-6. DOI: 10.1177/2053951714538417Struijs P., Braaksma B., Daas P.J.H. Official statistics and big data. Big Data & Society, 2014, vol. 1, iss. 1, pp. 1-6. DOI: 10.1177/2053951714538417.

The authors declare that there are no conflicts of interest present.