Problems and possibilities for using Big Data in the Russian statistics

The article outlines the definition of the concept of Big Data, presents its applicability for official statistics, and reviews problems and challenges associated with it. The paper introduces international experience in carrying out Big Data projects in statistics, as well as prospects of using this concept in the Russian statistics. The authors give consecutive account of interdependence between Big Data and official statistics, which perfectly coincides with fundamental principles of official statistics adopted at the 68th General Assembly of the United Nations on January 23, 2014. There is an analysis of monitoring results conducted by the Statistics Division and Economic Commission for Europe which resulted in gathered information on completed, on-going and potential Big Data projects (as well as organizational conditions for their execution) in selected countries. The authors comment on challenges and problems which have to be overcome in order to use Big Data in official statistics; they specify implementation directions for the concept of Big Data not only to substitute the existing statistical observation practice, but also to use it as an additional source of statistical information and a way to check validity of the obtained results.

большие данные, официальная статистика, статистическое наблюдение, административные данные, конфиденциальность информации, нагрузка на респондентов, Big Data, official statistics, statistical observation, administrative data, confidentiality of information, respondent burden

1. Доклад Глобальной рабочей группы по вопросам использования больших данных для подготовки официальной статистики. ООН. Экономический и социальный совет. Статистическая комиссия. 46-я сессия. 3-6 марта 2015 г

2. Доклад Генерального секретаря «Большие данные и модернизация статистических систем». ООН. Экономический и социальный совет. Статистическая комиссия. 45 сессия. 4-7 марта 2014 г

3. Доклад Глобальной рабочей группы по вопросам использования больших данных для подготовки официальной статистики. 47-я сессия. 8-11 марта 2016 г. С. 5-6

4. Outcomes of the UNECE Project on Using Big Data for Official Statistics. URL: http://www1.unece.org/stat/platform/display/bigdata/ Big+Data+in+Official+Statistics