Big Data and Official Statistics: An Overview of International Practice in Using New Data Sources

Abstract

The growing use of digital devices and massive increase in information flows in the modern world brought about new sources of information concerning our everyday life. These sources, collectively known as Big Data, provide unique opportunities for researchers to analyze quantitative data on various social and economic developments. This paper provides a brief review of research and pilot projects, which have been carried out recently by national and international statistical organizations to analyze prospects of using Big Data sources in the official statistics. Results of surveyed projects indicate that use of Big Data in the official statistics is hindered by several serious impediments, such as unresolved questions concerning methodological approaches to analysis of new data sources, data access and protection of data confidentiality, technical requirements to new IT infrastructure. Therefore, the paper concludes that examples of statistical indicators calculated solely on the basis of Big Data sources are rare, and national statistical offices efforts are currently concentrated mainly on integration of Big Data sources with traditional sources of information.