A Two-Step Procedure to Measure Representativeness of Internet Data Sources

• Published in: International statistical review 2017-12, Vol.85 (3), p.473-493
• Main Author: Bersewicz, Maciej
• Format: Article
• Language: English
• Subjects: big data; Data management; Data sources; Internet; Internet data sources; non‐probabilistic samples; Population (statistical); Real estate; real estate market; representativeness; Sampling error; self‐selection mechanism; Statistics
• ISSN: 0306-7734; 1751-5823
• DOI: 10.1111/insr.12217

So far, statistics has mainly relied on information collected from censuses and sample surveys, which are used to produce statistics about selected characteristics of the population. However, because of cost cuts and increasing non-response in sample surveys, statisticians have started to search for new sources of information, such as registers, Internet data sources (IDSs, i.e. web portals) or big data. Administrative sources are already used for purposes of official statistics, while the suitability of the latter two sources is currently being discussed in the literature. Unfortunately, only a few papers devoted to statistical theory point out methodological problems related to the use of IDSs, particularly in the context of survey methodology. The unknown generation mechanism and the complexity of such data are often neglected in view of their size. Hence, before IDSs can be used for statistical purposes, especially for official statistics, they need to be assessed in terms of such fundamental issues as representativeness, non-sampling errors or bias. The paper attempts to fill the first gap by proposing a two-step procedure to measure representativeness of IDSs. The procedure will be exemplified using data about the secondary real estate market in Poland.