Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions

• Published in: PloS one 2018-07, Vol.13 (7), p.e0200650-e0200650
• Main Authors: Lopez-Aparicio, Susana, Grythe, Henrik, Vogt, Matthias, Pierce, Matthew, Vallejo, Islen
• Format: Article
• Language: English
• Subjects: Artificial intelligence; Atmospheric sciences; Bioinformatics; Biology and Life Sciences; Burning; Combustion; Computer and Information Sciences; Data collection; Dwellings; Earth Sciences; Emission; Emission inventories; Emissions; Engineering and Technology; Fireplaces; Geographic information systems; Heating; Heating systems; High resolution; Household appliances; Humans; Image classification; Internet; Learning algorithms; Machine Learning; Methods; Models, Theoretical; Multimedia; Neural networks; Norway; Object recognition; Online searching; People and Places; Physical Sciences; Pollutants; Quality; Real estate; Research and Analysis Methods; Spatial discrimination; Spatial distribution; Statistical analysis; Stoves; Technology application; Web Browser; Wood
• ISSN: 1932-6203; 1932-6203
• DOI: 10.1371/journal.pone.0200650

In this study we apply two methods for data collection that are relatively new in the field of atmospheric science. The two developed methods are designed to collect essential geo-localized information to be used as input data for a high resolution emission inventory for residential wood combustion (RWC). The first method is a webcrawler that extracts openly online available real estate data in a systematic way, and thereafter structures them for analysis. The webcrawler reads online Norwegian real estate advertisements and it collects the geo-position of the dwellings. Dwellings are classified according to the type (e.g., apartment, detached house) they belong to and the heating systems they are equipped with. The second method is a model trained for image recognition and classification based on machine learning techniques. The images from the real estate advertisements are collected and processed to identify wood burning installations, which are automatically classified according to the three classes used in official statistics, i.e., open fireplaces, stoves produced before 1998 and stoves produced after 1998. The model recognizes and classifies the wood appliances with a precision of 81%, 85% and 91% for open fireplaces, old stoves and new stoves, respectively. Emission factors are heavily dependent on technology and this information is therefore essential for determining accurate emissions. The collected data are compared with existing information from the statistical register at county and national level in Norway. The comparison shows good agreement for the proportion of residential heating systems between the webcrawled data and the official statistics. The high resolution and level of detail of the extracted data show the value of open data to improve emission inventories. With the increased amount and availability of data, the techniques presented here add significant value to emission accuracy and potential applications should also be considered across all emission sectors.