Loading…

Crowdsourced Data Mining for Urban Activity: Review of Data Sources, Applications, and Methods

Abstract The penetration of devices integrated with location-based services and internet services has generated massive data about the everyday life of citizens and tracked their activities happening in cities. Crowdsourced data, such as social media data, points of interest (POIs) data, and collabo...

Full description

Saved in:
Bibliographic Details
Published in:Journal of urban planning and development 2020-06, Vol.146 (2)
Main Authors: Niu, Haifeng, Silva, Elisabete A
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-a441t-d1c6f579f77ab9c48cfa161ecf4cc418883913bff0d820a283d05ca2495427513
cites cdi_FETCH-LOGICAL-a441t-d1c6f579f77ab9c48cfa161ecf4cc418883913bff0d820a283d05ca2495427513
container_end_page
container_issue 2
container_start_page
container_title Journal of urban planning and development
container_volume 146
creator Niu, Haifeng
Silva, Elisabete A
description Abstract The penetration of devices integrated with location-based services and internet services has generated massive data about the everyday life of citizens and tracked their activities happening in cities. Crowdsourced data, such as social media data, points of interest (POIs) data, and collaborative websites, generated by the crowd, have become fine-grained proxy data of urban activity and widely used in research in urban studies. However, due to the heterogeneity of data types of crowdsourced data and the limitation of previous studies mainly focusing on a specific application, a systematic review of crowdsourced data mining for urban activity is still lacking. In order to fill the gap, this paper conducts a literature search in the Web of Science database, selecting 226 highly related papers published between 2013 and 2019. Based on these papers, the review first conducts a bibliometric analysis identifying underpinning domains, pivot scholars, and papers around this topic. The review also synthesizes previous research into three parts: main applications of different data sources and data fusion; application of spatial analysis in mobility patterns, functional areas, and event detection; and application of sociodemographic and perception analysis in city attractiveness, demographic characteristics, and sentiment analysis. The challenges of this type of data are also discussed in the end. This study provides a systematic and current review for both researchers and practitioners interested in the applications of crowdsourced data mining for urban activity.
doi_str_mv 10.1061/(ASCE)UP.1943-5444.0000566
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2383023439</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2383023439</sourcerecordid><originalsourceid>FETCH-LOGICAL-a441t-d1c6f579f77ab9c48cfa161ecf4cc418883913bff0d820a283d05ca2495427513</originalsourceid><addsrcrecordid>eNp1kF1PwyAUhonRxDn9D0RvNLETCm3p7po6P5ItLs7eShgFZZllQrdl_97WTr2SGwJ5n_ecPACcYzTAKMY3l9ksH10V0wFOKQkiSukANSeK4wPQ-_07BD2UEBKklLFjcOL9AiFME0R64DV3dlt6u3ZSlfBW1AJOTGWqN6itg4WbiwpmsjYbU--G8FltjNpCq7vk7Bvz1zBbrZZGitrYqnmJqoQTVb_b0p-CIy2WXp3t7z4o7kYv-UMwfrp_zLNxICjFdVBiGesoSXWSiHkqKZNa4BgrqamUFDPGSIrJXGtUshCJkJESRVKENI1omESY9MFF17ty9nOtfM0XzW5VM5KHhBEUEkrSJjXsUtJZ753SfOXMh3A7jhFvfXLe-uTFlLfueOuO7302cNzBwkv1V_9D_g9-AXn2eRU</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2383023439</pqid></control><display><type>article</type><title>Crowdsourced Data Mining for Urban Activity: Review of Data Sources, Applications, and Methods</title><source>PAIS Index</source><source>American Society Of Civil Engineers ASCE Journals</source><creator>Niu, Haifeng ; Silva, Elisabete A</creator><creatorcontrib>Niu, Haifeng ; Silva, Elisabete A</creatorcontrib><description>Abstract The penetration of devices integrated with location-based services and internet services has generated massive data about the everyday life of citizens and tracked their activities happening in cities. Crowdsourced data, such as social media data, points of interest (POIs) data, and collaborative websites, generated by the crowd, have become fine-grained proxy data of urban activity and widely used in research in urban studies. However, due to the heterogeneity of data types of crowdsourced data and the limitation of previous studies mainly focusing on a specific application, a systematic review of crowdsourced data mining for urban activity is still lacking. In order to fill the gap, this paper conducts a literature search in the Web of Science database, selecting 226 highly related papers published between 2013 and 2019. Based on these papers, the review first conducts a bibliometric analysis identifying underpinning domains, pivot scholars, and papers around this topic. The review also synthesizes previous research into three parts: main applications of different data sources and data fusion; application of spatial analysis in mobility patterns, functional areas, and event detection; and application of sociodemographic and perception analysis in city attractiveness, demographic characteristics, and sentiment analysis. The challenges of this type of data are also discussed in the end. This study provides a systematic and current review for both researchers and practitioners interested in the applications of crowdsourced data mining for urban activity.</description><identifier>ISSN: 0733-9488</identifier><identifier>EISSN: 1943-5444</identifier><identifier>DOI: 10.1061/(ASCE)UP.1943-5444.0000566</identifier><language>eng</language><publisher>New York: American Society of Civil Engineers</publisher><subject>Bibliometrics ; Citations ; Crowdsourcing ; Data integration ; Data mining ; Data sources ; Digital media ; Everyday life ; Heterogeneity ; Internet ; Location based services ; Mobility ; Reviews ; Sentiment analysis ; Social media ; Spatial analysis ; Technical Papers ; Urban areas ; Urban development ; Urban planning ; Urban studies ; Websites</subject><ispartof>Journal of urban planning and development, 2020-06, Vol.146 (2)</ispartof><rights>This work is made available under the terms of the Creative Commons Attribution 4.0 International license, .</rights><rights>Copyright American Society of Civil Engineers Jun 2020</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-a441t-d1c6f579f77ab9c48cfa161ecf4cc418883913bff0d820a283d05ca2495427513</citedby><cites>FETCH-LOGICAL-a441t-d1c6f579f77ab9c48cfa161ecf4cc418883913bff0d820a283d05ca2495427513</cites><orcidid>0000-0002-0182-3573</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttp://ascelibrary.org/doi/pdf/10.1061/(ASCE)UP.1943-5444.0000566$$EPDF$$P50$$Gasce$$H</linktopdf><linktohtml>$$Uhttp://ascelibrary.org/doi/abs/10.1061/(ASCE)UP.1943-5444.0000566$$EHTML$$P50$$Gasce$$H</linktohtml><link.rule.ids>314,776,780,3238,10048,27845,27903,27904,75937,75945</link.rule.ids></links><search><creatorcontrib>Niu, Haifeng</creatorcontrib><creatorcontrib>Silva, Elisabete A</creatorcontrib><title>Crowdsourced Data Mining for Urban Activity: Review of Data Sources, Applications, and Methods</title><title>Journal of urban planning and development</title><description>Abstract The penetration of devices integrated with location-based services and internet services has generated massive data about the everyday life of citizens and tracked their activities happening in cities. Crowdsourced data, such as social media data, points of interest (POIs) data, and collaborative websites, generated by the crowd, have become fine-grained proxy data of urban activity and widely used in research in urban studies. However, due to the heterogeneity of data types of crowdsourced data and the limitation of previous studies mainly focusing on a specific application, a systematic review of crowdsourced data mining for urban activity is still lacking. In order to fill the gap, this paper conducts a literature search in the Web of Science database, selecting 226 highly related papers published between 2013 and 2019. Based on these papers, the review first conducts a bibliometric analysis identifying underpinning domains, pivot scholars, and papers around this topic. The review also synthesizes previous research into three parts: main applications of different data sources and data fusion; application of spatial analysis in mobility patterns, functional areas, and event detection; and application of sociodemographic and perception analysis in city attractiveness, demographic characteristics, and sentiment analysis. The challenges of this type of data are also discussed in the end. This study provides a systematic and current review for both researchers and practitioners interested in the applications of crowdsourced data mining for urban activity.</description><subject>Bibliometrics</subject><subject>Citations</subject><subject>Crowdsourcing</subject><subject>Data integration</subject><subject>Data mining</subject><subject>Data sources</subject><subject>Digital media</subject><subject>Everyday life</subject><subject>Heterogeneity</subject><subject>Internet</subject><subject>Location based services</subject><subject>Mobility</subject><subject>Reviews</subject><subject>Sentiment analysis</subject><subject>Social media</subject><subject>Spatial analysis</subject><subject>Technical Papers</subject><subject>Urban areas</subject><subject>Urban development</subject><subject>Urban planning</subject><subject>Urban studies</subject><subject>Websites</subject><issn>0733-9488</issn><issn>1943-5444</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>7TQ</sourceid><recordid>eNp1kF1PwyAUhonRxDn9D0RvNLETCm3p7po6P5ItLs7eShgFZZllQrdl_97WTr2SGwJ5n_ecPACcYzTAKMY3l9ksH10V0wFOKQkiSukANSeK4wPQ-_07BD2UEBKklLFjcOL9AiFME0R64DV3dlt6u3ZSlfBW1AJOTGWqN6itg4WbiwpmsjYbU--G8FltjNpCq7vk7Bvz1zBbrZZGitrYqnmJqoQTVb_b0p-CIy2WXp3t7z4o7kYv-UMwfrp_zLNxICjFdVBiGesoSXWSiHkqKZNa4BgrqamUFDPGSIrJXGtUshCJkJESRVKENI1omESY9MFF17ty9nOtfM0XzW5VM5KHhBEUEkrSJjXsUtJZ753SfOXMh3A7jhFvfXLe-uTFlLfueOuO7302cNzBwkv1V_9D_g9-AXn2eRU</recordid><startdate>20200601</startdate><enddate>20200601</enddate><creator>Niu, Haifeng</creator><creator>Silva, Elisabete A</creator><general>American Society of Civil Engineers</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7ST</scope><scope>7TQ</scope><scope>8FD</scope><scope>C1K</scope><scope>DHY</scope><scope>DON</scope><scope>FR3</scope><scope>KR7</scope><scope>SOI</scope><orcidid>https://orcid.org/0000-0002-0182-3573</orcidid></search><sort><creationdate>20200601</creationdate><title>Crowdsourced Data Mining for Urban Activity: Review of Data Sources, Applications, and Methods</title><author>Niu, Haifeng ; Silva, Elisabete A</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a441t-d1c6f579f77ab9c48cfa161ecf4cc418883913bff0d820a283d05ca2495427513</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Bibliometrics</topic><topic>Citations</topic><topic>Crowdsourcing</topic><topic>Data integration</topic><topic>Data mining</topic><topic>Data sources</topic><topic>Digital media</topic><topic>Everyday life</topic><topic>Heterogeneity</topic><topic>Internet</topic><topic>Location based services</topic><topic>Mobility</topic><topic>Reviews</topic><topic>Sentiment analysis</topic><topic>Social media</topic><topic>Spatial analysis</topic><topic>Technical Papers</topic><topic>Urban areas</topic><topic>Urban development</topic><topic>Urban planning</topic><topic>Urban studies</topic><topic>Websites</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Niu, Haifeng</creatorcontrib><creatorcontrib>Silva, Elisabete A</creatorcontrib><collection>CrossRef</collection><collection>Environment Abstracts</collection><collection>PAIS Index</collection><collection>Technology Research Database</collection><collection>Environmental Sciences and Pollution Management</collection><collection>PAIS International</collection><collection>PAIS International (Ovid)</collection><collection>Engineering Research Database</collection><collection>Civil Engineering Abstracts</collection><collection>Environment Abstracts</collection><jtitle>Journal of urban planning and development</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Niu, Haifeng</au><au>Silva, Elisabete A</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Crowdsourced Data Mining for Urban Activity: Review of Data Sources, Applications, and Methods</atitle><jtitle>Journal of urban planning and development</jtitle><date>2020-06-01</date><risdate>2020</risdate><volume>146</volume><issue>2</issue><issn>0733-9488</issn><eissn>1943-5444</eissn><abstract>Abstract The penetration of devices integrated with location-based services and internet services has generated massive data about the everyday life of citizens and tracked their activities happening in cities. Crowdsourced data, such as social media data, points of interest (POIs) data, and collaborative websites, generated by the crowd, have become fine-grained proxy data of urban activity and widely used in research in urban studies. However, due to the heterogeneity of data types of crowdsourced data and the limitation of previous studies mainly focusing on a specific application, a systematic review of crowdsourced data mining for urban activity is still lacking. In order to fill the gap, this paper conducts a literature search in the Web of Science database, selecting 226 highly related papers published between 2013 and 2019. Based on these papers, the review first conducts a bibliometric analysis identifying underpinning domains, pivot scholars, and papers around this topic. The review also synthesizes previous research into three parts: main applications of different data sources and data fusion; application of spatial analysis in mobility patterns, functional areas, and event detection; and application of sociodemographic and perception analysis in city attractiveness, demographic characteristics, and sentiment analysis. The challenges of this type of data are also discussed in the end. This study provides a systematic and current review for both researchers and practitioners interested in the applications of crowdsourced data mining for urban activity.</abstract><cop>New York</cop><pub>American Society of Civil Engineers</pub><doi>10.1061/(ASCE)UP.1943-5444.0000566</doi><orcidid>https://orcid.org/0000-0002-0182-3573</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0733-9488
ispartof Journal of urban planning and development, 2020-06, Vol.146 (2)
issn 0733-9488
1943-5444
language eng
recordid cdi_proquest_journals_2383023439
source PAIS Index; American Society Of Civil Engineers ASCE Journals
subjects Bibliometrics
Citations
Crowdsourcing
Data integration
Data mining
Data sources
Digital media
Everyday life
Heterogeneity
Internet
Location based services
Mobility
Reviews
Sentiment analysis
Social media
Spatial analysis
Technical Papers
Urban areas
Urban development
Urban planning
Urban studies
Websites
title Crowdsourced Data Mining for Urban Activity: Review of Data Sources, Applications, and Methods
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-26T20%3A47%3A43IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Crowdsourced%20Data%20Mining%20for%20Urban%20Activity:%20Review%20of%20Data%20Sources,%20Applications,%20and%20Methods&rft.jtitle=Journal%20of%20urban%20planning%20and%20development&rft.au=Niu,%20Haifeng&rft.date=2020-06-01&rft.volume=146&rft.issue=2&rft.issn=0733-9488&rft.eissn=1943-5444&rft_id=info:doi/10.1061/(ASCE)UP.1943-5444.0000566&rft_dat=%3Cproquest_cross%3E2383023439%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-a441t-d1c6f579f77ab9c48cfa161ecf4cc418883913bff0d820a283d05ca2495427513%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2383023439&rft_id=info:pmid/&rfr_iscdi=true