Web Scraping for Migration, Mobility, and Migrant Integration Studies: Introduction, Application, and Potential Use Cases

Web scraping, a technique for extracting data from web pages, has been in use for decades, yet its utilization in the field of migration, mobility, and migrant integration studies has been limited. The field faces notorious limitations regarding data access and availability, particularly in low-inco...

Full description

Saved in:
Bibliographic Details
Published in:The International migration review 2023-10
Main Author: Tjaden, Jasper
Format: Article
Language:English
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c197t-d67547ddff2651b986a0dd4cbb942e7ab81ab17bd4ad26eab10c51692777e1f43
container_end_page
container_issue
container_start_page
container_title The International migration review
container_volume
creator Tjaden, Jasper
description Web scraping, a technique for extracting data from web pages, has been in use for decades, yet its utilization in the field of migration, mobility, and migrant integration studies has been limited. The field faces notorious limitations regarding data access and availability, particularly in low-income settings. Web scraping has the potential to provide new datasets for further qualitative and quantitative analysis. Web scraping requires no financial resources, is agnostic to epistemic divides in the field, reduces researcher bias, and increases transparency and replicability of data collection. As large providers of digital data such as Facebook or Twitter increasingly restrict access to their data for researchers, web scraping will become more important in the future and deserves its place in the toolbox of migration and mobility scholars. This short and nontechnical methods note introduces the fundamental concepts of web scraping, provides guidance on how to learn the technique, showcases practical applications of web scraping in the study of migrant populations, and discusses potential future use cases.
doi_str_mv 10.1177/01979183231208428
format article
fullrecord <record><control><sourceid>crossref</sourceid><recordid>TN_cdi_crossref_primary_10_1177_01979183231208428</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>10_1177_01979183231208428</sourcerecordid><originalsourceid>FETCH-LOGICAL-c197t-d67547ddff2651b986a0dd4cbb942e7ab81ab17bd4ad26eab10c51692777e1f43</originalsourceid><addsrcrecordid>eNplUE1Lw0AQXUTBWP0B3vYHNLqz2WYSb6VoLbQo1OIx7FfKSkzC7vbQf29DcnMuM8z74PEIeQT2BID4zKDEEoqMZ8BZIXhxRRJAgSlmWF6TZMDTgXBL7kL4YZdBzBJy_raK7rWXvWuPtO483bmjl9F17ZzuOuUaF89zKlszAm2kmzbaiUL38WScDS_D03fmpEfhsu8bpyeXQfvZRdtGJxt6CJauZLDhntzUsgn2Ydozcnh7_Vq9p9uP9Wa13Kb6EjmmJseFQGPqmucLUGWRS2aM0EqVgluUqgCpAJUR0vDcXm6mF5CXHBEt1CKbERh9te9C8Laueu9-pT9XwKqhu-pfd9kfHVdjEQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Web Scraping for Migration, Mobility, and Migrant Integration Studies: Introduction, Application, and Potential Use Cases</title><source>Sage Journals Online</source><creator>Tjaden, Jasper</creator><creatorcontrib>Tjaden, Jasper</creatorcontrib><description>Web scraping, a technique for extracting data from web pages, has been in use for decades, yet its utilization in the field of migration, mobility, and migrant integration studies has been limited. The field faces notorious limitations regarding data access and availability, particularly in low-income settings. Web scraping has the potential to provide new datasets for further qualitative and quantitative analysis. Web scraping requires no financial resources, is agnostic to epistemic divides in the field, reduces researcher bias, and increases transparency and replicability of data collection. As large providers of digital data such as Facebook or Twitter increasingly restrict access to their data for researchers, web scraping will become more important in the future and deserves its place in the toolbox of migration and mobility scholars. This short and nontechnical methods note introduces the fundamental concepts of web scraping, provides guidance on how to learn the technique, showcases practical applications of web scraping in the study of migrant populations, and discusses potential future use cases.</description><identifier>ISSN: 0197-9183</identifier><identifier>EISSN: 1747-7379</identifier><identifier>DOI: 10.1177/01979183231208428</identifier><language>eng</language><ispartof>The International migration review, 2023-10</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c197t-d67547ddff2651b986a0dd4cbb942e7ab81ab17bd4ad26eab10c51692777e1f43</cites><orcidid>0000-0002-5054-3535</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Tjaden, Jasper</creatorcontrib><title>Web Scraping for Migration, Mobility, and Migrant Integration Studies: Introduction, Application, and Potential Use Cases</title><title>The International migration review</title><description>Web scraping, a technique for extracting data from web pages, has been in use for decades, yet its utilization in the field of migration, mobility, and migrant integration studies has been limited. The field faces notorious limitations regarding data access and availability, particularly in low-income settings. Web scraping has the potential to provide new datasets for further qualitative and quantitative analysis. Web scraping requires no financial resources, is agnostic to epistemic divides in the field, reduces researcher bias, and increases transparency and replicability of data collection. As large providers of digital data such as Facebook or Twitter increasingly restrict access to their data for researchers, web scraping will become more important in the future and deserves its place in the toolbox of migration and mobility scholars. This short and nontechnical methods note introduces the fundamental concepts of web scraping, provides guidance on how to learn the technique, showcases practical applications of web scraping in the study of migrant populations, and discusses potential future use cases.</description><issn>0197-9183</issn><issn>1747-7379</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNplUE1Lw0AQXUTBWP0B3vYHNLqz2WYSb6VoLbQo1OIx7FfKSkzC7vbQf29DcnMuM8z74PEIeQT2BID4zKDEEoqMZ8BZIXhxRRJAgSlmWF6TZMDTgXBL7kL4YZdBzBJy_raK7rWXvWuPtO483bmjl9F17ZzuOuUaF89zKlszAm2kmzbaiUL38WScDS_D03fmpEfhsu8bpyeXQfvZRdtGJxt6CJauZLDhntzUsgn2Ydozcnh7_Vq9p9uP9Wa13Kb6EjmmJseFQGPqmucLUGWRS2aM0EqVgluUqgCpAJUR0vDcXm6mF5CXHBEt1CKbERh9te9C8Laueu9-pT9XwKqhu-pfd9kfHVdjEQ</recordid><startdate>20231030</startdate><enddate>20231030</enddate><creator>Tjaden, Jasper</creator><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-5054-3535</orcidid></search><sort><creationdate>20231030</creationdate><title>Web Scraping for Migration, Mobility, and Migrant Integration Studies: Introduction, Application, and Potential Use Cases</title><author>Tjaden, Jasper</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c197t-d67547ddff2651b986a0dd4cbb942e7ab81ab17bd4ad26eab10c51692777e1f43</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Tjaden, Jasper</creatorcontrib><collection>CrossRef</collection><jtitle>The International migration review</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Tjaden, Jasper</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Web Scraping for Migration, Mobility, and Migrant Integration Studies: Introduction, Application, and Potential Use Cases</atitle><jtitle>The International migration review</jtitle><date>2023-10-30</date><risdate>2023</risdate><issn>0197-9183</issn><eissn>1747-7379</eissn><abstract>Web scraping, a technique for extracting data from web pages, has been in use for decades, yet its utilization in the field of migration, mobility, and migrant integration studies has been limited. The field faces notorious limitations regarding data access and availability, particularly in low-income settings. Web scraping has the potential to provide new datasets for further qualitative and quantitative analysis. Web scraping requires no financial resources, is agnostic to epistemic divides in the field, reduces researcher bias, and increases transparency and replicability of data collection. As large providers of digital data such as Facebook or Twitter increasingly restrict access to their data for researchers, web scraping will become more important in the future and deserves its place in the toolbox of migration and mobility scholars. This short and nontechnical methods note introduces the fundamental concepts of web scraping, provides guidance on how to learn the technique, showcases practical applications of web scraping in the study of migrant populations, and discusses potential future use cases.</abstract><doi>10.1177/01979183231208428</doi><orcidid>https://orcid.org/0000-0002-5054-3535</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0197-9183
ispartof The International migration review, 2023-10
issn 0197-9183
1747-7379
language eng
recordid cdi_crossref_primary_10_1177_01979183231208428
source Sage Journals Online
title Web Scraping for Migration, Mobility, and Migrant Integration Studies: Introduction, Application, and Potential Use Cases
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T23%3A16%3A33IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Web%20Scraping%20for%20Migration,%20Mobility,%20and%20Migrant%20Integration%20Studies:%20Introduction,%20Application,%20and%20Potential%20Use%20Cases&rft.jtitle=The%20International%20migration%20review&rft.au=Tjaden,%20Jasper&rft.date=2023-10-30&rft.issn=0197-9183&rft.eissn=1747-7379&rft_id=info:doi/10.1177/01979183231208428&rft_dat=%3Ccrossref%3E10_1177_01979183231208428%3C/crossref%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c197t-d67547ddff2651b986a0dd4cbb942e7ab81ab17bd4ad26eab10c51692777e1f43%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true