Loading…

Examining the use of Amazon's Mechanical Turk for edge extraction of the occlusal surface of fossilized bovid teeth

In order to reconstruct environments associated with Plio-Pleistocene hominins in southern Africa, researchers frequently rely upon the animals associated with the hominins, in particular, animals in the Family Bovidae. Bovids in southern Africa are typically identified by their teeth. However, iden...

Full description

Saved in:
Bibliographic Details
Published in:PloS one 2017-07, Vol.12 (7), p.e0179757-e0179757
Main Authors: Matthews, Gregory J, Thiruvathukal, George K, Luetkemeier, Maxwell P, Brophy, Juliet K
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c641t-82198e42d6f2229724050b44b5bec955218ec908f25a57202e103bfb5e2384b53
container_end_page e0179757
container_issue 7
container_start_page e0179757
container_title PloS one
container_volume 12
creator Matthews, Gregory J
Thiruvathukal, George K
Luetkemeier, Maxwell P
Brophy, Juliet K
description In order to reconstruct environments associated with Plio-Pleistocene hominins in southern Africa, researchers frequently rely upon the animals associated with the hominins, in particular, animals in the Family Bovidae. Bovids in southern Africa are typically identified by their teeth. However, identifying the taxon of a bovid tooth is challenging due to various biasing factors. Furthermore, inaccurate identification of fossil bovids can have significant consequences on the reconstructed paleoenvironment. Recent research on the classification of bovid fossil teeth has relied on using elliptical Fourier analysis to summarize the shape of the outline of the occlusal surface of the tooth and the resulting harmonic amplitudes. Currently, an expert in the field must manually place landmarks around the edges of each tooth which is slow and time consuming. This study tests whether it is possible to crowdsource this task, while maintaining the necessary level of quality needed to perform a statistical analysis on each tooth. Amazon Mechanical Turk workers place landmarks on the edge of the tooth which is compared to the performance of an expert in the field. The results suggest that crowdsourcing the digitization process is reliable and replicable. With the technical aspects of digitization managed, researchers can concentrate on analyzing and interpreting the data.
doi_str_mv 10.1371/journal.pone.0179757
format article
fullrecord <record><control><sourceid>gale_plos_</sourceid><recordid>TN_cdi_plos_journals_1919520423</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A498443103</galeid><doaj_id>oai_doaj_org_article_8e60ce31c20d41938d72b62c486699e6</doaj_id><sourcerecordid>A498443103</sourcerecordid><originalsourceid>FETCH-LOGICAL-c641t-82198e42d6f2229724050b44b5bec955218ec908f25a57202e103bfb5e2384b53</originalsourceid><addsrcrecordid>eNqNk0tv1DAUhSMEoqXwDxBEQqKwmMHPPDZIo6rASEWVoLC1HOcm8eDEUzup2v56nE5aTVAXKAtH9neO7eN7o-g1RktMU_xpYwfXSbPc2g6WCKd5ytMn0SHOKVkkBNGne_8H0QvvNwhxmiXJ8-iAZCliDLPDyJ9ey1Z3uqvjvoF48BDbKl618tZ2xz7-DqqRnVbSxBeD-xNX1sVQ1hDDde-k6rXtRn6UWqXM4APoB1dJdedTWe-10bdQxoW90mXcA_TNy-hZJY2HV9N4FP36cnpx8m1xdv51fbI6W6iE4X6REZxnwEiZVISQPCUMcVQwVvACVM45wVkYUVYRLnlKEAGMaFEVHAjNAkWPorc7362xXkx5eYFznHOCGKGBWO-I0sqN2DrdSncjrNTibsK6WkjXa2VAZJAgBRQrgkoWgs3KlBQJUSwkmueQBK_P025D0UKpoAsJmZnpfKXTjajtleAc5RizYPBhMnD2cgDfi1Z7BcbIDuwwnpukFJGM4oC--wd9_HYTVctwAd1Vdnyz0VSsWJ4xRkNggVo-QoWvhFarUFyVDvMzwceZIDB9KIdaDt6L9c8f_8-e_56z7_fYBqTpG2_NMBaZn4NsByoX6stB9RAyRmLsjfs0xNgbYuqNIHuz_0APovtmoH8BKxwHuQ</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1919520423</pqid></control><display><type>article</type><title>Examining the use of Amazon's Mechanical Turk for edge extraction of the occlusal surface of fossilized bovid teeth</title><source>Open Access: PubMed Central</source><source>Publicly Available Content Database</source><creator>Matthews, Gregory J ; Thiruvathukal, George K ; Luetkemeier, Maxwell P ; Brophy, Juliet K</creator><contributor>Lozano, Sergi</contributor><creatorcontrib>Matthews, Gregory J ; Thiruvathukal, George K ; Luetkemeier, Maxwell P ; Brophy, Juliet K ; Lozano, Sergi</creatorcontrib><description>In order to reconstruct environments associated with Plio-Pleistocene hominins in southern Africa, researchers frequently rely upon the animals associated with the hominins, in particular, animals in the Family Bovidae. Bovids in southern Africa are typically identified by their teeth. However, identifying the taxon of a bovid tooth is challenging due to various biasing factors. Furthermore, inaccurate identification of fossil bovids can have significant consequences on the reconstructed paleoenvironment. Recent research on the classification of bovid fossil teeth has relied on using elliptical Fourier analysis to summarize the shape of the outline of the occlusal surface of the tooth and the resulting harmonic amplitudes. Currently, an expert in the field must manually place landmarks around the edges of each tooth which is slow and time consuming. This study tests whether it is possible to crowdsource this task, while maintaining the necessary level of quality needed to perform a statistical analysis on each tooth. Amazon Mechanical Turk workers place landmarks on the edge of the tooth which is compared to the performance of an expert in the field. The results suggest that crowdsourcing the digitization process is reliable and replicable. With the technical aspects of digitization managed, researchers can concentrate on analyzing and interpreting the data.</description><identifier>ISSN: 1932-6203</identifier><identifier>EISSN: 1932-6203</identifier><identifier>DOI: 10.1371/journal.pone.0179757</identifier><identifier>PMID: 28704414</identifier><language>eng</language><publisher>United States: Public Library of Science</publisher><subject>Analysis ; Animals ; Biology and Life Sciences ; Cattle ; Classification ; Crowdsourcing ; Crowdsourcing - methods ; Data Collection ; Digitization ; Earth Sciences ; Ecology and Environmental Sciences ; Environmental engineering ; Fossils ; Fossils - anatomy &amp; histology ; Fourier analysis ; Landmarks ; Medicine and Health Sciences ; Paleontology ; Pleistocene ; Social Sciences ; Statistical analysis ; Studies ; Teeth ; Tooth - anatomy &amp; histology ; Workers</subject><ispartof>PloS one, 2017-07, Vol.12 (7), p.e0179757-e0179757</ispartof><rights>COPYRIGHT 2017 Public Library of Science</rights><rights>2017 Matthews et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>2017 Matthews et al 2017 Matthews et al</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c641t-82198e42d6f2229724050b44b5bec955218ec908f25a57202e103bfb5e2384b53</cites><orcidid>0000-0002-8413-5097</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/1919520423/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/1919520423?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>230,314,727,780,784,885,25753,27924,27925,37012,37013,44590,53791,53793,75126</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/28704414$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><contributor>Lozano, Sergi</contributor><creatorcontrib>Matthews, Gregory J</creatorcontrib><creatorcontrib>Thiruvathukal, George K</creatorcontrib><creatorcontrib>Luetkemeier, Maxwell P</creatorcontrib><creatorcontrib>Brophy, Juliet K</creatorcontrib><title>Examining the use of Amazon's Mechanical Turk for edge extraction of the occlusal surface of fossilized bovid teeth</title><title>PloS one</title><addtitle>PLoS One</addtitle><description>In order to reconstruct environments associated with Plio-Pleistocene hominins in southern Africa, researchers frequently rely upon the animals associated with the hominins, in particular, animals in the Family Bovidae. Bovids in southern Africa are typically identified by their teeth. However, identifying the taxon of a bovid tooth is challenging due to various biasing factors. Furthermore, inaccurate identification of fossil bovids can have significant consequences on the reconstructed paleoenvironment. Recent research on the classification of bovid fossil teeth has relied on using elliptical Fourier analysis to summarize the shape of the outline of the occlusal surface of the tooth and the resulting harmonic amplitudes. Currently, an expert in the field must manually place landmarks around the edges of each tooth which is slow and time consuming. This study tests whether it is possible to crowdsource this task, while maintaining the necessary level of quality needed to perform a statistical analysis on each tooth. Amazon Mechanical Turk workers place landmarks on the edge of the tooth which is compared to the performance of an expert in the field. The results suggest that crowdsourcing the digitization process is reliable and replicable. With the technical aspects of digitization managed, researchers can concentrate on analyzing and interpreting the data.</description><subject>Analysis</subject><subject>Animals</subject><subject>Biology and Life Sciences</subject><subject>Cattle</subject><subject>Classification</subject><subject>Crowdsourcing</subject><subject>Crowdsourcing - methods</subject><subject>Data Collection</subject><subject>Digitization</subject><subject>Earth Sciences</subject><subject>Ecology and Environmental Sciences</subject><subject>Environmental engineering</subject><subject>Fossils</subject><subject>Fossils - anatomy &amp; histology</subject><subject>Fourier analysis</subject><subject>Landmarks</subject><subject>Medicine and Health Sciences</subject><subject>Paleontology</subject><subject>Pleistocene</subject><subject>Social Sciences</subject><subject>Statistical analysis</subject><subject>Studies</subject><subject>Teeth</subject><subject>Tooth - anatomy &amp; histology</subject><subject>Workers</subject><issn>1932-6203</issn><issn>1932-6203</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2017</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><sourceid>DOA</sourceid><recordid>eNqNk0tv1DAUhSMEoqXwDxBEQqKwmMHPPDZIo6rASEWVoLC1HOcm8eDEUzup2v56nE5aTVAXKAtH9neO7eN7o-g1RktMU_xpYwfXSbPc2g6WCKd5ytMn0SHOKVkkBNGne_8H0QvvNwhxmiXJ8-iAZCliDLPDyJ9ey1Z3uqvjvoF48BDbKl618tZ2xz7-DqqRnVbSxBeD-xNX1sVQ1hDDde-k6rXtRn6UWqXM4APoB1dJdedTWe-10bdQxoW90mXcA_TNy-hZJY2HV9N4FP36cnpx8m1xdv51fbI6W6iE4X6REZxnwEiZVISQPCUMcVQwVvACVM45wVkYUVYRLnlKEAGMaFEVHAjNAkWPorc7362xXkx5eYFznHOCGKGBWO-I0sqN2DrdSncjrNTibsK6WkjXa2VAZJAgBRQrgkoWgs3KlBQJUSwkmueQBK_P025D0UKpoAsJmZnpfKXTjajtleAc5RizYPBhMnD2cgDfi1Z7BcbIDuwwnpukFJGM4oC--wd9_HYTVctwAd1Vdnyz0VSsWJ4xRkNggVo-QoWvhFarUFyVDvMzwceZIDB9KIdaDt6L9c8f_8-e_56z7_fYBqTpG2_NMBaZn4NsByoX6stB9RAyRmLsjfs0xNgbYuqNIHuz_0APovtmoH8BKxwHuQ</recordid><startdate>20170713</startdate><enddate>20170713</enddate><creator>Matthews, Gregory J</creator><creator>Thiruvathukal, George K</creator><creator>Luetkemeier, Maxwell P</creator><creator>Brophy, Juliet K</creator><general>Public Library of Science</general><general>Public Library of Science (PLoS)</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>IOV</scope><scope>ISR</scope><scope>3V.</scope><scope>7QG</scope><scope>7QL</scope><scope>7QO</scope><scope>7RV</scope><scope>7SN</scope><scope>7SS</scope><scope>7T5</scope><scope>7TG</scope><scope>7TM</scope><scope>7U9</scope><scope>7X2</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8AO</scope><scope>8C1</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FH</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>ATCPS</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>C1K</scope><scope>CCPQU</scope><scope>D1I</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>H94</scope><scope>HCIFZ</scope><scope>K9.</scope><scope>KB.</scope><scope>KB0</scope><scope>KL.</scope><scope>L6V</scope><scope>LK8</scope><scope>M0K</scope><scope>M0S</scope><scope>M1P</scope><scope>M7N</scope><scope>M7P</scope><scope>M7S</scope><scope>NAPCQ</scope><scope>P5Z</scope><scope>P62</scope><scope>P64</scope><scope>PATMY</scope><scope>PDBOC</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>PYCSY</scope><scope>RC3</scope><scope>7X8</scope><scope>5PM</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-8413-5097</orcidid></search><sort><creationdate>20170713</creationdate><title>Examining the use of Amazon's Mechanical Turk for edge extraction of the occlusal surface of fossilized bovid teeth</title><author>Matthews, Gregory J ; Thiruvathukal, George K ; Luetkemeier, Maxwell P ; Brophy, Juliet K</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c641t-82198e42d6f2229724050b44b5bec955218ec908f25a57202e103bfb5e2384b53</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Analysis</topic><topic>Animals</topic><topic>Biology and Life Sciences</topic><topic>Cattle</topic><topic>Classification</topic><topic>Crowdsourcing</topic><topic>Crowdsourcing - methods</topic><topic>Data Collection</topic><topic>Digitization</topic><topic>Earth Sciences</topic><topic>Ecology and Environmental Sciences</topic><topic>Environmental engineering</topic><topic>Fossils</topic><topic>Fossils - anatomy &amp; histology</topic><topic>Fourier analysis</topic><topic>Landmarks</topic><topic>Medicine and Health Sciences</topic><topic>Paleontology</topic><topic>Pleistocene</topic><topic>Social Sciences</topic><topic>Statistical analysis</topic><topic>Studies</topic><topic>Teeth</topic><topic>Tooth - anatomy &amp; histology</topic><topic>Workers</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Matthews, Gregory J</creatorcontrib><creatorcontrib>Thiruvathukal, George K</creatorcontrib><creatorcontrib>Luetkemeier, Maxwell P</creatorcontrib><creatorcontrib>Brophy, Juliet K</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Gale_Opposing Viewpoints In Context</collection><collection>Gale In Context: Science</collection><collection>ProQuest Central (Corporate)</collection><collection>Animal Behavior Abstracts</collection><collection>Bacteriology Abstracts (Microbiology B)</collection><collection>Biotechnology Research Abstracts</collection><collection>Nursing &amp; Allied Health Database (ProQuest)</collection><collection>Ecology Abstracts</collection><collection>Entomology Abstracts (Full archive)</collection><collection>Immunology Abstracts</collection><collection>Meteorological &amp; Geoastrophysical Abstracts</collection><collection>Nucleic Acids Abstracts</collection><collection>Virology and AIDS Abstracts</collection><collection>Agricultural Science Collection</collection><collection>Health &amp; Medical Collection (Proquest)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Public Health Database (Proquest)</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>Agricultural &amp; Environmental Science Collection</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ProQuest One Community College</collection><collection>ProQuest Materials Science Collection</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>AIDS and Cancer Research Abstracts</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>https://resources.nclive.org/materials</collection><collection>Nursing &amp; Allied Health Database (Alumni Edition)</collection><collection>Meteorological &amp; Geoastrophysical Abstracts - Academic</collection><collection>ProQuest Engineering Collection</collection><collection>ProQuest Biological Science Collection</collection><collection>Agriculture Science Database</collection><collection>Health &amp; Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Algology Mycology and Protozoology Abstracts (Microbiology C)</collection><collection>ProQuest Biological Science Journals</collection><collection>ProQuest Engineering Database</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>ProQuest advanced technologies &amp; aerospace journals</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Environmental Science Database</collection><collection>Materials science collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering collection</collection><collection>Environmental Science Collection</collection><collection>Genetics Abstracts</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>PloS one</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Matthews, Gregory J</au><au>Thiruvathukal, George K</au><au>Luetkemeier, Maxwell P</au><au>Brophy, Juliet K</au><au>Lozano, Sergi</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Examining the use of Amazon's Mechanical Turk for edge extraction of the occlusal surface of fossilized bovid teeth</atitle><jtitle>PloS one</jtitle><addtitle>PLoS One</addtitle><date>2017-07-13</date><risdate>2017</risdate><volume>12</volume><issue>7</issue><spage>e0179757</spage><epage>e0179757</epage><pages>e0179757-e0179757</pages><issn>1932-6203</issn><eissn>1932-6203</eissn><abstract>In order to reconstruct environments associated with Plio-Pleistocene hominins in southern Africa, researchers frequently rely upon the animals associated with the hominins, in particular, animals in the Family Bovidae. Bovids in southern Africa are typically identified by their teeth. However, identifying the taxon of a bovid tooth is challenging due to various biasing factors. Furthermore, inaccurate identification of fossil bovids can have significant consequences on the reconstructed paleoenvironment. Recent research on the classification of bovid fossil teeth has relied on using elliptical Fourier analysis to summarize the shape of the outline of the occlusal surface of the tooth and the resulting harmonic amplitudes. Currently, an expert in the field must manually place landmarks around the edges of each tooth which is slow and time consuming. This study tests whether it is possible to crowdsource this task, while maintaining the necessary level of quality needed to perform a statistical analysis on each tooth. Amazon Mechanical Turk workers place landmarks on the edge of the tooth which is compared to the performance of an expert in the field. The results suggest that crowdsourcing the digitization process is reliable and replicable. With the technical aspects of digitization managed, researchers can concentrate on analyzing and interpreting the data.</abstract><cop>United States</cop><pub>Public Library of Science</pub><pmid>28704414</pmid><doi>10.1371/journal.pone.0179757</doi><tpages>e0179757</tpages><orcidid>https://orcid.org/0000-0002-8413-5097</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1932-6203
ispartof PloS one, 2017-07, Vol.12 (7), p.e0179757-e0179757
issn 1932-6203
1932-6203
language eng
recordid cdi_plos_journals_1919520423
source Open Access: PubMed Central; Publicly Available Content Database
subjects Analysis
Animals
Biology and Life Sciences
Cattle
Classification
Crowdsourcing
Crowdsourcing - methods
Data Collection
Digitization
Earth Sciences
Ecology and Environmental Sciences
Environmental engineering
Fossils
Fossils - anatomy & histology
Fourier analysis
Landmarks
Medicine and Health Sciences
Paleontology
Pleistocene
Social Sciences
Statistical analysis
Studies
Teeth
Tooth - anatomy & histology
Workers
title Examining the use of Amazon's Mechanical Turk for edge extraction of the occlusal surface of fossilized bovid teeth
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T11%3A31%3A51IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_plos_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Examining%20the%20use%20of%20Amazon's%20Mechanical%20Turk%20for%20edge%20extraction%20of%20the%20occlusal%20surface%20of%20fossilized%20bovid%20teeth&rft.jtitle=PloS%20one&rft.au=Matthews,%20Gregory%20J&rft.date=2017-07-13&rft.volume=12&rft.issue=7&rft.spage=e0179757&rft.epage=e0179757&rft.pages=e0179757-e0179757&rft.issn=1932-6203&rft.eissn=1932-6203&rft_id=info:doi/10.1371/journal.pone.0179757&rft_dat=%3Cgale_plos_%3EA498443103%3C/gale_plos_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c641t-82198e42d6f2229724050b44b5bec955218ec908f25a57202e103bfb5e2384b53%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=1919520423&rft_id=info:pmid/28704414&rft_galeid=A498443103&rfr_iscdi=true