A Model-Based Analysis of Semiautomated Data Discovery and Entry Using Automated Content-Extraction

Content extraction systems can automatically extract entities and relations from raw text and use the information to populate knowledge bases, potentially eliminating the need for manual data discovery and entry. Unfortunately, content extraction is not sufficiently accurate for end users who requir...

Full description

Saved in:
Bibliographic Details
Published in:International journal of human-computer interaction 2013-10, Vol.29 (10), p.629-646
Main Authors: Winder, Ransom, Haimson, Craig, Goldstein-Stewart, Jade, Grossman, Justin
Format: Article
Language:English
Subjects:
Automation
Computer simulation
Computing time
Data analysis
Data entry
Data mining
Error correction
Extraction
Focusing
Human
Information content
Information systems
Mathematical models
Permissible error
Prototypes
Simulation
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Content extraction systems can automatically extract entities and relations from raw text and use the information to populate knowledge bases, potentially eliminating the need for manual data discovery and entry. Unfortunately, content extraction is not sufficiently accurate for end users who require high trust in the information uploaded to their databases, creating a need for human validation and correction of extracted content. In this article the potential influence of content extraction errors on a prototype semiautomated system that will allow a human reviewer to correct and validate extracted information before uploading it was examined, focusing on the identification and correction of precision errors. Content extraction was applied to 6 different corpora, and a Goals, Operators, Methods, and Selection rules Language (GOMSL) model was used to simulate the activities of a human using the prototype system to review extraction results, correct precision errors, ignore spurious instances, and validate information. The simulated task completion rate of the semiautomated system model was compared with that of a second GOMSL model that simulates the steps required for finding and entering information manually. Results quantify the efficiency advantage of the semiautomated workflow-estimated to be roughly 1.5 to 2 times more efficient than a manual workflow-and illustrate the value of employing multidisciplinary quantitative methods to calculate system-level measures of technology utility.
ISSN:1044-7318
1532-7590
1044-7318
DOI:10.1080/10447318.2012.758528