Automated Discovery of Unknown Unknowns

The "unknown unknowns" are factors affecting a decision that are not known to exist at the beginning of the evaluation of a situation. While humans (analysts, children, etc.) seem to have this reasoning capability, the automation of this process is more difficult. In fact, until now it has...

Full description

Saved in:
Bibliographic Details
Main Author: Talbot, P.J.
Format: Conference Proceeding
Language:English
Subjects:
Automation
Data mining
Humans
Inference algorithms
Information analysis
Personnel
Prototypes
Springs
Strategic planning
Terrorism
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page 7
container_issue
container_start_page 1
container_title
container_volume
creator Talbot, P.J.
description The "unknown unknowns" are factors affecting a decision that are not known to exist at the beginning of the evaluation of a situation. While humans (analysts, children, etc.) seem to have this reasoning capability, the automation of this process is more difficult. In fact, until now it has been an unresolved research problem. Using automated reasoning and learning algorithms (separately and in combination), we leveraged extremely rich structures from a knowledge base. To do this, we took differences between what was specified as known in the knowledge base, and what new evidence suggested. These differences, dubbed "unknown unknowns", were of three types: new hypotheses that might explain a situation, new links that explain previously unknown relationships between facts, and new story fragments that describe the significance of previously unidentified collections of factors that might drive a decision. The basic approach enabled us to prototype various different methods for the automated discovery of unknown unknowns (ADUU), depending on the characteristics of the decisions. We successfully demonstrated these methods in three domains: strategic planning and analysis, information operations (contractually), and anti-terrorism
doi_str_mv 10.1109/MILCOM.2006.302431
format conference_proceeding
fullrecord <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_4086656</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>4086656</ieee_id><sourcerecordid>4086656</sourcerecordid><originalsourceid>FETCH-LOGICAL-i90t-c10b33ed35e5d52837bdd3b3b1941cf0fd97da96fd8fb24c922d4ce768fabc503</originalsourceid><addsrcrecordid>eNpFjElLw0AYQMcNrLV_QC-5eUr8Zr5ZjyV1KaT0UsFbmRWiNpFMVPrvFdze5R0ePEIuKFSUgrleLZt6vaoYgKwQGEd6QM4oZ5yDpFofkgmjQpRKaHn0H9Tj8V9Q-pTMcn6CL9AIwfmEXM3fxn5nxxiKRZt9_x6HfdGn4qF77vqP7tf5nJwk-5Lj7MdTsrm92dT3ZbO-W9bzpmwNjKWn4BBjQBFFEEyjciGgQ0cNpz5BCkYFa2QKOjnGvWEscB-V1Mk6LwCn5PJ728YYt69Du7PDfstBSykkfgJb8UV_</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Automated Discovery of Unknown Unknowns</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Talbot, P.J.</creator><creatorcontrib>Talbot, P.J.</creatorcontrib><description>The "unknown unknowns" are factors affecting a decision that are not known to exist at the beginning of the evaluation of a situation. While humans (analysts, children, etc.) seem to have this reasoning capability, the automation of this process is more difficult. In fact, until now it has been an unresolved research problem. Using automated reasoning and learning algorithms (separately and in combination), we leveraged extremely rich structures from a knowledge base. To do this, we took differences between what was specified as known in the knowledge base, and what new evidence suggested. These differences, dubbed "unknown unknowns", were of three types: new hypotheses that might explain a situation, new links that explain previously unknown relationships between facts, and new story fragments that describe the significance of previously unidentified collections of factors that might drive a decision. The basic approach enabled us to prototype various different methods for the automated discovery of unknown unknowns (ADUU), depending on the characteristics of the decisions. We successfully demonstrated these methods in three domains: strategic planning and analysis, information operations (contractually), and anti-terrorism</description><identifier>ISSN: 2155-7578</identifier><identifier>ISBN: 142440617X</identifier><identifier>ISBN: 9781424406173</identifier><identifier>EISSN: 2155-7586</identifier><identifier>EISBN: 1424406188</identifier><identifier>EISBN: 9781424406180</identifier><identifier>DOI: 10.1109/MILCOM.2006.302431</identifier><language>eng</language><publisher>IEEE</publisher><subject>Automation ; Data mining ; Humans ; Inference algorithms ; Information analysis ; Personnel ; Prototypes ; Springs ; Strategic planning ; Terrorism</subject><ispartof>MILCOM 2006 - 2006 IEEE Military Communications conference, 2006, p.1-7</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/4086656$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,776,780,785,786,2052,27902,54530,54895,54907</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/4086656$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Talbot, P.J.</creatorcontrib><title>Automated Discovery of Unknown Unknowns</title><title>MILCOM 2006 - 2006 IEEE Military Communications conference</title><addtitle>MILCOM</addtitle><description>The "unknown unknowns" are factors affecting a decision that are not known to exist at the beginning of the evaluation of a situation. While humans (analysts, children, etc.) seem to have this reasoning capability, the automation of this process is more difficult. In fact, until now it has been an unresolved research problem. Using automated reasoning and learning algorithms (separately and in combination), we leveraged extremely rich structures from a knowledge base. To do this, we took differences between what was specified as known in the knowledge base, and what new evidence suggested. These differences, dubbed "unknown unknowns", were of three types: new hypotheses that might explain a situation, new links that explain previously unknown relationships between facts, and new story fragments that describe the significance of previously unidentified collections of factors that might drive a decision. The basic approach enabled us to prototype various different methods for the automated discovery of unknown unknowns (ADUU), depending on the characteristics of the decisions. We successfully demonstrated these methods in three domains: strategic planning and analysis, information operations (contractually), and anti-terrorism</description><subject>Automation</subject><subject>Data mining</subject><subject>Humans</subject><subject>Inference algorithms</subject><subject>Information analysis</subject><subject>Personnel</subject><subject>Prototypes</subject><subject>Springs</subject><subject>Strategic planning</subject><subject>Terrorism</subject><issn>2155-7578</issn><issn>2155-7586</issn><isbn>142440617X</isbn><isbn>9781424406173</isbn><isbn>1424406188</isbn><isbn>9781424406180</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2006</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><recordid>eNpFjElLw0AYQMcNrLV_QC-5eUr8Zr5ZjyV1KaT0UsFbmRWiNpFMVPrvFdze5R0ePEIuKFSUgrleLZt6vaoYgKwQGEd6QM4oZ5yDpFofkgmjQpRKaHn0H9Tj8V9Q-pTMcn6CL9AIwfmEXM3fxn5nxxiKRZt9_x6HfdGn4qF77vqP7tf5nJwk-5Lj7MdTsrm92dT3ZbO-W9bzpmwNjKWn4BBjQBFFEEyjciGgQ0cNpz5BCkYFa2QKOjnGvWEscB-V1Mk6LwCn5PJ728YYt69Du7PDfstBSykkfgJb8UV_</recordid><startdate>200610</startdate><enddate>200610</enddate><creator>Talbot, P.J.</creator><general>IEEE</general><scope>6IE</scope><scope>6IH</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIO</scope></search><sort><creationdate>200610</creationdate><title>Automated Discovery of Unknown Unknowns</title><author>Talbot, P.J.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i90t-c10b33ed35e5d52837bdd3b3b1941cf0fd97da96fd8fb24c922d4ce768fabc503</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2006</creationdate><topic>Automation</topic><topic>Data mining</topic><topic>Humans</topic><topic>Inference algorithms</topic><topic>Information analysis</topic><topic>Personnel</topic><topic>Prototypes</topic><topic>Springs</topic><topic>Strategic planning</topic><topic>Terrorism</topic><toplevel>online_resources</toplevel><creatorcontrib>Talbot, P.J.</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan (POP) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEL</collection><collection>IEEE Proceedings Order Plans (POP) 1998-present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Talbot, P.J.</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Automated Discovery of Unknown Unknowns</atitle><btitle>MILCOM 2006 - 2006 IEEE Military Communications conference</btitle><stitle>MILCOM</stitle><date>2006-10</date><risdate>2006</risdate><spage>1</spage><epage>7</epage><pages>1-7</pages><issn>2155-7578</issn><eissn>2155-7586</eissn><isbn>142440617X</isbn><isbn>9781424406173</isbn><eisbn>1424406188</eisbn><eisbn>9781424406180</eisbn><abstract>The "unknown unknowns" are factors affecting a decision that are not known to exist at the beginning of the evaluation of a situation. While humans (analysts, children, etc.) seem to have this reasoning capability, the automation of this process is more difficult. In fact, until now it has been an unresolved research problem. Using automated reasoning and learning algorithms (separately and in combination), we leveraged extremely rich structures from a knowledge base. To do this, we took differences between what was specified as known in the knowledge base, and what new evidence suggested. These differences, dubbed "unknown unknowns", were of three types: new hypotheses that might explain a situation, new links that explain previously unknown relationships between facts, and new story fragments that describe the significance of previously unidentified collections of factors that might drive a decision. The basic approach enabled us to prototype various different methods for the automated discovery of unknown unknowns (ADUU), depending on the characteristics of the decisions. We successfully demonstrated these methods in three domains: strategic planning and analysis, information operations (contractually), and anti-terrorism</abstract><pub>IEEE</pub><doi>10.1109/MILCOM.2006.302431</doi><tpages>7</tpages></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 2155-7578
ispartof MILCOM 2006 - 2006 IEEE Military Communications conference, 2006, p.1-7
issn 2155-7578
2155-7586
language eng
recordid cdi_ieee_primary_4086656
source IEEE Electronic Library (IEL) Conference Proceedings
subjects Automation
Data mining
Humans
Inference algorithms
Information analysis
Personnel
Prototypes
Springs
Strategic planning
Terrorism
title Automated Discovery of Unknown Unknowns
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-08T06%3A08%3A11IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Automated%20Discovery%20of%20Unknown%20Unknowns&rft.btitle=MILCOM%202006%20-%202006%20IEEE%20Military%20Communications%20conference&rft.au=Talbot,%20P.J.&rft.date=2006-10&rft.spage=1&rft.epage=7&rft.pages=1-7&rft.issn=2155-7578&rft.eissn=2155-7586&rft.isbn=142440617X&rft.isbn_list=9781424406173&rft_id=info:doi/10.1109/MILCOM.2006.302431&rft.eisbn=1424406188&rft.eisbn_list=9781424406180&rft_dat=%3Cieee_6IE%3E4086656%3C/ieee_6IE%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-i90t-c10b33ed35e5d52837bdd3b3b1941cf0fd97da96fd8fb24c922d4ce768fabc503%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=4086656&rfr_iscdi=true