Data Prospecting-A Step Towards Data Intensive Science

Data-intensive science is a scientific discovery process that is driven by knowledge extracted from large volumes of data rather than the traditional hypothesis driven discovery process. One of the key challenges in data-intensive science is development of enabling technologies to allow researchers...

Full description

Saved in:
Bibliographic Details
Published in:IEEE journal of selected topics in applied earth observations and remote sensing 2013-06, Vol.6 (3), p.1233-1241
Main Authors: Ramachandran, Rahul, Rushing, John, Lin, Amy, Conover, Helen, Li, Xiang, Graves, Sara, Nair, U. S., Kuo, Kwo-Sen, Smith, Deborah K.
Format: Article
Language:English
Subjects:
Architecture
data analysis
Data mining
data preprocessing
data systems
data visualization
Earth
Engines
Exploration
Histograms
information retrieval
Interactive
Mathematical models
Metaphors
Microwaves
Ocean temperature
Prospecting
Prototypes
remote sensing
Science education
sea surface
Studies
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Data-intensive science is a scientific discovery process that is driven by knowledge extracted from large volumes of data rather than the traditional hypothesis driven discovery process. One of the key challenges in data-intensive science is development of enabling technologies to allow researchers to effectively utilize these large volumes of data in an effective manner. This paper introduces the concept of "data prospecting" to address the challenges of data intensive science. With data prospecting, we extend the familiar metaphor of data mining to describe an initial phase of data exploration used to determine promising areas for deeper analysis. Data prospecting enhances data selection through the use of interactive discovery engines. Interactive exploration enables a researcher to filter the data based on the "first look" analytics, discover interesting and previously unknown patterns to start new science investigations, verify the quality of the data, and corroborate whether patterns in the data match existing science theories or mental models. This paper describes our initial evaluation of the value of"data prospecting" to Earth Science researchers as part of their research process. The paper describes our discovery engine prototype to support data prospecting for specific data products along with its current limitations. Example science investigations from three different researchers using our prototype discovery engine to explore the Special Sensor Microwave/Imager and Sounder (SSM/I, SSMIS) data products are also presented.
ISSN:1939-1404
2151-1535
DOI:10.1109/JSTARS.2013.2248133