Near Real-time Autonomous Quality Control for Streaming Environmental Sensor Data

In this paper, we present a novel and accessible approach to time-series data validation: the Near-Real Time Autonomous Quality Control (NRAQC) system. The design, implementation, and impacts of this software are explored in detail within this paper. This software system, created in close conference...

Full description

Saved in:
Bibliographic Details
Published in:Procedia computer science 2018, Vol.126, p.1656-1665
Main Authors: Scully-Allison, Connor, Le, Vinh, Fritzinger, Eric, Strachan, Scotty, Harris, Frederick C., Dascalu, Sergiu M.
Format: Article
Language:English
Subjects:
Data Management
Information Quality
Microservices
Quality Control
Software Engineering
Web-based Systems
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we present a novel and accessible approach to time-series data validation: the Near-Real Time Autonomous Quality Control (NRAQC) system. The design, implementation, and impacts of this software are explored in detail within this paper. This software system, created in close conference with environmental scientists, leverages microservice design patterns employed for high volume web applications to develop a contemporary solution to the problem of data quality control with streaming sensor data. Through a comparative analysis between NRAQC and the GCE Toolbox, we argue that the web based deployment of QC software enhances accessibility to crucial tools required to make a robust and useful data product from raw measurements. Additionally, a key innovation of the NRAQC platform is its positive impact on modern data management practices and quality data dissemination.
ISSN:1877-0509
1877-0509
DOI:10.1016/j.procs.2018.08.139