Big Data Pipelines on the Computing Continuum: Tapping the Dark Data

Big Data pipelines are essential for leveraging Dark Data, i.e., data collected but not used and turned into value. However, tapping their potential requires going beyond existing approaches and frameworks for Big Data processing. The Computing Continuum enables new opportunities for managing Big Da...

Full description

Saved in:
Bibliographic Details
Published in:Computer 2022
Main Authors: Roman, Dumitru, Prodan, Radu, Nikolov, Nikolay, Soylu, Ahmet, Matskin, Mihhail, Marrella, Andrea, Kimovski, Dragi, Elvesæter, Brian, Simonet-Boulogne, Anthony, Ledakis, Giannis, Song, Hui, Leotta, Francesco, Kharlamov, Evgeny
Format: Article
Language:English
Subjects:
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Big Data pipelines are essential for leveraging Dark Data, i.e., data collected but not used and turned into value. However, tapping their potential requires going beyond existing approaches and frameworks for Big Data processing. The Computing Continuum enables new opportunities for managing Big Data pipelines concerning efficient management of heterogeneous and untrustworthy resources. This article discusses the Big Data pipelines lifecycle on the Computing Continuum, its associated challenges and outlines a future research agenda in this area.