Data Placement Strategy of Data-Intensive Workflows in Collaborative Cloud-Edge Environment

With the continuous development and integration of mobile communication and cloud computing technology, cloud-edge collaboration has emerged as a promising distributed paradigm to solve data-intensive workflow applications. How to improve the execution performance of data-intensive workflows has bec...

Full description

Saved in:
Bibliographic Details
Main Authors: Liang, Yang, Ding, Changsong, Hu, Zhigang
Format: Conference Proceeding
Language:English
Subjects:
Cloud computing
cloud-edge collaboration
Collaboration
Costs
Data models
data placement
data-intensive workflows
execution performance
Mobile communication
multiple constraints
Numerical models
Particle swarm optimization
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:With the continuous development and integration of mobile communication and cloud computing technology, cloud-edge collaboration has emerged as a promising distributed paradigm to solve data-intensive workflow applications. How to improve the execution performance of data-intensive workflows has become one of the key issues in the collaborative cloud-edge environment. To address this issue, this paper built a data placement model with multiple constraints. Taking deadline and execution budget as the core constraints, the model is solved by minimizing the data access cost of workflow in the cloud-edge clusters. Subsequently, an immune genetic-particle swarm hybrid optimization algorithm (IGPSHO) is proposed to find the optimal replica placement scheme. Through simulation, compared with the classical immune genetic algorithm (IGA) and particle swarm optimization (PSO), the IGPSHO has obvious advantages in terms of workflow default rate, time-consuming ratio, and average execution cost when the workflow scale is large.
ISSN:2693-8928
DOI:10.1109/CSCloud-EdgeCom58631.2023.00045