Supporting Distributed Application Workflows in Heterogeneous Computing Environments

Next-generation computation-intensive applications in various fields of science and engineering feature large-scale computing workflows with complex structures that are often modeled as directed acyclic graphs. Supporting such task graphs and optimizing their end-to-end network performances in heter...

Full description

Saved in:
Bibliographic Details
Main Authors: Qishi Wu, Yi Gu
Format: Conference Proceeding
Language:English
Subjects:
Analytical models
Application software
Computational modeling
Computer networks
Concurrent computing
Delay estimation
Distributed computing
Graph mapping
heuristic algorithm
minimum end-to-end delay
Network topology
NP-complete
optimization problem
Physics computing
Resource management
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Next-generation computation-intensive applications in various fields of science and engineering feature large-scale computing workflows with complex structures that are often modeled as directed acyclic graphs. Supporting such task graphs and optimizing their end-to-end network performances in heterogeneous computing environments are critical to the success of these distributed applications that require fast response. We construct analytical models for computing modules, network nodes, and communication links to estimate data processing and transport overhead, and formulate the task graph mapping with node reuse and resource sharing for minimum end-to-end delay as an NP-complete optimization problem. We propose a heuristic approach to this problem that recursively computes and maps the critical path to the network using a dynamic programming-based procedure. The performance superiority of the proposed approach is justified by an extensive set of experiments on simulated data sets in comparison with existing methods.
ISSN:1521-9097
2690-5965
DOI:10.1109/ICPADS.2008.40