DRL Based Computation Efficiency Maximization in MEC-Enabled Heterogeneous Networks

Mobile edge computing (MEC)-enabled heterogeneous networks which compose of multiple layers with different MEC servers can support massive computation-intensive and delay-sensitive applications by pushing cloud functions to the edge of the networks. The heterogeneous nature of networks and the diffe...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on vehicular technology 2024-10, Vol.73 (10), p.15739-15744
Main Authors: Ding, Hui, Zhao, Zichao, Zhang, Haixia, Liu, Wenjie, Yuan, Dongfeng
Format: Article
Language:English
Subjects:
Central Processing Unit
computation efficiency
Computational modeling
Deep reinforcement learning
deep reinforcement learning (DRL)
Energy consumption
Heterogeneous networks
Mobile edge computing (MEC)
Multi-access edge computing
Resource management
Servers
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Mobile edge computing (MEC)-enabled heterogeneous networks which compose of multiple layers with different MEC servers can support massive computation-intensive and delay-sensitive applications by pushing cloud functions to the edge of the networks. The heterogeneous nature of networks and the different transmit powers, computing capabilities, coverage areas and various sizes tasks of MEC servers make the resources (such as communication and computation) allocation become more challenging. More importantly, facing the ever-increasing greenhouse gas emission concerns and the rapid growth of the operational cost, how to effectively utilize the resources to improve computation efficiency is of vital importance. In this paper, with the aim to maximize the computation efficiency of the MEC-enabled heterogeneous networks through proper resource allocation, a joint task offloading and resource management problem is formulated. The formulated problem turns out to be a mixed integer nonlinear programming (MINLP) problem. To solve it, an Advantage Actor-Critic (A2C)-based on joint task offloading and resource allocation algorithm (A2C-JTRA) is proposed to determine the offloading strategy, transmit power control and the central processing unit (CPU) computing frequencies allocation of MEC servers and terminal devices (TDs). Simulation results demonstrate that the superiority of the proposed algorithm in improving the computation efficiency compared to the baseline algorithms.
ISSN:0018-9545
1939-9359
DOI:10.1109/TVT.2024.3403731