Virtual machine migration policy for multi-tier application in cloud computing based on Q-learning algorithm

Cloud computing technology provides shared computing which can be accessed over the Internet. When cloud data centers are flooded by end-users, how to efficiently manage virtual machines to balance both economical cost and ensure QoS becomes a mandatory work to service providers. Virtual machine mig...

Full description

Saved in:
Bibliographic Details
Published in:Computing 2022-06, Vol.104 (6), p.1285-1306
Main Authors: Tran, Cong Hung, Bui, Thanh Khiet, Pham, Tran Vu
Format: Article
Language:English
Subjects:
Algorithms
Artificial Intelligence
Cloud computing
Computer Appl. in Administrative Data Processing
Computer Communication Networks
Computer Science
Data centers
Game theory
Information Systems Applications (incl.Internet)
Machine learning
Markov processes
Migration
Regular Paper
Resource allocation
Resource utilization
Software Engineering
Virtual environments
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Cloud computing technology provides shared computing which can be accessed over the Internet. When cloud data centers are flooded by end-users, how to efficiently manage virtual machines to balance both economical cost and ensure QoS becomes a mandatory work to service providers. Virtual machine migration feature brings a plenty of benefits to stakeholders such as cost, energy, performance, stability, availability. However, stakeholders’ objectives are usually conflict with each other. Furthermore, the optimal resource allocation problem in cloud infrastructure is usually NP-Hard or NP-Complete class. In this paper, the virtual migration problem is formulated by applying the game theory to ensure both load balance and resource utilization. The virtual machine migration algorithm, named V2PQL, is proposed based on Markov decision process and Q-learning algorithm. The results of the simulation demonstrate the efficiency of our proposal which are divided into training phase and extraction phase. The proposed V2PQL algorithm has been benchmarked to the Round-Robin, inverse Ant System, Max–Min Ant System, and Ant System algorithms in order to highlight its strength and feasibility in extraction phase.
ISSN:0010-485X
1436-5057
DOI:10.1007/s00607-021-01047-0