A two-stage scheduler based on New Caledonian Crow Learning Algorithm and reinforcement learning strategy for cloud environment

Most studies on task scheduling in the cloud consider at most two or three objectives and hence the main motivation of this paper is to design the task scheduling problem by considering conflicting objectives (i.e., makespan, energy consumption, resources utilization, and security). The proposed alg...

Full description

Saved in:
Bibliographic Details
Published in:Journal of network and computer applications 2022-06, Vol.202, p.103385, Article 103385
Main Authors: Mohammad Hasani Zade, B., Mansouri, N., Javidi, M.M.
Format: Article
Language:English
Subjects:
Cloud computing
Metaheuristic
Parallel strategy
Reinforcement learning
Task scheduling
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Most studies on task scheduling in the cloud consider at most two or three objectives and hence the main motivation of this paper is to design the task scheduling problem by considering conflicting objectives (i.e., makespan, energy consumption, resources utilization, and security). The proposed algorithm consists of two stages (i.e., meta-scheduler and local-scheduler). In the meta-scheduler stage, the tasks are assigned to hosts based on their priorities, deadlines, and the power of hosts. In the local-scheduler stage, the optimal mapping between tasks and virtual machines is obtained with the proposed Parallel Reinforcement Learning Caledonian Crow (PRLCC). The proposed PRLCC is a combination of the New Caledonian Crow Learning Algorithm (NCCLA), Reinforcement Learning (RL), and parallel strategy. The RE is utilized to guide the agent's activity and provide a balance between intensification and diversification activities, whereas parallel strategy is employed to help agents for searching different directions of problems in the shortest time. The first experiment tries to evaluate the proposed PRLCC as a global optimizer by 20 test functions (i.e., 8 unimodal and 12 multimodal). The results demonstrate the PRLCC's robustness, efficiency, and stability. The second experiment compares the performance of the proposed scheduler with four scheduling algorithms. In a heavily (lightly) loaded system, it improves waiting time by 32.5% (1.4%), energy consumption by 81% (75%), and resource utilization by 7.5% (3.5%) on average compared to other methods, also guaranteed security by 65.5% (84%).
ISSN:1084-8045
1095-8592
DOI:10.1016/j.jnca.2022.103385