Network SLO-aware container scheduling in Kubernetes

In clouds, various services run on respective containers and have service-level objectives (SLO) that significantly impact service qualities. However, Kubernetes, a widely used container orchestration platform, does not schedule containers with respect to the network SLOs. This paper proposes a new...

Full description

Saved in:
Bibliographic Details
Published in:The Journal of supercomputing 2023-07, Vol.79 (10), p.11478-11494
Main Authors: Kim, Eunsook, Lee, Kyungwoon, Yoo, Chuck
Format: Article
Language:English
Subjects:
Compilers
Computer Science
Containers
Interpreters
Nodes
Processor Architectures
Programming Languages
Resource scheduling
Scheduling
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In clouds, various services run on respective containers and have service-level objectives (SLO) that significantly impact service qualities. However, Kubernetes, a widely used container orchestration platform, does not schedule containers with respect to the network SLOs. This paper proposes a new container scheduling technique consisting of a cloud-level and node-level scheduler. The cloud-level scheduler selects a node that is best suited for satisfying the network SLO, and the node-level scheduler adjusts the CPU allocation for the container to satisfy SLOs on the selected node. We implement the cloud-level scheduler in Kubernetes and the node-level scheduler in the Linux kernel module and evaluate them using simulation and actual deployment. The evaluation results show that the cloud-level scheduler reduces the scheduling overhead by 22 × compared to DRF, a representative multi-resource scheduling technique. Also, the node-level scheduler increases the number of containers that satisfy SLOs by 2.5 × compared to native Kubernetes, which will significantly enhance the service quality of user-facing services.
ISSN:0920-8542
1573-0484
DOI:10.1007/s11227-023-05122-5