IOCost: Block IO Control for Containers in Datacenters

Resource isolation is a requirement in datacenter environments. However, our production experience in Meta's large scale datacenters shows that existing IO control mechanisms for block storage are inadequate in containerized environments. This paper presents IOCost, an IO control solution that...

Full description

Saved in:
Bibliographic Details
Published in:IEEE MICRO 2023-05, p.1-8
Main Authors: Heo, Tejun, Schatzberg, Dan, Newell, Andrew, Liu, Song, Dhakshinamurthy, Saravanan, Narayanan, Iyswarya, Bacik, Josef, Mason, Chris, Tang, Chunqiang, Skarlatos, Dimitrios
Format: Article
Language:English
Subjects:
Biological system modeling
Containers
Costs
Hardware
Performance evaluation
Planning
Quality of service
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Resource isolation is a requirement in datacenter environments. However, our production experience in Meta's large scale datacenters shows that existing IO control mechanisms for block storage are inadequate in containerized environments. This paper presents IOCost, an IO control solution that is designed for containerized environments and provides scalable, work-conserving, and low-overhead IO control for heterogeneous storage devices and diverse workloads in datacenters. IOCost performs offline profiling to build a device model and uses it to estimate device occupancy of each IO request. To minimize runtime overhead, it separates IO control into a fast per-IO issue path and a slower periodic planning path. A novel work-conserving budget donation algorithm enables containers to dynamically share unused budget. We have deployed IOCost across Meta's datacenters comprised of millions of machines, upstreamed IOCost to the Linux kernel, and open-sourced our device-profiling tools.
ISSN:0272-1732
DOI:10.1109/MM.2023.3277783