Synergy: A Hypervisor Managed Holistic Caching System

• Published in: IEEE transactions on cloud computing 2019-07, Vol.7 (3), p.878-892
• Main Authors: Mishra, Debadatta, Kulkarni, Purushottam, Rangaswami, Raju
• Format: Article
• Language: English
• Subjects: Caching; Cloud computing; Data storage; Domains; Knobs; Memory management; memory virtualization; Optimization; Packing density; Partitioning; Prefetching; Reconfiguration; resource management; Servers; Virtual machine monitors; Virtual machining; Virtualization
• ISSN: 2168-7161; 2168-7161; 2372-0018
• DOI: 10.1109/TCC.2017.2669033

Efficient system-wide memory management is an important challenge for over-commitment based hosting in virtualized systems. Due to the limitation of memory domains considered for sharing, current deduplication solutions simply cannot achieve system-wide deduplication. Popular memory management techniques like sharing and ballooning enable important memory usage optimizations individually. However, they do not complement each other and, in fact, may degrade individual benefits when combined. We propose \mathsf{Synergy}Synergy, a hypervisor managed caching system to improve memory efficiency in over-commitment scenarios. \mathsf{Synergy}Synergy builds on an exclusive caching framework to achieve, for the first time, system-wide memory deduplication. \mathsf{Synergy}Synergy also enables the co-existence of the mutually agnostic ballooning and sharing techniques within hypervisor managed systems. Finally, \mathsf{Synergy}Synergy implements a novel file-level eviction policy that prevents hypervisor caching benefits from being squandered away due to partial cache hits. \mathsf{Synergy}Synergy's cache is flexible with configuration knobs for cache sizing and data storage options, and a utility-based cache partitioning scheme. Our evaluation shows that \mathsf{Synergy}Synergy consistently uses 10 to 75 percent lesser memory by exploiting system-wide deduplication as compared to inclusive caching techniques and achieves application speedup of 2x to 23x. We also demonstrate the capabilities of \mathsf{Synergy}Synergy to increase VM packing density and support for dynamic reconfiguration of cache partitioning policies.