DeX: Scaling Applications Beyond Machine Boundaries

Increasing the computing performance within a single-machine form factor is becoming increasingly difficult due to the complexities in scaling processor interconnects and coherence protocols. On the other hand, converting existing applications to run on multiple nodes requires a significant effort t...

Full description

Saved in:
Bibliographic Details
Main Authors: Kim, Sang-Hoon, Chuang, Ho-Ren, Lyerly, Robert, Olivier, Pierre, Min, Changwoo, Ravindran, Binoy
Format: Conference Proceeding
Language:English
Subjects:
Distributed databases
distributed execution
distributed memory
Instruction sets
Kernel
Linux
Programming
Protocols
Prototypes
RDMA
Thread migration
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Increasing the computing performance within a single-machine form factor is becoming increasingly difficult due to the complexities in scaling processor interconnects and coherence protocols. On the other hand, converting existing applications to run on multiple nodes requires a significant effort to rewrite application logic in distributed programming models and adapt the code to the underlying network characteristics.This paper presents DeX, an operating system-level approach to extend the execution boundary of existing applications over multiple machines. DeX allows the threads in a process to be relocated and distributed dynamically through a simple function call. DeX makes it trivial for developers to convert any application to be distributed over multiple nodes and for applications to transparently utilize disaggregated resources in a rack-scale system with minimal effort. Evaluation results using a running prototype and eight real applications showed promising results - six out of the eight scaled beyond the single-machine performance on DeX.
ISSN:2575-8411
DOI:10.1109/ICDCS47774.2020.00021