Scalable Cloning on Large-Scale GPU Platforms with Application to Time-Stepped Simulations on Grids

• Published in: ACM transactions on modeling and computer simulation 2018-01, Vol.28 (1), p.11-26
• Main Authors: Yoginath, Srikanth B., Perumalla, Kalyan S.
• Format: Article
• Language: English
• Subjects: algorithms; CUDA; design; experimentation; graphical processing units; load balancing; MATHEMATICS AND COMPUTING; supercomputing; time synchronization; what-if decision tree
• ISSN: 1049-3301; 1558-1195
• DOI: 10.1145/3158669

Cloning is a technique to efficiently simulate a tree of multiple what-if scenarios that are unraveled during the course of a base simulation. However, cloned execution is highly challenging to realize on large, distributed memory computing platforms, due to the dynamic nature of the computational load across clones, and due to the complex dependencies spanning the clone tree. We present the conceptual simulation framework, algorithmic foundations, and runtime interface of C lone X, a new system we designed for scalable simulation cloning. It efficiently and dynamically creates whole logical copies of a dynamic tree of simulations across a large parallel system without full physical duplication of computation and memory. The performance of a prototype implementation executed on up to 1,024 graphical processing units of a supercomputing system has been evaluated with three benchmarks—heat diffusion, forest fire, and disease propagation models—delivering a speed up of over two orders of magnitude compared to replicated runs. The results demonstrate a significantly faster and scalable way to execute many what-if scenario ensembles of large simulations via cloning using the C lone X interface.