Efficient offloading of collective communications in large-scale systems

In parallel applications communication overheads generally increase as the processor count increases and in particular, collective communication operations can become a critical limiting factor in achieving high performance. In this paper we explore a novel technique to boost application performance...

Full description

Saved in:
Bibliographic Details
Main Authors: Sancho, J.C., Kerbyson, D.J., Barker, K.J.
Format: Conference Proceeding
Language:English
Subjects:
Acceleration
Hardware
Libraries
Magnetic cores
Programming
Sockets
Synchronization
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In parallel applications communication overheads generally increase as the processor count increases and in particular, collective communication operations can become a critical limiting factor in achieving high performance. In this paper we explore a novel technique to boost application performance by dedicating some processors in the system to collective operations. We demonstrate the viability and efficiency of this approach for the allreduce collective operation on a state-of-the-art cluster. Experimental results show that the collective latency can be reduced by 30% and that the communication overhead per processor is also very low, at 1.6 mus, which represents one order of magnitude higher performance than with conventional implementations. Moreover, results on a large-scale scientific application (POP) show that this approach achieves 15% higher performance on 640 processors than when using the default collective implementation.
ISSN:1552-5244
2168-9253
DOI:10.1109/CLUSTR.2007.4629229