D-RDMALib: InfiniBand-based RDMA Library for Distributed Cluster Applications

• Published in: Journal of semiconductor technology and science 2023, 23(6), 114, pp.341-351
• Main Authors: Jeong, Laewon, Gil, Myeong-Seon, Moon, Yang-Sae
• Format: Article
• Language: English
• Subjects: 전기공학
• ISSN: 1598-1657; 2233-4866; 2233-4866; 1598-1657
• DOI: 10.5573/JSTS.2023.23.6.341

RDMA (Remote Direct Memory Access) is a recent communication protocol that allows for the maximum utilization of the performance of InfiniBand, a high-speed network device based on Data Processing Units (DPUs). However, the existing RDMA development method incurs a high implementation complexity, which makes it difficult to apply to a multi-node environment. To solve these problems, we propose D-RDMALib, an efficient and easy-to-use RDMA library suitable for distributed cluster environments. As an effective development tool, D-RDMALib can reduce the implementation difficulty of applying RDMA to distributed multi-node environments. It also improves the accessibility of InfiniBand and RDMA technologies with high entry barriers. In this paper, we demonstrate the efficiency of D-RDMALib by 1) verifying the successful operation of many-to-many communication in distributed nodes, and 2) evaluating the performance by implementing PageRank-based on D-RDMALib. We believe that our work is a novel technique that can be easily applied to existing distributed processing environments as well as to emerging ultra-high-speed in-network technologies such as Quantum InfiniBand. KCI Citation Count: 0