Design of a software distributed shared memory system using an MPI communication layer

• Main Authors: Ojima, Y., Sato, M., Boku, T., Takahashi, D.
• Format: Conference Proceeding
• Language: English
• Subjects: Application software; Benchmark testing; Communication system software; Delay; High-speed networks; Prefetching; Software design; Software libraries; Software systems; Yarn
• ISSN: 1087-4089; 2375-527X
• DOI: 10.1109/ISPAN.2005.90

We designed and implemented a software distributed shared memory (DSM) system, SCASH-MPI, by using MPI as the communication layer of the SCASH DSM. With MPI as the communication layer, we could use high-speed networks with several clusters and high portability. Furthermore, SCASH-MPI can use high-speed networks with MPI, which is the most commonly available communication library. On the other hand, existing software DSM systems usually use a dedicated communication layer, TCP, or UDP-Ethernet. SCASH-MPI avoids the need for a large amount of pin-down memory for shared memory use that has limited the applications of the original SCASH. In SCASH-MPI, a thread is created to support remote memory communication using MPI. An experiment on a 4-node Itanium cluster showed that the Laplace Solver benchmark using SCASH-MPI achieves a performance comparable to the original SCASH. Performance degradation is only 6.3% in the NPB BT benchmark Class B test. In SCASH-MPI, page transfer does not start until a page fault is detected. To hide the latency of page transmission, we implemented a prefetch function. The latency in BT Class B was reduced by 64% when the prefetch function was used.