Distributed Shared Arrays: Portable Shared-Memory Programming Interface for Multiple Computer Systems

• Published in: Cluster computing 2004-01, Vol.7 (1), p.65-72
• Main Authors: Nomoto, Akira, Watanabe, Yasuo, Kaneko, Wataru, Nakamura, Shugo, Shimizu, Kentaro
• Format: Article
• Language: English
• Subjects: Alignment; Arrays; Cluster analysis; Molecular dynamics; Parallel programming; Programming environments; Replication; Synchronism
• ISSN: 1386-7857; 1573-7543
• DOI: 10.1023/B:CLUS.0000003944.78311.72

This paper describes the design and implementation of a parallel programming environment called “Distributed Shared Array” (DSA), which provides a shared global array abstract across different machines connected by a network. In DSA, users can define and use global arrays that can be accessed uniformly from any machines in the network. Explicit management of array area allocation, replication, and migration is achieved by explicit calls for array manipulation: defining array regions, reading and writing array regions, synchronization, and control of replication and migration. The DSA is integrated with Grid (Globus) services. This paper also describes the use of our model for gene cluster analysis, multiple alignment and molecular dynamics simulation. In these applications, global arrays are used for storing the distance matrix, alignment matrix and atom coordinates, respectively. Large array areas, which cannot be stored in the memory of individual machines, are made available by the DSA. Scalable performance of DSA was obtained compared to that of conventional parallel programs written in MPI.