A multi-GPU algorithm for large-scale neuronal networks

• Published in: Concurrency and computation 2011-04, Vol.23 (6), p.556-572
• Main Authors: de Camargo, Raphael Y., Rozante, Luiz, Song, Siang W.
• Format: Article
• Language: English
• Subjects: Algorithms; Brain; Central processing units; Computation; Computer simulation; CUDA; GPU computing; Hodgkin-Huxley model; Mathematical models; Networks; neural networks; Neurons; simulation
• ISSN: 1532-0626; 1532-0634; 1532-0634
• DOI: 10.1002/cpe.1665

Large‐scale simulations of parts of the brain using detailed neuronal models to improve our understanding of brain functions are becoming a reality with the usage of supercomputers and large clusters. However, the high acquisition and maintenance cost of these computers, including the physical space, air conditioning, and electrical power, limits the number of simulations of this kind that scientists can perform. Modern commodity graphical cards, based on the CUDA platform, contain graphical processing units (GPUs) composed of hundreds of processors that can simultaneously execute thousands of threads and thus constitute a low‐cost solution for many high‐performance computing applications. In this work, we present a CUDA algorithm that enables the execution, on multiple GPUs, of simulations of large‐scale networks composed of biologically realistic Hodgkin–Huxley neurons. The algorithm represents each neuron as a CUDA thread, which solves the set of coupled differential equations that model each neuron. Communication among neurons located in different GPUs is coordinated by the CPU. We obtained speedups of 40 for the simulation of 200k neurons that received random external input and speedups of 9 for a network with 200k neurons and 20M neuronal connections, in a single computer with two graphic boards with two GPUs each, when compared with a modern quad‐core CPU. Copyright © 2010 John Wiley & Sons, Ltd.