Mapping of neural networks onto the memory-processor integrated architecture

• Published in: Neural networks 1998-08, Vol.11 (6), p.1083-1098
• Main Authors: Kim, Youngsik, Noh, Mi-Jung, Han, Tack-Don, Kim, Shin-Dug
• Format: Article
• Language: English
• Subjects: Algorithmic mapping; Applied sciences; Back-propagation learning; Electric, optical and optoelectronic circuits; Electronics; Exact sciences and technology; Memory-processor integration; Multilayer perceptron; Neural networks; Parallel processing
• ISSN: 0893-6080; 1879-2782
• DOI: 10.1016/S0893-6080(98)00092-6

In this paper, an effective memory-processor integrated architecture, called memory-based processor array for artificial neural networks (MPAA), is proposed. The MPAA can be easily integrated into any host system via memory interface. Specifically, the MPA system provides an efficient mechanism for its local memory accesses allowed by row and column bases, using hybrid row and column decoding, which is suitable for computation models of ANNs such as the accessing and alignment patterns given for matrix-by-vector operations. Mapping algorithms to implement the multilayer perceptron with backpropagation learning on the MPAA system are also provided. The proposed algorithms support both neuron and layer level parallelisms which allow the MPAA system to operate the learning phase as well as the recall phase in the pipelined fashion. Performance evaluation is provided by detailed comparison in terms of two metrics such as the cost and number of computation steps. The results show that the performance of the proposed architecture and algorithms is superior to those of the previous approaches, such as one-dimensional single-instruction multiple data (SIMD) arrays, two-dimensional SIMD arrays, systolic ring structures, and hypercube machines.