CHIMERA: A 0.92 TOPS, 2.2 TOPS/W Edge AI Accelerator with 2 MByte On-Chip Foundry Resistive RAM for Efficient Training and Inference

CHIMERA is the first non-volatile deep neural network (DNN) chip for edge AI training and inference using foundry on-chip resistive RAM (RRAM) macros and no off-chip memory. CHIMERA achieves 0.92 TOPS peak performance and 2.2 TOPS/W. We scale inference to 6x larger DNNs by connecting 6 CHIMERAs with...

Full description

Saved in:
Bibliographic Details
Main Authors: Giordano, Massimo, Prabhu, Kartik, Koul, Kalhan, Radway, Robert M., Gural, Albert, Doshi, Rohan, Khan, Zainab F., Kustin, John W., Liu, Timothy, Lopes, Gregorio B., Turbiner, Victor, Khwa, Win-San, Chih, Yu-Der, Chang, Meng-Fan, Lallement, Guenole, Murmann, Boris, Mitra, Subhasish, Raina, Priyanka
Format: Conference Proceeding
Language:English
Subjects:
Feature extraction
Inference algorithms
Light rail systems
Resistive RAM
Training
Very large scale integration
Writing
Citations: Items that cite this one
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:CHIMERA is the first non-volatile deep neural network (DNN) chip for edge AI training and inference using foundry on-chip resistive RAM (RRAM) macros and no off-chip memory. CHIMERA achieves 0.92 TOPS peak performance and 2.2 TOPS/W. We scale inference to 6x larger DNNs by connecting 6 CHIMERAs with just 4% execution time and 5% energy costs, enabled by communication-sparse DNN mappings that exploit RRAM non-volatility through quick chip wakeup/shutdown (33 µs). We demonstrate the first incremental edge AI training which overcomes RRAM write energy, speed, and endurance challenges. Our training achieves the same accuracy as traditional algorithms with up to 283x fewer RRAM weight update steps and 340x better energy-delay product. We thus demonstrate 10 years of 20 samples/minute incremental edge AI training on CHIMERA.
ISSN:2158-5636
DOI:10.23919/VLSICircuits52068.2021.9492347