Loading…

Delocalized photonic deep learning on the internet’s edge

Advanced machine learning models are currently impossible to run on edge devices such as smart sensors and unmanned aerial vehicles owing to constraints on power, processing, and memory. We introduce an approach to machine learning inference based on delocalized analog processing across networks. In...

Full description

Saved in:
Bibliographic Details
Published in:Science (American Association for the Advancement of Science) 2022-10, Vol.378 (6617), p.270-276
Main Authors: Sludds, Alexander, Bandyopadhyay, Saumil, Chen, Zaijun, Zhong, Zhizhen, Cochrane, Jared, Bernstein, Liane, Bunandar, Darius, Dixon, P. Ben, Hamilton, Scott A., Streshinsky, Matthew, Novack, Ari, Baehr-Jones, Tom, Hochberg, Michael, Ghobadi, Manya, Hamerly, Ryan, Englund, Dirk
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Advanced machine learning models are currently impossible to run on edge devices such as smart sensors and unmanned aerial vehicles owing to constraints on power, processing, and memory. We introduce an approach to machine learning inference based on delocalized analog processing across networks. In this approach, named Netcast, cloud-based “smart transceivers” stream weight data to edge devices, enabling ultraefficient photonic inference. We demonstrate image recognition at ultralow optical energy of 40 attojoules per multiply (100 watts) cloud computers. Smart devices such as cell phones and sensors are low-power electronics operating on the edge of the internet. Although they are increasingly more powerful, they cannot perform complex machine learning tasks locally. Instead, such devices offload these tasks to the cloud, where they are performed by factory-sized servers in data centers, creating issues related to large power consumption, latency, and data privacy. Sludds et al . introduce an edge-computing architecture called NetCast that makes use of the strengths of photonics and electronics. In this method, smart transceivers periodically broadcast the weights of commonly used deep neural networks. The architecture allows low-power edge devices with minimal memory and processing to compute at teraflop rates otherwise reserved for high-power cloud computers. —ISO A new computing architecture allows low-power edge devices to perform at levels otherwise reserved for data centers.
ISSN:0036-8075
1095-9203
DOI:10.1126/science.abq8271