Loading…

A Native Stochastic Computing Architecture Enabled by Memristors

A two-terminal memristor device is a promising digital memory for its high integration density, substantially lower energy consumption compared to CMOS, and scalability below 10 nm. However, a nanoscale memristor is an inherently stochastic device, and extra energy and latency are required to make a...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on nanotechnology 2014-03, Vol.13 (2), p.283-293
Main Authors: Knag, Phil, Wei Lu, Zhengya Zhang
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c394t-5c388769c4a9f8b2328a62b5451688209d5747bdc338ee62f9eb33ba5a3ca6c93
cites cdi_FETCH-LOGICAL-c394t-5c388769c4a9f8b2328a62b5451688209d5747bdc338ee62f9eb33ba5a3ca6c93
container_end_page 293
container_issue 2
container_start_page 283
container_title IEEE transactions on nanotechnology
container_volume 13
creator Knag, Phil
Wei Lu
Zhengya Zhang
description A two-terminal memristor device is a promising digital memory for its high integration density, substantially lower energy consumption compared to CMOS, and scalability below 10 nm. However, a nanoscale memristor is an inherently stochastic device, and extra energy and latency are required to make a deterministic memory based on memristors. Instead of enforcing deterministic storage, we take advantage of the nondeterministic memory for native stochastic computing, where the randomness required by stochastic computing is intrinsic to the devices without resorting to expensive stochastic number generation. This native stochastic computing system can be implemented as a hybrid integration of memristor memory and simple CMOS stochastic computing circuits. We use an approach called group write to program memristor memory cells in arrays to generate random bit streams for stochastic computing. Three methods are proposed to program memristors using stochastic bit streams and compensate for the nonlinear memristor write function: voltage predistortion, parallel single-pulse write, and downscaled write and upscaled read. To evaluate these technical approaches, we show by simulation a memristor-based stochastic processor for gradient descent optimization, and k-means clustering. The native stochastic computing based on memristors demonstrates key advantages in energy and speed in compute-intensive, data-intensive, and probabilistic applications.
doi_str_mv 10.1109/TNANO.2014.2300342
format article
fullrecord <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_proquest_miscellaneous_1520965016</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>6714595</ieee_id><sourcerecordid>1520965016</sourcerecordid><originalsourceid>FETCH-LOGICAL-c394t-5c388769c4a9f8b2328a62b5451688209d5747bdc338ee62f9eb33ba5a3ca6c93</originalsourceid><addsrcrecordid>eNpdkDtPwzAUhS0EEqXwB2CJxMKS4nfsjagqD6m0A0Visxz3hqZqkmI7SP33pLRiYLpn-M7R1YfQNcEjQrC-X8zy2XxEMeEjyjBmnJ6gAdGcpBgrcdpnwWRKqPg4RxchrDEmmRRqgB7yZGZj9Q3JW2zdyoZYuWTc1tsuVs1nknu3qiK42HlIJo0tNrBMil3yCrWvQmx9uERnpd0EuDreIXp_nCzGz-l0_vQyzqepY5rHVDimVCa141aXqqCMKitpIbggUimK9VJkPCuWjjEFIGmpoWCssMIyZ6XTbIjuDrtb3351EKKpq-Bgs7ENtF0wRPQjUmAie_T2H7puO9_03_UUlhllIiM9RQ-U820IHkqz9VVt_c4QbPZSza9Us5dqjlL70s2hVAHAX0FmhAst2A9vGXGD</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1506723571</pqid></control><display><type>article</type><title>A Native Stochastic Computing Architecture Enabled by Memristors</title><source>IEEE Electronic Library (IEL) Journals</source><creator>Knag, Phil ; Wei Lu ; Zhengya Zhang</creator><creatorcontrib>Knag, Phil ; Wei Lu ; Zhengya Zhang</creatorcontrib><description>A two-terminal memristor device is a promising digital memory for its high integration density, substantially lower energy consumption compared to CMOS, and scalability below 10 nm. However, a nanoscale memristor is an inherently stochastic device, and extra energy and latency are required to make a deterministic memory based on memristors. Instead of enforcing deterministic storage, we take advantage of the nondeterministic memory for native stochastic computing, where the randomness required by stochastic computing is intrinsic to the devices without resorting to expensive stochastic number generation. This native stochastic computing system can be implemented as a hybrid integration of memristor memory and simple CMOS stochastic computing circuits. We use an approach called group write to program memristor memory cells in arrays to generate random bit streams for stochastic computing. Three methods are proposed to program memristors using stochastic bit streams and compensate for the nonlinear memristor write function: voltage predistortion, parallel single-pulse write, and downscaled write and upscaled read. To evaluate these technical approaches, we show by simulation a memristor-based stochastic processor for gradient descent optimization, and k-means clustering. The native stochastic computing based on memristors demonstrates key advantages in energy and speed in compute-intensive, data-intensive, and probabilistic applications.</description><identifier>ISSN: 1536-125X</identifier><identifier>EISSN: 1941-0085</identifier><identifier>DOI: 10.1109/TNANO.2014.2300342</identifier><identifier>CODEN: ITNECU</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>CMOS ; CMOS integrated circuits ; Computation ; Density ; Devices ; Materials ; Memory devices ; Memristor ; Memristors ; Probabilistic logic ; Programming ; Resistance ; Resistors ; stochastic computing ; stochastic number generator ; stochastic switching ; Stochasticity ; Streams ; Switches</subject><ispartof>IEEE transactions on nanotechnology, 2014-03, Vol.13 (2), p.283-293</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Mar 2014</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c394t-5c388769c4a9f8b2328a62b5451688209d5747bdc338ee62f9eb33ba5a3ca6c93</citedby><cites>FETCH-LOGICAL-c394t-5c388769c4a9f8b2328a62b5451688209d5747bdc338ee62f9eb33ba5a3ca6c93</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/6714595$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,27922,27923,54794</link.rule.ids></links><search><creatorcontrib>Knag, Phil</creatorcontrib><creatorcontrib>Wei Lu</creatorcontrib><creatorcontrib>Zhengya Zhang</creatorcontrib><title>A Native Stochastic Computing Architecture Enabled by Memristors</title><title>IEEE transactions on nanotechnology</title><addtitle>TNANO</addtitle><description>A two-terminal memristor device is a promising digital memory for its high integration density, substantially lower energy consumption compared to CMOS, and scalability below 10 nm. However, a nanoscale memristor is an inherently stochastic device, and extra energy and latency are required to make a deterministic memory based on memristors. Instead of enforcing deterministic storage, we take advantage of the nondeterministic memory for native stochastic computing, where the randomness required by stochastic computing is intrinsic to the devices without resorting to expensive stochastic number generation. This native stochastic computing system can be implemented as a hybrid integration of memristor memory and simple CMOS stochastic computing circuits. We use an approach called group write to program memristor memory cells in arrays to generate random bit streams for stochastic computing. Three methods are proposed to program memristors using stochastic bit streams and compensate for the nonlinear memristor write function: voltage predistortion, parallel single-pulse write, and downscaled write and upscaled read. To evaluate these technical approaches, we show by simulation a memristor-based stochastic processor for gradient descent optimization, and k-means clustering. The native stochastic computing based on memristors demonstrates key advantages in energy and speed in compute-intensive, data-intensive, and probabilistic applications.</description><subject>CMOS</subject><subject>CMOS integrated circuits</subject><subject>Computation</subject><subject>Density</subject><subject>Devices</subject><subject>Materials</subject><subject>Memory devices</subject><subject>Memristor</subject><subject>Memristors</subject><subject>Probabilistic logic</subject><subject>Programming</subject><subject>Resistance</subject><subject>Resistors</subject><subject>stochastic computing</subject><subject>stochastic number generator</subject><subject>stochastic switching</subject><subject>Stochasticity</subject><subject>Streams</subject><subject>Switches</subject><issn>1536-125X</issn><issn>1941-0085</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2014</creationdate><recordtype>article</recordtype><recordid>eNpdkDtPwzAUhS0EEqXwB2CJxMKS4nfsjagqD6m0A0Visxz3hqZqkmI7SP33pLRiYLpn-M7R1YfQNcEjQrC-X8zy2XxEMeEjyjBmnJ6gAdGcpBgrcdpnwWRKqPg4RxchrDEmmRRqgB7yZGZj9Q3JW2zdyoZYuWTc1tsuVs1nknu3qiK42HlIJo0tNrBMil3yCrWvQmx9uERnpd0EuDreIXp_nCzGz-l0_vQyzqepY5rHVDimVCa141aXqqCMKitpIbggUimK9VJkPCuWjjEFIGmpoWCssMIyZ6XTbIjuDrtb3351EKKpq-Bgs7ENtF0wRPQjUmAie_T2H7puO9_03_UUlhllIiM9RQ-U820IHkqz9VVt_c4QbPZSza9Us5dqjlL70s2hVAHAX0FmhAst2A9vGXGD</recordid><startdate>201403</startdate><enddate>201403</enddate><creator>Knag, Phil</creator><creator>Wei Lu</creator><creator>Zhengya Zhang</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>7SR</scope><scope>7U5</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>L7M</scope><scope>F28</scope><scope>FR3</scope></search><sort><creationdate>201403</creationdate><title>A Native Stochastic Computing Architecture Enabled by Memristors</title><author>Knag, Phil ; Wei Lu ; Zhengya Zhang</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c394t-5c388769c4a9f8b2328a62b5451688209d5747bdc338ee62f9eb33ba5a3ca6c93</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2014</creationdate><topic>CMOS</topic><topic>CMOS integrated circuits</topic><topic>Computation</topic><topic>Density</topic><topic>Devices</topic><topic>Materials</topic><topic>Memory devices</topic><topic>Memristor</topic><topic>Memristors</topic><topic>Probabilistic logic</topic><topic>Programming</topic><topic>Resistance</topic><topic>Resistors</topic><topic>stochastic computing</topic><topic>stochastic number generator</topic><topic>stochastic switching</topic><topic>Stochasticity</topic><topic>Streams</topic><topic>Switches</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Knag, Phil</creatorcontrib><creatorcontrib>Wei Lu</creatorcontrib><creatorcontrib>Zhengya Zhang</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005–Present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Xplore</collection><collection>CrossRef</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>ANTE: Abstracts in New Technology &amp; Engineering</collection><collection>Engineering Research Database</collection><jtitle>IEEE transactions on nanotechnology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Knag, Phil</au><au>Wei Lu</au><au>Zhengya Zhang</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Native Stochastic Computing Architecture Enabled by Memristors</atitle><jtitle>IEEE transactions on nanotechnology</jtitle><stitle>TNANO</stitle><date>2014-03</date><risdate>2014</risdate><volume>13</volume><issue>2</issue><spage>283</spage><epage>293</epage><pages>283-293</pages><issn>1536-125X</issn><eissn>1941-0085</eissn><coden>ITNECU</coden><abstract>A two-terminal memristor device is a promising digital memory for its high integration density, substantially lower energy consumption compared to CMOS, and scalability below 10 nm. However, a nanoscale memristor is an inherently stochastic device, and extra energy and latency are required to make a deterministic memory based on memristors. Instead of enforcing deterministic storage, we take advantage of the nondeterministic memory for native stochastic computing, where the randomness required by stochastic computing is intrinsic to the devices without resorting to expensive stochastic number generation. This native stochastic computing system can be implemented as a hybrid integration of memristor memory and simple CMOS stochastic computing circuits. We use an approach called group write to program memristor memory cells in arrays to generate random bit streams for stochastic computing. Three methods are proposed to program memristors using stochastic bit streams and compensate for the nonlinear memristor write function: voltage predistortion, parallel single-pulse write, and downscaled write and upscaled read. To evaluate these technical approaches, we show by simulation a memristor-based stochastic processor for gradient descent optimization, and k-means clustering. The native stochastic computing based on memristors demonstrates key advantages in energy and speed in compute-intensive, data-intensive, and probabilistic applications.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TNANO.2014.2300342</doi><tpages>11</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1536-125X
ispartof IEEE transactions on nanotechnology, 2014-03, Vol.13 (2), p.283-293
issn 1536-125X
1941-0085
language eng
recordid cdi_proquest_miscellaneous_1520965016
source IEEE Electronic Library (IEL) Journals
subjects CMOS
CMOS integrated circuits
Computation
Density
Devices
Materials
Memory devices
Memristor
Memristors
Probabilistic logic
Programming
Resistance
Resistors
stochastic computing
stochastic number generator
stochastic switching
Stochasticity
Streams
Switches
title A Native Stochastic Computing Architecture Enabled by Memristors
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-14T10%3A34%3A31IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Native%20Stochastic%20Computing%20Architecture%20Enabled%20by%20Memristors&rft.jtitle=IEEE%20transactions%20on%20nanotechnology&rft.au=Knag,%20Phil&rft.date=2014-03&rft.volume=13&rft.issue=2&rft.spage=283&rft.epage=293&rft.pages=283-293&rft.issn=1536-125X&rft.eissn=1941-0085&rft.coden=ITNECU&rft_id=info:doi/10.1109/TNANO.2014.2300342&rft_dat=%3Cproquest_ieee_%3E1520965016%3C/proquest_ieee_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c394t-5c388769c4a9f8b2328a62b5451688209d5747bdc338ee62f9eb33ba5a3ca6c93%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=1506723571&rft_id=info:pmid/&rft_ieee_id=6714595&rfr_iscdi=true