Loading…

3.7 A 1920×1080 30fps 2.3TOPS/W stereo-depth processor for robust autonomous navigation

This paper presents a stereo vision processor that fully implements the SGM algorithm on a single chip. The design uses a new image-scanning stride to enable a deeply pipelined implementation with ultra-wide (1612b) custom SRAM for 1.64Tb/s on-chip access bandwidth. Our design is the first ASIC to r...

Full description

Saved in:
Bibliographic Details
Main Authors: Ziyun Li, Qing Dong, Saligane, Mehdi, Kempke, Benjamin, Shijia Yang, Zhengya Zhang, Dreslinski, Ronald, Sylvester, Dennis, Blaauw, David, Hun Seok Kim
Format: Conference Proceeding
Language:English
Subjects:
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page 63
container_issue
container_start_page 62
container_title
container_volume
creator Ziyun Li
Qing Dong
Saligane, Mehdi
Kempke, Benjamin
Shijia Yang
Zhengya Zhang
Dreslinski, Ronald
Sylvester, Dennis
Blaauw, David
Hun Seok Kim
description This paper presents a stereo vision processor that fully implements the SGM algorithm on a single chip. The design uses a new image-scanning stride to enable a deeply pipelined implementation with ultra-wide (1612b) custom SRAM for 1.64Tb/s on-chip access bandwidth. Our design is the first ASIC to report performance under the industrial standard KITTI benchmark that renders realistic automobile scenes. The proposed design supports 512-level depth resolution on full HD (1920×1080) resolution with real-time 30fps, consuming 836mW from a 0.75V supply in 40nm CMOS. We also integrate the stereo chip with a quadcopter and demonstrate its operation in real-time flight.
doi_str_mv 10.1109/ISSCC.2017.7870261
format conference_proceeding
fullrecord <record><control><sourceid>ieee_CHZPO</sourceid><recordid>TN_cdi_ieee_primary_7870261</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>7870261</ieee_id><sourcerecordid>7870261</sourcerecordid><originalsourceid>FETCH-ieee_primary_78702613</originalsourceid><addsrcrecordid>eNp9jj1uwjAYQN1KlaDABejyXSDms634Z0QRqJ1aKUiwIbd12lQljvw5SJyEA_ViMDB3eHrDWx5jc4FcCHSLl7quKi5RGG6sQanFHZs5Y0WJDpUprbxnY6mMLqxGPWKPRD-IWDptx2ynuIElCCfx7yzQIihsegLJ1eb1rV5sgXJIIRafoc_f0Kf4EYhiguZKiu8DZfBDjl08xIGg88f2y-c2dlP20PhfCrObJ-xpvdpUz0UbQtj3qT34dNrfhtX_9QJmPEFb</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>3.7 A 1920×1080 30fps 2.3TOPS/W stereo-depth processor for robust autonomous navigation</title><source>IEEE Xplore All Conference Series</source><creator>Ziyun Li ; Qing Dong ; Saligane, Mehdi ; Kempke, Benjamin ; Shijia Yang ; Zhengya Zhang ; Dreslinski, Ronald ; Sylvester, Dennis ; Blaauw, David ; Hun Seok Kim</creator><creatorcontrib>Ziyun Li ; Qing Dong ; Saligane, Mehdi ; Kempke, Benjamin ; Shijia Yang ; Zhengya Zhang ; Dreslinski, Ronald ; Sylvester, Dennis ; Blaauw, David ; Hun Seok Kim</creatorcontrib><description>This paper presents a stereo vision processor that fully implements the SGM algorithm on a single chip. The design uses a new image-scanning stride to enable a deeply pipelined implementation with ultra-wide (1612b) custom SRAM for 1.64Tb/s on-chip access bandwidth. Our design is the first ASIC to report performance under the industrial standard KITTI benchmark that renders realistic automobile scenes. The proposed design supports 512-level depth resolution on full HD (1920×1080) resolution with real-time 30fps, consuming 836mW from a 0.75V supply in 40nm CMOS. We also integrate the stereo chip with a quadcopter and demonstrate its operation in real-time flight.</description><identifier>EISSN: 2376-8606</identifier><identifier>EISBN: 9781509037582</identifier><identifier>EISBN: 1509037586</identifier><identifier>DOI: 10.1109/ISSCC.2017.7870261</identifier><language>eng</language><publisher>IEEE</publisher><subject>Bandwidth ; High definition video ; Image resolution ; Memory management ; Program processors ; Random access memory ; Real-time systems</subject><ispartof>2017 IEEE International Solid-State Circuits Conference (ISSCC), 2017, p.62-63</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/7870261$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,780,784,789,790,27925,54555,54932</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/7870261$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Ziyun Li</creatorcontrib><creatorcontrib>Qing Dong</creatorcontrib><creatorcontrib>Saligane, Mehdi</creatorcontrib><creatorcontrib>Kempke, Benjamin</creatorcontrib><creatorcontrib>Shijia Yang</creatorcontrib><creatorcontrib>Zhengya Zhang</creatorcontrib><creatorcontrib>Dreslinski, Ronald</creatorcontrib><creatorcontrib>Sylvester, Dennis</creatorcontrib><creatorcontrib>Blaauw, David</creatorcontrib><creatorcontrib>Hun Seok Kim</creatorcontrib><title>3.7 A 1920×1080 30fps 2.3TOPS/W stereo-depth processor for robust autonomous navigation</title><title>2017 IEEE International Solid-State Circuits Conference (ISSCC)</title><addtitle>ISSCC</addtitle><description>This paper presents a stereo vision processor that fully implements the SGM algorithm on a single chip. The design uses a new image-scanning stride to enable a deeply pipelined implementation with ultra-wide (1612b) custom SRAM for 1.64Tb/s on-chip access bandwidth. Our design is the first ASIC to report performance under the industrial standard KITTI benchmark that renders realistic automobile scenes. The proposed design supports 512-level depth resolution on full HD (1920×1080) resolution with real-time 30fps, consuming 836mW from a 0.75V supply in 40nm CMOS. We also integrate the stereo chip with a quadcopter and demonstrate its operation in real-time flight.</description><subject>Bandwidth</subject><subject>High definition video</subject><subject>Image resolution</subject><subject>Memory management</subject><subject>Program processors</subject><subject>Random access memory</subject><subject>Real-time systems</subject><issn>2376-8606</issn><isbn>9781509037582</isbn><isbn>1509037586</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2017</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><recordid>eNp9jj1uwjAYQN1KlaDABejyXSDms634Z0QRqJ1aKUiwIbd12lQljvw5SJyEA_ViMDB3eHrDWx5jc4FcCHSLl7quKi5RGG6sQanFHZs5Y0WJDpUprbxnY6mMLqxGPWKPRD-IWDptx2ynuIElCCfx7yzQIihsegLJ1eb1rV5sgXJIIRafoc_f0Kf4EYhiguZKiu8DZfBDjl08xIGg88f2y-c2dlP20PhfCrObJ-xpvdpUz0UbQtj3qT34dNrfhtX_9QJmPEFb</recordid><startdate>201702</startdate><enddate>201702</enddate><creator>Ziyun Li</creator><creator>Qing Dong</creator><creator>Saligane, Mehdi</creator><creator>Kempke, Benjamin</creator><creator>Shijia Yang</creator><creator>Zhengya Zhang</creator><creator>Dreslinski, Ronald</creator><creator>Sylvester, Dennis</creator><creator>Blaauw, David</creator><creator>Hun Seok Kim</creator><general>IEEE</general><scope>6IE</scope><scope>6IH</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIO</scope></search><sort><creationdate>201702</creationdate><title>3.7 A 1920×1080 30fps 2.3TOPS/W stereo-depth processor for robust autonomous navigation</title><author>Ziyun Li ; Qing Dong ; Saligane, Mehdi ; Kempke, Benjamin ; Shijia Yang ; Zhengya Zhang ; Dreslinski, Ronald ; Sylvester, Dennis ; Blaauw, David ; Hun Seok Kim</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-ieee_primary_78702613</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Bandwidth</topic><topic>High definition video</topic><topic>Image resolution</topic><topic>Memory management</topic><topic>Program processors</topic><topic>Random access memory</topic><topic>Real-time systems</topic><toplevel>online_resources</toplevel><creatorcontrib>Ziyun Li</creatorcontrib><creatorcontrib>Qing Dong</creatorcontrib><creatorcontrib>Saligane, Mehdi</creatorcontrib><creatorcontrib>Kempke, Benjamin</creatorcontrib><creatorcontrib>Shijia Yang</creatorcontrib><creatorcontrib>Zhengya Zhang</creatorcontrib><creatorcontrib>Dreslinski, Ronald</creatorcontrib><creatorcontrib>Sylvester, Dennis</creatorcontrib><creatorcontrib>Blaauw, David</creatorcontrib><creatorcontrib>Hun Seok Kim</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan (POP) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP) 1998-present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Ziyun Li</au><au>Qing Dong</au><au>Saligane, Mehdi</au><au>Kempke, Benjamin</au><au>Shijia Yang</au><au>Zhengya Zhang</au><au>Dreslinski, Ronald</au><au>Sylvester, Dennis</au><au>Blaauw, David</au><au>Hun Seok Kim</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>3.7 A 1920×1080 30fps 2.3TOPS/W stereo-depth processor for robust autonomous navigation</atitle><btitle>2017 IEEE International Solid-State Circuits Conference (ISSCC)</btitle><stitle>ISSCC</stitle><date>2017-02</date><risdate>2017</risdate><spage>62</spage><epage>63</epage><pages>62-63</pages><eissn>2376-8606</eissn><eisbn>9781509037582</eisbn><eisbn>1509037586</eisbn><abstract>This paper presents a stereo vision processor that fully implements the SGM algorithm on a single chip. The design uses a new image-scanning stride to enable a deeply pipelined implementation with ultra-wide (1612b) custom SRAM for 1.64Tb/s on-chip access bandwidth. Our design is the first ASIC to report performance under the industrial standard KITTI benchmark that renders realistic automobile scenes. The proposed design supports 512-level depth resolution on full HD (1920×1080) resolution with real-time 30fps, consuming 836mW from a 0.75V supply in 40nm CMOS. We also integrate the stereo chip with a quadcopter and demonstrate its operation in real-time flight.</abstract><pub>IEEE</pub><doi>10.1109/ISSCC.2017.7870261</doi></addata></record>
fulltext fulltext_linktorsrc
identifier EISSN: 2376-8606
ispartof 2017 IEEE International Solid-State Circuits Conference (ISSCC), 2017, p.62-63
issn 2376-8606
language eng
recordid cdi_ieee_primary_7870261
source IEEE Xplore All Conference Series
subjects Bandwidth
High definition video
Image resolution
Memory management
Program processors
Random access memory
Real-time systems
title 3.7 A 1920×1080 30fps 2.3TOPS/W stereo-depth processor for robust autonomous navigation
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T21%3A44%3A44IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_CHZPO&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=3.7%20A%201920%C3%971080%2030fps%202.3TOPS/W%20stereo-depth%20processor%20for%20robust%20autonomous%20navigation&rft.btitle=2017%20IEEE%20International%20Solid-State%20Circuits%20Conference%20(ISSCC)&rft.au=Ziyun%20Li&rft.date=2017-02&rft.spage=62&rft.epage=63&rft.pages=62-63&rft.eissn=2376-8606&rft_id=info:doi/10.1109/ISSCC.2017.7870261&rft.eisbn=9781509037582&rft.eisbn_list=1509037586&rft_dat=%3Cieee_CHZPO%3E7870261%3C/ieee_CHZPO%3E%3Cgrp_id%3Ecdi_FETCH-ieee_primary_78702613%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=7870261&rfr_iscdi=true