Non-line-of-sight Imaging with Partial Occluders and Surface Normals

Imaging objects obscured by occluders is a significant challenge for many applications. A camera that could “see around corners” could help improve navigation and mapping capabilities of autonomous vehicles or make search and rescue missions more effective. Time-resolved single-photon imaging system...

Full description

Saved in:
Bibliographic Details
Published in:ACM transactions on graphics 2019-06, Vol.38 (3), p.1-10
Main Authors: Heide, Felix, O’Toole, Matthew, Zang, Kai, Lindell, David B., Diamond, Steven, Wetzstein, Gordon
Format: Article
Language:English
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c258t-2f8be377826347b53e1242f43c4f8b9138cdd19e1346ef2a6034265ae8971f353
cites cdi_FETCH-LOGICAL-c258t-2f8be377826347b53e1242f43c4f8b9138cdd19e1346ef2a6034265ae8971f353
container_end_page 10
container_issue 3
container_start_page 1
container_title ACM transactions on graphics
container_volume 38
creator Heide, Felix
O’Toole, Matthew
Zang, Kai
Lindell, David B.
Diamond, Steven
Wetzstein, Gordon
description Imaging objects obscured by occluders is a significant challenge for many applications. A camera that could “see around corners” could help improve navigation and mapping capabilities of autonomous vehicles or make search and rescue missions more effective. Time-resolved single-photon imaging systems have recently been demonstrated to record optical information of a scene that can lead to an estimation of the shape and reflectance of objects hidden from the line of sight of a camera. However, existing non-line-of-sight (NLOS) reconstruction algorithms have been constrained in the types of light transport effects they model for the hidden scene parts. We introduce a factored NLOS light transport representation that accounts for partial occlusions and surface normals. Based on this model, we develop a factorization approach for inverse time-resolved light transport and demonstrate high-fidelity NLOS reconstructions for challenging scenes both in simulation and with an experimental NLOS imaging system.
doi_str_mv 10.1145/3269977
format article
fullrecord <record><control><sourceid>crossref</sourceid><recordid>TN_cdi_crossref_primary_10_1145_3269977</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>10_1145_3269977</sourcerecordid><originalsourceid>FETCH-LOGICAL-c258t-2f8be377826347b53e1242f43c4f8b9138cdd19e1346ef2a6034265ae8971f353</originalsourceid><addsrcrecordid>eNotj8tKAzEUQIMoOFbxF7JzFc3NzWuWUl-F0grqekgzyTQynZFkivj3VuzqLA4cOIRcA78FkOoOha5rY05IBUoZZlDbU1Jxg5xx5HBOLkr55JxrKXVFHlbjwPo0BDZGVlK3nehi57o0dPQ7TVv66vKUXE_X3vf7NuRC3dDSt32Ozge6GvPO9eWSnMUDwtWRM_Lx9Pg-f2HL9fNifr9kXig7MRHtJqAxVmiUZqMwgJAiSvTyYGpA69sW6gAodYjCaY5SaOWCrQ1EVDgjN_9dn8dScojNV047l38a4M3ffHOcx1_Ik0oc</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Non-line-of-sight Imaging with Partial Occluders and Surface Normals</title><source>Association for Computing Machinery:Jisc Collections:ACM OPEN Journals 2023-2025 (reading list)</source><creator>Heide, Felix ; O’Toole, Matthew ; Zang, Kai ; Lindell, David B. ; Diamond, Steven ; Wetzstein, Gordon</creator><creatorcontrib>Heide, Felix ; O’Toole, Matthew ; Zang, Kai ; Lindell, David B. ; Diamond, Steven ; Wetzstein, Gordon</creatorcontrib><description>Imaging objects obscured by occluders is a significant challenge for many applications. A camera that could “see around corners” could help improve navigation and mapping capabilities of autonomous vehicles or make search and rescue missions more effective. Time-resolved single-photon imaging systems have recently been demonstrated to record optical information of a scene that can lead to an estimation of the shape and reflectance of objects hidden from the line of sight of a camera. However, existing non-line-of-sight (NLOS) reconstruction algorithms have been constrained in the types of light transport effects they model for the hidden scene parts. We introduce a factored NLOS light transport representation that accounts for partial occlusions and surface normals. Based on this model, we develop a factorization approach for inverse time-resolved light transport and demonstrate high-fidelity NLOS reconstructions for challenging scenes both in simulation and with an experimental NLOS imaging system.</description><identifier>ISSN: 0730-0301</identifier><identifier>EISSN: 1557-7368</identifier><identifier>DOI: 10.1145/3269977</identifier><language>eng</language><ispartof>ACM transactions on graphics, 2019-06, Vol.38 (3), p.1-10</ispartof><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c258t-2f8be377826347b53e1242f43c4f8b9138cdd19e1346ef2a6034265ae8971f353</citedby><cites>FETCH-LOGICAL-c258t-2f8be377826347b53e1242f43c4f8b9138cdd19e1346ef2a6034265ae8971f353</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Heide, Felix</creatorcontrib><creatorcontrib>O’Toole, Matthew</creatorcontrib><creatorcontrib>Zang, Kai</creatorcontrib><creatorcontrib>Lindell, David B.</creatorcontrib><creatorcontrib>Diamond, Steven</creatorcontrib><creatorcontrib>Wetzstein, Gordon</creatorcontrib><title>Non-line-of-sight Imaging with Partial Occluders and Surface Normals</title><title>ACM transactions on graphics</title><description>Imaging objects obscured by occluders is a significant challenge for many applications. A camera that could “see around corners” could help improve navigation and mapping capabilities of autonomous vehicles or make search and rescue missions more effective. Time-resolved single-photon imaging systems have recently been demonstrated to record optical information of a scene that can lead to an estimation of the shape and reflectance of objects hidden from the line of sight of a camera. However, existing non-line-of-sight (NLOS) reconstruction algorithms have been constrained in the types of light transport effects they model for the hidden scene parts. We introduce a factored NLOS light transport representation that accounts for partial occlusions and surface normals. Based on this model, we develop a factorization approach for inverse time-resolved light transport and demonstrate high-fidelity NLOS reconstructions for challenging scenes both in simulation and with an experimental NLOS imaging system.</description><issn>0730-0301</issn><issn>1557-7368</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNotj8tKAzEUQIMoOFbxF7JzFc3NzWuWUl-F0grqekgzyTQynZFkivj3VuzqLA4cOIRcA78FkOoOha5rY05IBUoZZlDbU1Jxg5xx5HBOLkr55JxrKXVFHlbjwPo0BDZGVlK3nehi57o0dPQ7TVv66vKUXE_X3vf7NuRC3dDSt32Ozge6GvPO9eWSnMUDwtWRM_Lx9Pg-f2HL9fNifr9kXig7MRHtJqAxVmiUZqMwgJAiSvTyYGpA69sW6gAodYjCaY5SaOWCrQ1EVDgjN_9dn8dScojNV047l38a4M3ffHOcx1_Ik0oc</recordid><startdate>20190630</startdate><enddate>20190630</enddate><creator>Heide, Felix</creator><creator>O’Toole, Matthew</creator><creator>Zang, Kai</creator><creator>Lindell, David B.</creator><creator>Diamond, Steven</creator><creator>Wetzstein, Gordon</creator><scope>AAYXX</scope><scope>CITATION</scope></search><sort><creationdate>20190630</creationdate><title>Non-line-of-sight Imaging with Partial Occluders and Surface Normals</title><author>Heide, Felix ; O’Toole, Matthew ; Zang, Kai ; Lindell, David B. ; Diamond, Steven ; Wetzstein, Gordon</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c258t-2f8be377826347b53e1242f43c4f8b9138cdd19e1346ef2a6034265ae8971f353</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Heide, Felix</creatorcontrib><creatorcontrib>O’Toole, Matthew</creatorcontrib><creatorcontrib>Zang, Kai</creatorcontrib><creatorcontrib>Lindell, David B.</creatorcontrib><creatorcontrib>Diamond, Steven</creatorcontrib><creatorcontrib>Wetzstein, Gordon</creatorcontrib><collection>CrossRef</collection><jtitle>ACM transactions on graphics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Heide, Felix</au><au>O’Toole, Matthew</au><au>Zang, Kai</au><au>Lindell, David B.</au><au>Diamond, Steven</au><au>Wetzstein, Gordon</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Non-line-of-sight Imaging with Partial Occluders and Surface Normals</atitle><jtitle>ACM transactions on graphics</jtitle><date>2019-06-30</date><risdate>2019</risdate><volume>38</volume><issue>3</issue><spage>1</spage><epage>10</epage><pages>1-10</pages><issn>0730-0301</issn><eissn>1557-7368</eissn><abstract>Imaging objects obscured by occluders is a significant challenge for many applications. A camera that could “see around corners” could help improve navigation and mapping capabilities of autonomous vehicles or make search and rescue missions more effective. Time-resolved single-photon imaging systems have recently been demonstrated to record optical information of a scene that can lead to an estimation of the shape and reflectance of objects hidden from the line of sight of a camera. However, existing non-line-of-sight (NLOS) reconstruction algorithms have been constrained in the types of light transport effects they model for the hidden scene parts. We introduce a factored NLOS light transport representation that accounts for partial occlusions and surface normals. Based on this model, we develop a factorization approach for inverse time-resolved light transport and demonstrate high-fidelity NLOS reconstructions for challenging scenes both in simulation and with an experimental NLOS imaging system.</abstract><doi>10.1145/3269977</doi><tpages>10</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0730-0301
ispartof ACM transactions on graphics, 2019-06, Vol.38 (3), p.1-10
issn 0730-0301
1557-7368
language eng
recordid cdi_crossref_primary_10_1145_3269977
source Association for Computing Machinery:Jisc Collections:ACM OPEN Journals 2023-2025 (reading list)
title Non-line-of-sight Imaging with Partial Occluders and Surface Normals
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T20%3A01%3A16IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Non-line-of-sight%20Imaging%20with%20Partial%20Occluders%20and%20Surface%20Normals&rft.jtitle=ACM%20transactions%20on%20graphics&rft.au=Heide,%20Felix&rft.date=2019-06-30&rft.volume=38&rft.issue=3&rft.spage=1&rft.epage=10&rft.pages=1-10&rft.issn=0730-0301&rft.eissn=1557-7368&rft_id=info:doi/10.1145/3269977&rft_dat=%3Ccrossref%3E10_1145_3269977%3C/crossref%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c258t-2f8be377826347b53e1242f43c4f8b9138cdd19e1346ef2a6034265ae8971f353%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true