Loading…

Estimating Object Proper Motion Using Optical Flow, Kinematics, and Depth Information

For the interaction of a mobile robot with a dynamic environment, the estimation of object motion is desired while the robot is walking and/or turning its head. In this paper, we describe a system which manages this task by combining depth from a stereo camera and computation of the camera movement...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on cybernetics 2008-08, Vol.38 (4), p.1139-1151
Main Authors: Schmudderich, J., Willert, V., Eggert, J., Rebhan, S., Goerick, C., Sagerer, G., Korner, E.
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c378t-f4038220358df46dbd897e3a17eeafa270eac31b853e0be935fadc6d67fdd8b53
cites cdi_FETCH-LOGICAL-c378t-f4038220358df46dbd897e3a17eeafa270eac31b853e0be935fadc6d67fdd8b53
container_end_page 1151
container_issue 4
container_start_page 1139
container_title IEEE transactions on cybernetics
container_volume 38
creator Schmudderich, J.
Willert, V.
Eggert, J.
Rebhan, S.
Goerick, C.
Sagerer, G.
Korner, E.
description For the interaction of a mobile robot with a dynamic environment, the estimation of object motion is desired while the robot is walking and/or turning its head. In this paper, we describe a system which manages this task by combining depth from a stereo camera and computation of the camera movement from robot kinematics in order to stabilize the camera images. Moving objects are detected by applying optical flow to the stabilized images followed by a filtering method, which incorporates both prior knowledge about the accuracy of the measurement and the uncertainties of the measurement process itself. The efficiency of this system is demonstrated in a dynamic real-world scenario with a walking humanoid robot.
doi_str_mv 10.1109/TSMCB.2008.925657
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1109_TSMCB_2008_925657</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>4567548</ieee_id><sourcerecordid>875057969</sourcerecordid><originalsourceid>FETCH-LOGICAL-c378t-f4038220358df46dbd897e3a17eeafa270eac31b853e0be935fadc6d67fdd8b53</originalsourceid><addsrcrecordid>eNp9kU1v1DAQhi0EoqXwAxASsjjQS7OM4-8jLC2taFUkumfLiSeQVTYOdlaIf4-3uyoSh5488jzvyJ6HkNcMFoyB_XD3_Wb5aVEDmIWtpZL6CTlmVrAKhK2flhoMr4Rg9oi8yHkNABasfk6OmFG8FsCPyeo8z_3Gz_34g942a2xn-i3FCRO9iXMfR7rK961p7ls_0Ish_j6jX_sRd5k2n1E_BvoZp_knvRq7mHbXcXxJnnV-yPjqcJ6Q1cX53fKyur79crX8eF21XJu56soTTF0DlyZ0QoUmGKuRe6YRfedrDehbzhojOUKDlsvOh1YFpbsQTCP5CTndz51S_LXFPLtNn1scBj9i3GZntASprbKFfP8oWRCmleYFfPcfuI7bNJZfOKNqLizXUCC2h9oUc07YuSmVLaY_joHbqXH3atxOjdurKZm3h8HbZoPhX-LgogBv9kCPiA9tIZWWwvC_7m-SHg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>862349370</pqid></control><display><type>article</type><title>Estimating Object Proper Motion Using Optical Flow, Kinematics, and Depth Information</title><source>IEEE Electronic Library (IEL) Journals</source><creator>Schmudderich, J. ; Willert, V. ; Eggert, J. ; Rebhan, S. ; Goerick, C. ; Sagerer, G. ; Korner, E.</creator><creatorcontrib>Schmudderich, J. ; Willert, V. ; Eggert, J. ; Rebhan, S. ; Goerick, C. ; Sagerer, G. ; Korner, E.</creatorcontrib><description>For the interaction of a mobile robot with a dynamic environment, the estimation of object motion is desired while the robot is walking and/or turning its head. In this paper, we describe a system which manages this task by combining depth from a stereo camera and computation of the camera movement from robot kinematics in order to stabilize the camera images. Moving objects are detected by applying optical flow to the stabilized images followed by a filtering method, which incorporates both prior knowledge about the accuracy of the measurement and the uncertainties of the measurement process itself. The efficiency of this system is demonstrated in a dynamic real-world scenario with a walking humanoid robot.</description><identifier>ISSN: 1083-4419</identifier><identifier>ISSN: 2168-2267</identifier><identifier>EISSN: 1941-0492</identifier><identifier>EISSN: 2168-2275</identifier><identifier>DOI: 10.1109/TSMCB.2008.925657</identifier><identifier>PMID: 18632403</identifier><identifier>CODEN: ITSCFI</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Algorithms ; Biomechanical Phenomena - methods ; Cameras ; Computer Simulation ; Cybernetics ; Disparity ; Dynamical systems ; Dynamics ; egomotion (EM) ; Fluid flow measurement ; Image motion analysis ; Kinematics ; Legged locomotion ; Measurement uncertainty ; Mobile robots ; Models, Theoretical ; Motion ; Motion estimation ; Optical filters ; optical flow (OF) ; Rheology - methods ; Robot vision systems ; Robotics - methods ; Robots ; Walking</subject><ispartof>IEEE transactions on cybernetics, 2008-08, Vol.38 (4), p.1139-1151</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2008</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c378t-f4038220358df46dbd897e3a17eeafa270eac31b853e0be935fadc6d67fdd8b53</citedby><cites>FETCH-LOGICAL-c378t-f4038220358df46dbd897e3a17eeafa270eac31b853e0be935fadc6d67fdd8b53</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/4567548$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,54796</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/18632403$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Schmudderich, J.</creatorcontrib><creatorcontrib>Willert, V.</creatorcontrib><creatorcontrib>Eggert, J.</creatorcontrib><creatorcontrib>Rebhan, S.</creatorcontrib><creatorcontrib>Goerick, C.</creatorcontrib><creatorcontrib>Sagerer, G.</creatorcontrib><creatorcontrib>Korner, E.</creatorcontrib><title>Estimating Object Proper Motion Using Optical Flow, Kinematics, and Depth Information</title><title>IEEE transactions on cybernetics</title><addtitle>TSMCB</addtitle><addtitle>IEEE Trans Syst Man Cybern B Cybern</addtitle><description>For the interaction of a mobile robot with a dynamic environment, the estimation of object motion is desired while the robot is walking and/or turning its head. In this paper, we describe a system which manages this task by combining depth from a stereo camera and computation of the camera movement from robot kinematics in order to stabilize the camera images. Moving objects are detected by applying optical flow to the stabilized images followed by a filtering method, which incorporates both prior knowledge about the accuracy of the measurement and the uncertainties of the measurement process itself. The efficiency of this system is demonstrated in a dynamic real-world scenario with a walking humanoid robot.</description><subject>Algorithms</subject><subject>Biomechanical Phenomena - methods</subject><subject>Cameras</subject><subject>Computer Simulation</subject><subject>Cybernetics</subject><subject>Disparity</subject><subject>Dynamical systems</subject><subject>Dynamics</subject><subject>egomotion (EM)</subject><subject>Fluid flow measurement</subject><subject>Image motion analysis</subject><subject>Kinematics</subject><subject>Legged locomotion</subject><subject>Measurement uncertainty</subject><subject>Mobile robots</subject><subject>Models, Theoretical</subject><subject>Motion</subject><subject>Motion estimation</subject><subject>Optical filters</subject><subject>optical flow (OF)</subject><subject>Rheology - methods</subject><subject>Robot vision systems</subject><subject>Robotics - methods</subject><subject>Robots</subject><subject>Walking</subject><issn>1083-4419</issn><issn>2168-2267</issn><issn>1941-0492</issn><issn>2168-2275</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2008</creationdate><recordtype>article</recordtype><recordid>eNp9kU1v1DAQhi0EoqXwAxASsjjQS7OM4-8jLC2taFUkumfLiSeQVTYOdlaIf4-3uyoSh5488jzvyJ6HkNcMFoyB_XD3_Wb5aVEDmIWtpZL6CTlmVrAKhK2flhoMr4Rg9oi8yHkNABasfk6OmFG8FsCPyeo8z_3Gz_34g942a2xn-i3FCRO9iXMfR7rK961p7ls_0Ish_j6jX_sRd5k2n1E_BvoZp_knvRq7mHbXcXxJnnV-yPjqcJ6Q1cX53fKyur79crX8eF21XJu56soTTF0DlyZ0QoUmGKuRe6YRfedrDehbzhojOUKDlsvOh1YFpbsQTCP5CTndz51S_LXFPLtNn1scBj9i3GZntASprbKFfP8oWRCmleYFfPcfuI7bNJZfOKNqLizXUCC2h9oUc07YuSmVLaY_joHbqXH3atxOjdurKZm3h8HbZoPhX-LgogBv9kCPiA9tIZWWwvC_7m-SHg</recordid><startdate>20080801</startdate><enddate>20080801</enddate><creator>Schmudderich, J.</creator><creator>Willert, V.</creator><creator>Eggert, J.</creator><creator>Rebhan, S.</creator><creator>Goerick, C.</creator><creator>Sagerer, G.</creator><creator>Korner, E.</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7TB</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>H8D</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>7X8</scope></search><sort><creationdate>20080801</creationdate><title>Estimating Object Proper Motion Using Optical Flow, Kinematics, and Depth Information</title><author>Schmudderich, J. ; Willert, V. ; Eggert, J. ; Rebhan, S. ; Goerick, C. ; Sagerer, G. ; Korner, E.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c378t-f4038220358df46dbd897e3a17eeafa270eac31b853e0be935fadc6d67fdd8b53</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2008</creationdate><topic>Algorithms</topic><topic>Biomechanical Phenomena - methods</topic><topic>Cameras</topic><topic>Computer Simulation</topic><topic>Cybernetics</topic><topic>Disparity</topic><topic>Dynamical systems</topic><topic>Dynamics</topic><topic>egomotion (EM)</topic><topic>Fluid flow measurement</topic><topic>Image motion analysis</topic><topic>Kinematics</topic><topic>Legged locomotion</topic><topic>Measurement uncertainty</topic><topic>Mobile robots</topic><topic>Models, Theoretical</topic><topic>Motion</topic><topic>Motion estimation</topic><topic>Optical filters</topic><topic>optical flow (OF)</topic><topic>Rheology - methods</topic><topic>Robot vision systems</topic><topic>Robotics - methods</topic><topic>Robots</topic><topic>Walking</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Schmudderich, J.</creatorcontrib><creatorcontrib>Willert, V.</creatorcontrib><creatorcontrib>Eggert, J.</creatorcontrib><creatorcontrib>Rebhan, S.</creatorcontrib><creatorcontrib>Goerick, C.</creatorcontrib><creatorcontrib>Sagerer, G.</creatorcontrib><creatorcontrib>Korner, E.</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE/IET Electronic Library (IEL)</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Mechanical &amp; Transportation Engineering Abstracts</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology &amp; Engineering</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transactions on cybernetics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Schmudderich, J.</au><au>Willert, V.</au><au>Eggert, J.</au><au>Rebhan, S.</au><au>Goerick, C.</au><au>Sagerer, G.</au><au>Korner, E.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Estimating Object Proper Motion Using Optical Flow, Kinematics, and Depth Information</atitle><jtitle>IEEE transactions on cybernetics</jtitle><stitle>TSMCB</stitle><addtitle>IEEE Trans Syst Man Cybern B Cybern</addtitle><date>2008-08-01</date><risdate>2008</risdate><volume>38</volume><issue>4</issue><spage>1139</spage><epage>1151</epage><pages>1139-1151</pages><issn>1083-4419</issn><issn>2168-2267</issn><eissn>1941-0492</eissn><eissn>2168-2275</eissn><coden>ITSCFI</coden><abstract>For the interaction of a mobile robot with a dynamic environment, the estimation of object motion is desired while the robot is walking and/or turning its head. In this paper, we describe a system which manages this task by combining depth from a stereo camera and computation of the camera movement from robot kinematics in order to stabilize the camera images. Moving objects are detected by applying optical flow to the stabilized images followed by a filtering method, which incorporates both prior knowledge about the accuracy of the measurement and the uncertainties of the measurement process itself. The efficiency of this system is demonstrated in a dynamic real-world scenario with a walking humanoid robot.</abstract><cop>United States</cop><pub>IEEE</pub><pmid>18632403</pmid><doi>10.1109/TSMCB.2008.925657</doi><tpages>13</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1083-4419
ispartof IEEE transactions on cybernetics, 2008-08, Vol.38 (4), p.1139-1151
issn 1083-4419
2168-2267
1941-0492
2168-2275
language eng
recordid cdi_crossref_primary_10_1109_TSMCB_2008_925657
source IEEE Electronic Library (IEL) Journals
subjects Algorithms
Biomechanical Phenomena - methods
Cameras
Computer Simulation
Cybernetics
Disparity
Dynamical systems
Dynamics
egomotion (EM)
Fluid flow measurement
Image motion analysis
Kinematics
Legged locomotion
Measurement uncertainty
Mobile robots
Models, Theoretical
Motion
Motion estimation
Optical filters
optical flow (OF)
Rheology - methods
Robot vision systems
Robotics - methods
Robots
Walking
title Estimating Object Proper Motion Using Optical Flow, Kinematics, and Depth Information
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-06T22%3A23%3A47IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Estimating%20Object%20Proper%20Motion%20Using%20Optical%20Flow,%20Kinematics,%20and%20Depth%20Information&rft.jtitle=IEEE%20transactions%20on%20cybernetics&rft.au=Schmudderich,%20J.&rft.date=2008-08-01&rft.volume=38&rft.issue=4&rft.spage=1139&rft.epage=1151&rft.pages=1139-1151&rft.issn=1083-4419&rft.eissn=1941-0492&rft.coden=ITSCFI&rft_id=info:doi/10.1109/TSMCB.2008.925657&rft_dat=%3Cproquest_cross%3E875057969%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c378t-f4038220358df46dbd897e3a17eeafa270eac31b853e0be935fadc6d67fdd8b53%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=862349370&rft_id=info:pmid/18632403&rft_ieee_id=4567548&rfr_iscdi=true