Stereo Visual-Inertial Odometry with Online Initialization and Extrinsic Self-Calibration

Reliable extrinsic calibration is critical to fuse camera and inertial measurement unit (IMU), which are usually used in stereo visual-inertial odometry (VIO), however, it is difficult to obtain extrinsic parameters in practice. This paper proposes a stereo VIO with the capability of calibrating the...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on instrumentation and measurement 2023-01, Vol.72, p.1-1
Main Authors: Yin, Hongpei, Liu, Peter Xiaoping, Zheng, Minhua
Format: Article
Language:English
Subjects:
Accelerometers
Calibration
Cameras
Gravity
Inertial platforms
Instruments
Odometry
Parameters
Self calibration
Sensor fusion
Velocity measurement
visual-inertial odometry
Visualization
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c245t-fc6b1c2f913a144ac693aa08abcec0432836c905d4fb5c400cd67be7b73f90c03
container_end_page 1
container_issue
container_start_page 1
container_title IEEE transactions on instrumentation and measurement
container_volume 72
creator Yin, Hongpei
Liu, Peter Xiaoping
Zheng, Minhua
description Reliable extrinsic calibration is critical to fuse camera and inertial measurement unit (IMU), which are usually used in stereo visual-inertial odometry (VIO), however, it is difficult to obtain extrinsic parameters in practice. This paper proposes a stereo VIO with the capability of calibrating the unknown extrinsic parameters online. The initial values of IMU-camera and camera-camera transformations are estimated during the initial process, which fully leverages commonly observed features between stereo cameras. The pose and velocity are estimated and the extrinsic parameters are jointly refined. Additionally, the accelerometer and gyroscope biases, and gravity direction are taken into account. The proposed VIO scheme have been demonstrated to be effective without prior knowledge of extrinsic parameters.
doi_str_mv 10.1109/TIM.2023.3282674
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1109_TIM_2023_3282674</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10144437</ieee_id><sourcerecordid>2828004197</sourcerecordid><originalsourceid>FETCH-LOGICAL-c245t-fc6b1c2f913a144ac693aa08abcec0432836c905d4fb5c400cd67be7b73f90c03</originalsourceid><addsrcrecordid>eNpNkL1PwzAQxS0EEqWwMzBYYk45x44dj6jiI1JRhxYkJstxHOEqdYqdCspfj0s7MN3w3ru790PomsCEEJB3y-plkkNOJzQvcy7YCRqRohCZ5Dw_RSMAUmaSFfwcXcS4AgDBmRih98Vgg-3xm4tb3WWVt2FwusPzpl_bIezwlxs-8Nx3zltcebcX3Y8eXO-x9g1--B6C89EZvLBdm02TWoc_-RKdtbqL9uo4x-j18WE5fc5m86dqej_LTM6KIWsNr4nJW0moJoxpwyXVGkpdG2uApTaUGwlFw9q6MAzANFzUVtSCthIM0DG6PezdhP5za-OgVv02-HRSJRIlACNSJBccXCb0MQbbqk1wax12ioDaA1QJoNoDVEeAKXJziDhr7T97-pJRQX8B-RVtRg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2828004197</pqid></control><display><type>article</type><title>Stereo Visual-Inertial Odometry with Online Initialization and Extrinsic Self-Calibration</title><source>IEEE Electronic Library (IEL) Journals</source><creator>Yin, Hongpei ; Liu, Peter Xiaoping ; Zheng, Minhua</creator><creatorcontrib>Yin, Hongpei ; Liu, Peter Xiaoping ; Zheng, Minhua</creatorcontrib><description>Reliable extrinsic calibration is critical to fuse camera and inertial measurement unit (IMU), which are usually used in stereo visual-inertial odometry (VIO), however, it is difficult to obtain extrinsic parameters in practice. This paper proposes a stereo VIO with the capability of calibrating the unknown extrinsic parameters online. The initial values of IMU-camera and camera-camera transformations are estimated during the initial process, which fully leverages commonly observed features between stereo cameras. The pose and velocity are estimated and the extrinsic parameters are jointly refined. Additionally, the accelerometer and gyroscope biases, and gravity direction are taken into account. The proposed VIO scheme have been demonstrated to be effective without prior knowledge of extrinsic parameters.</description><identifier>ISSN: 0018-9456</identifier><identifier>EISSN: 1557-9662</identifier><identifier>DOI: 10.1109/TIM.2023.3282674</identifier><identifier>CODEN: IEIMAO</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Accelerometers ; Calibration ; Cameras ; Gravity ; Inertial platforms ; Instruments ; Odometry ; Parameters ; Self calibration ; Sensor fusion ; Velocity measurement ; visual-inertial odometry ; Visualization</subject><ispartof>IEEE transactions on instrumentation and measurement, 2023-01, Vol.72, p.1-1</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c245t-fc6b1c2f913a144ac693aa08abcec0432836c905d4fb5c400cd67be7b73f90c03</cites><orcidid>0000-0002-1415-9229 ; 0000-0002-8703-6967 ; 0000-0002-4675-5412</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10144437$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,54796</link.rule.ids></links><search><creatorcontrib>Yin, Hongpei</creatorcontrib><creatorcontrib>Liu, Peter Xiaoping</creatorcontrib><creatorcontrib>Zheng, Minhua</creatorcontrib><title>Stereo Visual-Inertial Odometry with Online Initialization and Extrinsic Self-Calibration</title><title>IEEE transactions on instrumentation and measurement</title><addtitle>TIM</addtitle><description>Reliable extrinsic calibration is critical to fuse camera and inertial measurement unit (IMU), which are usually used in stereo visual-inertial odometry (VIO), however, it is difficult to obtain extrinsic parameters in practice. This paper proposes a stereo VIO with the capability of calibrating the unknown extrinsic parameters online. The initial values of IMU-camera and camera-camera transformations are estimated during the initial process, which fully leverages commonly observed features between stereo cameras. The pose and velocity are estimated and the extrinsic parameters are jointly refined. Additionally, the accelerometer and gyroscope biases, and gravity direction are taken into account. The proposed VIO scheme have been demonstrated to be effective without prior knowledge of extrinsic parameters.</description><subject>Accelerometers</subject><subject>Calibration</subject><subject>Cameras</subject><subject>Gravity</subject><subject>Inertial platforms</subject><subject>Instruments</subject><subject>Odometry</subject><subject>Parameters</subject><subject>Self calibration</subject><subject>Sensor fusion</subject><subject>Velocity measurement</subject><subject>visual-inertial odometry</subject><subject>Visualization</subject><issn>0018-9456</issn><issn>1557-9662</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNpNkL1PwzAQxS0EEqWwMzBYYk45x44dj6jiI1JRhxYkJstxHOEqdYqdCspfj0s7MN3w3ru790PomsCEEJB3y-plkkNOJzQvcy7YCRqRohCZ5Dw_RSMAUmaSFfwcXcS4AgDBmRih98Vgg-3xm4tb3WWVt2FwusPzpl_bIezwlxs-8Nx3zltcebcX3Y8eXO-x9g1--B6C89EZvLBdm02TWoc_-RKdtbqL9uo4x-j18WE5fc5m86dqej_LTM6KIWsNr4nJW0moJoxpwyXVGkpdG2uApTaUGwlFw9q6MAzANFzUVtSCthIM0DG6PezdhP5za-OgVv02-HRSJRIlACNSJBccXCb0MQbbqk1wax12ioDaA1QJoNoDVEeAKXJziDhr7T97-pJRQX8B-RVtRg</recordid><startdate>20230101</startdate><enddate>20230101</enddate><creator>Yin, Hongpei</creator><creator>Liu, Peter Xiaoping</creator><creator>Zheng, Minhua</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>7U5</scope><scope>8FD</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0002-1415-9229</orcidid><orcidid>https://orcid.org/0000-0002-8703-6967</orcidid><orcidid>https://orcid.org/0000-0002-4675-5412</orcidid></search><sort><creationdate>20230101</creationdate><title>Stereo Visual-Inertial Odometry with Online Initialization and Extrinsic Self-Calibration</title><author>Yin, Hongpei ; Liu, Peter Xiaoping ; Zheng, Minhua</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c245t-fc6b1c2f913a144ac693aa08abcec0432836c905d4fb5c400cd67be7b73f90c03</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Accelerometers</topic><topic>Calibration</topic><topic>Cameras</topic><topic>Gravity</topic><topic>Inertial platforms</topic><topic>Instruments</topic><topic>Odometry</topic><topic>Parameters</topic><topic>Self calibration</topic><topic>Sensor fusion</topic><topic>Velocity measurement</topic><topic>visual-inertial odometry</topic><topic>Visualization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Yin, Hongpei</creatorcontrib><creatorcontrib>Liu, Peter Xiaoping</creatorcontrib><creatorcontrib>Zheng, Minhua</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) Online</collection><collection>IEL</collection><collection>CrossRef</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on instrumentation and measurement</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yin, Hongpei</au><au>Liu, Peter Xiaoping</au><au>Zheng, Minhua</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Stereo Visual-Inertial Odometry with Online Initialization and Extrinsic Self-Calibration</atitle><jtitle>IEEE transactions on instrumentation and measurement</jtitle><stitle>TIM</stitle><date>2023-01-01</date><risdate>2023</risdate><volume>72</volume><spage>1</spage><epage>1</epage><pages>1-1</pages><issn>0018-9456</issn><eissn>1557-9662</eissn><coden>IEIMAO</coden><abstract>Reliable extrinsic calibration is critical to fuse camera and inertial measurement unit (IMU), which are usually used in stereo visual-inertial odometry (VIO), however, it is difficult to obtain extrinsic parameters in practice. This paper proposes a stereo VIO with the capability of calibrating the unknown extrinsic parameters online. The initial values of IMU-camera and camera-camera transformations are estimated during the initial process, which fully leverages commonly observed features between stereo cameras. The pose and velocity are estimated and the extrinsic parameters are jointly refined. Additionally, the accelerometer and gyroscope biases, and gravity direction are taken into account. The proposed VIO scheme have been demonstrated to be effective without prior knowledge of extrinsic parameters.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TIM.2023.3282674</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0002-1415-9229</orcidid><orcidid>https://orcid.org/0000-0002-8703-6967</orcidid><orcidid>https://orcid.org/0000-0002-4675-5412</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0018-9456
ispartof IEEE transactions on instrumentation and measurement, 2023-01, Vol.72, p.1-1
issn 0018-9456
1557-9662
language eng
recordid cdi_crossref_primary_10_1109_TIM_2023_3282674
source IEEE Electronic Library (IEL) Journals
subjects Accelerometers
Calibration
Cameras
Gravity
Inertial platforms
Instruments
Odometry
Parameters
Self calibration
Sensor fusion
Velocity measurement
visual-inertial odometry
Visualization
title Stereo Visual-Inertial Odometry with Online Initialization and Extrinsic Self-Calibration
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T20%3A12%3A53IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Stereo%20Visual-Inertial%20Odometry%20with%20Online%20Initialization%20and%20Extrinsic%20Self-Calibration&rft.jtitle=IEEE%20transactions%20on%20instrumentation%20and%20measurement&rft.au=Yin,%20Hongpei&rft.date=2023-01-01&rft.volume=72&rft.spage=1&rft.epage=1&rft.pages=1-1&rft.issn=0018-9456&rft.eissn=1557-9662&rft.coden=IEIMAO&rft_id=info:doi/10.1109/TIM.2023.3282674&rft_dat=%3Cproquest_cross%3E2828004197%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c245t-fc6b1c2f913a144ac693aa08abcec0432836c905d4fb5c400cd67be7b73f90c03%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2828004197&rft_id=info:pmid/&rft_ieee_id=10144437&rfr_iscdi=true