Toward Efficient Visual Gyroscopes: Spherical Moments, Harmonics Filtering, and Masking Techniques for Spherical Camera Applications

Unlike a traditional gyroscope, a visual gyroscope estimates camera rotation through images. The integration of omnidirectional cameras, offering a larger field of view compared to traditional RGB cameras, has proven to yield more accurate and robust results. However, challenges arise in situations...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2024-09
Main Authors: Du, Yao, Mateo, Carlos M, Maras, Mirjana, Wang, Tsun-Hsuan, Blanchon, Marc, Amini, Alexander, Rus, Daniela, Tahri, Omar
Format: Article
Language:English
Subjects:
Cameras
Exact solutions
Field of view
Gyroscopes
Machine learning
Masks
Multilayer perceptrons
Neural networks
Rotating spheres
Rotation
Spherical harmonics
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Unlike a traditional gyroscope, a visual gyroscope estimates camera rotation through images. The integration of omnidirectional cameras, offering a larger field of view compared to traditional RGB cameras, has proven to yield more accurate and robust results. However, challenges arise in situations that lack features, have substantial noise causing significant errors, and where certain features in the images lack sufficient strength, leading to less precise prediction results. Here, we address these challenges by introducing a novel visual gyroscope, which combines an Efficient Multi-Mask-Filter Rotation Estimator(EMMFRE) and a Learning based optimization(LbTO) to provide a more efficient and accurate rotation estimation from spherical images. Experimental results demonstrate superior performance of the proposed approach in terms of accuracy. The paper emphasizes the advantages of integrating machine learning to optimize analytical solutions, discusses limitations, and suggests directions for future research.
ISSN:2331-8422