3D perception from binocular vision for a low cost humanoid robot NAO

• Published in: Robotics and autonomous systems 2015-06, Vol.68, p.129-139
• Main Authors: Nefti-Meziani, Samia, Manzoor, Umar, Davis, Steve, Pupala, Suresh Kumar
• Format: Article
• Language: English
• Subjects: 3D reconstruction; Camera calibration; Low cost 3D perception; NAO robot; Stereo vision system
• ISSN: 0921-8890; 1872-793X
• DOI: 10.1016/j.robot.2014.12.016

Depth estimation is a classical problem in computer vision and after decades of research many methods have been developed for 3D perception like magnetic tracking, mechanical tracking, acoustic tracking, inertial tracking, optical tracking using markers and beacons. The vision system allows the 3D perception of the scene and the process involves: (1) camera calibration, (2) image correction, (3) feature extraction and stereo correspondence, (4) disparity estimation and reconstruction, and finally, (5) surface triangulation and texture mapping. The work presented in this paper is the implementation of a stereo vision system integrated in humanoid robot. The low cost of the vision system is one of the aims to avoid expensive investment in hardware when used in robotics for 3D perception. In our proposed solution, cameras are highly utilized as in our opinion they are easy to handle, cheap and very compatible when compared to the hardware used in other techniques. The software for the automated recognition of features and detection of the correspondence points has been programmed using the image processing library OpenCV (Open Source Computer Vision) and OpenGL (Open Graphic Library) is used to display the 3D models obtained from the reconstruction. Experimental results of the reconstruction and models of different scenes are shown. The results obtained from the program are evaluated comparing the size of the objects reconstructed with that calculated by the program. •Implementation of a stereo vision system integrated in humanoid robot is proposed.•Low cost robotics vision system for 3D perception avoids expensive hardware cost.•Cameras are highly utilized as they are easy to handle, cheap and very compatible.