DM-SLAM: A Feature-Based SLAM System for Rigid Dynamic Scenes

• Published in: ISPRS international journal of geo-information 2020-03, Vol.9 (4), p.202
• Main Authors: Cheng, Junhao, Wang, Zhi, Zhou, Hongyan, Li, Li, Yao, Jian
• Format: Article
• Language: English
• Subjects: deep learning; dynamic scenes; Mask R-CNN; optical flow; ORB-SLAM2; visual SLAM
• ISSN: 2220-9964; 2220-9964
• DOI: 10.3390/ijgi9040202

Most Simultaneous Localization and Mapping (SLAM) methods assume that environments are static. Such a strong assumption limits the application of most visual SLAM systems. The dynamic objects will cause many wrong data associations during the SLAM process. To address this problem, a novel visual SLAM method that follows the pipeline of feature-based methods called DM-SLAM is proposed in this paper. DM-SLAM combines an instance segmentation network with optical flow information to improve the location accuracy in dynamic environments, which supports monocular, stereo, and RGB-D sensors. It consists of four modules: semantic segmentation, ego-motion estimation, dynamic point detection and a feature-based SLAM framework. The semantic segmentation module obtains pixel-wise segmentation results of potentially dynamic objects, and the ego-motion estimation module calculates the initial pose. In the third module, two different strategies are presented to detect dynamic feature points for RGB-D/stereo and monocular cases. In the first case, the feature points with depth information are reprojected to the current frame. The reprojection offset vectors are used to distinguish the dynamic points. In the other case, we utilize the epipolar constraint to accomplish this task. Furthermore, the static feature points left are fed into the fourth module. The experimental results on the public TUM and KITTI datasets demonstrate that DM-SLAM outperforms the standard visual SLAM baselines in terms of accuracy in highly dynamic environments.