• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2024, Vol. 46 ›› Issue (11): 2017-2026.

• Graphics and Images • Previous Articles     Next Articles

A RGB-D visual SLAM system based on lightweight object detection network

DAI Kang-jia1,XU Hui-ying1,ZHU Xin-zhong1,HUANG Xiao2,LI Chen1,LIU Wei1,CAO Yu-qi1,WANG Ba-long1,LIU Zi-yang1,CHEN Guo-qiang3   

  1. (1.School of Computer Science and Technology(School of Artificial Intelligence),Zhejiang Normal University,Jinhua 321004;
    2.College of Education(College of Teacher Education),Zhejiang Normal University,Jinhua 321004;
    3.Zhejiang Rainbow Aerospace Measurement & Control Technology Co., Ltd., Hangzhou 311200,China)
  • Received:2023-07-12 Revised:2024-01-22 Accepted:2024-11-25 Online:2024-11-25 Published:2024-11-27

Abstract: RGB-D SLAM is a technology that utilizes depth cameras to achieve simultaneous localization and mapping (SLAM). Traditional visual SLAM systems are based on the assumption of a static environment, yet dynamic objects often exist in real-world scenarios, potentially leading to significant deviations in the pose estimation of SLAM systems. To address this issue, this paper proposes a SLAM system based on lightweight YOLOv8s object detection. This system employs Socket communication to transmit object detection results to the SLAM system, which then utilizes the Depth Value-RANSAC geometric algorithm to eliminate dynamic feature points within the detected bounding boxes, thereby enhancing the positioning accuracy of the SLAM system in dynamic environments. The experiments were conducted using the TUM dataset for validation, and the results indicate that the systems accuracy is significantly improved compared to ORB-SLAM2. Compared to other SLAM systems, varying degrees of improvement in accuracy and real-time performance were observed.

Key words: RGB-D SLAM, dynamic scene, object detection, geometric constraint