• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

计算机工程与科学 ›› 2024, Vol. 46 ›› Issue (05): 846-851.

• 图形与图像 • 上一篇    下一篇

ELPVO:基于I/O流水优化的超低功耗视觉里程计

赵千贺1,王锐1,2   

  1. (1.北京航空航天大学计算机学院,北京 100191;2.上海人工智能实验室,上海  200232)
  • 收稿日期:2023-10-23 修回日期:2023-12-15 接受日期:2024-05-25 出版日期:2024-05-25 发布日期:2024-05-30
  • 基金资助:
    科技创新2030-“新一代人工智能”重大项目(2022ZD0161902)

ELPVO: A ultra-low power visual odometry based on I/O optimization

ZHAO Qian-he1,WANG Rui1,2   

  1. (1.School of Computer Science and Engineering,Beihang University,Beijing 100191;
    2.Shanghai Artificial Intelligence Laboratory,Shanghai 200232,China)
  • Received:2023-10-23 Revised:2023-12-15 Accepted:2024-05-25 Online:2024-05-25 Published:2024-05-30

摘要: 视觉里程计赋予了机器人自主定位与构建环境地图的能力,被广泛应用在各类无人设备上。视觉里程计涉及大量的图像处理计算,但其部署平台多数仅具备极为有限的计算资源,限制了其使用范围。针对现有低功耗视觉里程计存在的I/O瓶颈,提出一种面向STM32F7嵌入式平台的基于RGB-D相机的高速低功耗视觉里程计ELPVO。ELPVO充分考虑STM32F7平台的硬件资源,通过DMA传输提高处理器使用效率,进而在算法精度没有变化的情况下提升处理速度。在搭载216 MHz ARM Cortex-M7处理器的STM32F767嵌入式平台上,以TUM RGB-D数据集作为测试基准,ELPVO对320×240分辨率的图像处理速度可以达到26 fps,整体运行速度提升了84%,运行功耗维持在0.7 W。

关键词: 视觉里程计, 低功耗, RGB-D相机

Abstract: Visual odometry endows robots with the ability of autonomous positioning and building environmental maps, and is widely used in various unmanned devices. Visual odometry involves a large amount of image processing and calculation, but most of its deployment platforms only have extremely limited computational resources, limiting its application scope. In response to the I/O bottleneck of existing low-power visual odometry, this paper proposes a high-speed low-power visual odometry, named ELPVO, based on RGB-D cameras for the STM32F7 embedded platform. ELPVO fully considers the hardware resources of the STM32F7 platform, improves the processor utilization efficiency through DMA transmission, and further enhances the processing speed without changing the algorithm accuracy. On the STM32F767 embedded platform equipped with a 216 MHz ARM Cortex-M7 processor, with the TUM RGB-D dataset as the testing benchmark, ELPVO can achieve a processing speed of 26 frames per second for images with a resolution of 320×240, with an overall run speed improved by 84% and a run power consumption maintained at 0.7 watts.

Key words: visual odometry, low power consumption, RGB-D camera