• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2025, Vol. 47 ›› Issue (10): 1867-1876.

• Artificial Intelligence and Data Mining • Previous Articles     Next Articles

An intelligent assembly method based on edge-cloud collaboration and augmented reality

CAO Pengxia,LI Wenxin,HUANG Yibo   

  1. (1.College of Physics and Electronic Engineering,Northwest Normal University,Lanzhou 730070;
    2.Lanzhou Institute of Physics,China Academy of Space Technology,Lanzhou 730000,China)
  • Received:2024-04-01 Revised:2024-06-25 Online:2025-10-25 Published:2025-10-29

Abstract: Traditional assembly methods have problems such as difficulty in ensuring efficiency and quality, and poor visualization capabilities, while augmented reality wearable devices also have shortcomings in terms of tracking and registration stability and computing power. To solve these problems, an intelligent assembly method based on edge-cloud collaboration and augmented reality is proposed. The cloud provides accurate pose information for the assembly process through the tracking and registration module, and manages information such as 3D models and assembly processes required for intelligent assembly. Since most targets in the assembly scenes lack textures and vary in size, the tracking and registration module uses the improved YOLOv5s for target detection to obtain the operation object, and then applies the 3D point cloud registration method to obtain the precise pose information of the operation object. The edge terminal, through binocular AR glasses, provides on-site operation environment data, receives the pose information provided by the cloud, and combines the speech recognition module and the augmented reality visualization module to realize the guidance of the assembly process. Experimental verification shows that the method proposed in this paper can effectively solve the problems of accuracy, speed and robustness faced by the augmented reality intelligent assembly system, and realize the intelligent assembly guidance of “what you see is what you operate”.

Key words: augmented reality, intelligent assembly, tracking registration, edge-cloud collaboration