关键词: 增强现实, 智能装配, 跟踪注册, 边云协同

Abstract: Traditional assembly methods have problems such as difficulty in ensuring efficiency and quality, and poor visualization capabilities, while augmented reality wearable devices also have shortcomings in terms of tracking and registration stability and computing power. To solve these problems, an intelligent assembly method based on edge-cloud collaboration and augmented reality is proposed. The cloud provides accurate pose information for the assembly process through the tracking and registration module, and manages information such as 3D models and assembly processes required for intelligent assembly. Since most targets in the assembly scenes lack textures and vary in size, the tracking and registration module uses the improved YOLOv5s for target detection to obtain the operation object, and then applies the 3D point cloud registration method to obtain the precise pose information of the operation object. The edge terminal, through binocular AR glasses, provides on-site operation environment data, receives the pose information provided by the cloud, and combines the speech recognition module and the augmented reality visualization module to realize the guidance of the assembly process. Experimental verification shows that the method proposed in this paper can effectively solve the problems of accuracy, speed and robustness faced by the augmented reality intelligent assembly system, and realize the intelligent assembly guidance of “what you see is what you operate”.

Key words: augmented reality, intelligent assembly, tracking registration, edge-cloud collaboration