• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2022, Vol. 44 ›› Issue (07): 1247-1255.

• Graphics and Images • Previous Articles     Next Articles

A space-aware adversarial neural network for 3D reconstruction of point cloud

LU Lin-peng1,GUAN Bo-liang1,LIN Shu-jin2   

  1. (1.School of Computer Science,Sun Yat-sen University,Guangzhou 510006;
    2.School of Communication and Design,Sun Yat-sen University,Guangzhou 510006,China)
  • Received:2021-11-24 Revised:2022-01-14 Accepted:2022-07-25 Online:2022-07-25 Published:2022-07-25

Abstract: In order to overcome the quality problem of reconstructed meshes caused by the restrictive factors such as sparse and uneven density or wrong normal vector of original point cloud data,  a three-dimensional reconstruction method of point cloud based on Countermeasure network is proposed by using the characteristics of weight sharing in adversarial neural network and adversarial training process.Firstly, the predictor is used to predict the offset of the edge of the mesh model, so as to obtain the displacement of each vertex, and perform the vertex redirection of the topology preservation to obtain a new mesh. Secondly, the point cloud classifier in the discriminator is used to extract the high-dimensional features of the original point cloud data and the sampled point set of the mesh surface, and the spatial perception discrimination based on the high-dimensional features is performed to distinguish the original point cloud from the samples point set data. Finally, the output data of the predictor and the discriminator are correlated by the adversarial training method, and the network model is optimized through multiple iterations to obtain a three-dimensional mesh model that meets the spatial characteristics of the point cloud. Experiments are carried out on different point cloud datasets, and the results are displayed by using MeshLab software. The results show that the method can reconstruct the 3D mesh model that meets the spatial information of point cloud, and overcome the mesh quality problems caused by poor point cloud data.


Key words: 3D reconstruction, deep learning, mesh deformation, adversarial network