Abstract:

Aiming at fingertip detection in a complex environment, from the two aspects of hand image segmentation and fingertip detection, a fingertip detection method based on human skeleton and depth image information is proposed. Firstly, Kinect is used to obtain the human skeleton and depth image information, the objective user is locked by the human skeleton information, and then the hand joint position of the locked user is used to extract the hand area image from the depth image. Secondly, the skeleton endpoints are searched from the hand skeleton, and the local optimal search method is proposed to optimize the results of contour convex hull computation. Finally, the fingertip position is found by combining the feature of hand contour. The experimental results show that the proposed method has good detection effect, meets the realtime requirements and can realize robust detection in a complex environment.

Key words: hand segmentation;fingertip detection;human skeleton;depth image;complex background