• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

J4 ›› 2014, Vol. 36 ›› Issue (09): 1788-1794.

• 论文 • 上一篇    下一篇

基于人体骨骼和深度图像信息的指尖检测方法

宋海声,刘平和,王全州,赵学深,王海燕   

  1. (西北师范大学物理与电子工程学院,甘肃 兰州 730070)
  • 收稿日期:2013-01-31 修回日期:2013-05-29 出版日期:2014-09-25 发布日期:2014-09-25
  • 基金资助:

    甘肃省自然基金资助项目(1208RJZA191)

A fingertip detection method based on
human skeleton and depth image information        

SONG Haisheng,LIU Pinghe,WANG Quanzhou,ZHAO Xueshen,WANG Haiyan      

  1. (College of Physics and Electronic Engineering,Northwest Normal University,Lanzhou 730070,China)
  • Received:2013-01-31 Revised:2013-05-29 Online:2014-09-25 Published:2014-09-25

摘要:

针对复杂环境下的指尖检测,从手部图像分割和指尖检测方法两方面进行改进,提出了一种基于人体骨骼和深度图像信息的指尖检测方法。首先采用Kinect获取人体骨骼和深度图像信息,通过人体骨骼信息锁定目标用户,利用锁定用户的手部节点位置从深度图像中提取手部区域图像;然后从手部骨架中搜索骨架端点,提出局部最优查找方法对轮廓凸包计算结果进行优化;最后结合手部轮廓特征找到指尖位置。实验结果表明,该方法具有良好的检测效果,满足实时性要求,能够实现复杂环境下的鲁棒检测。

关键词: 手部分割, 指尖检测, 人体骨骼, 深度图像, 复杂背景

Abstract:

Aiming at fingertip detection in a complex environment, from the two aspects of hand image segmentation and fingertip detection, a fingertip detection method based on human skeleton and depth image information is proposed. Firstly, Kinect is used to obtain the human skeleton and depth image information, the objective user is locked by the human skeleton information, and then the hand joint position of the locked user is used to extract the hand area image from the depth image. Secondly, the skeleton endpoints are searched from the hand skeleton, and the local optimal search method is proposed to optimize the results of contour convex hull computation. Finally, the fingertip position is found by combining the feature of hand contour. The experimental results show that the proposed method has good detection effect, meets the realtime requirements and can realize robust detection in a complex environment.

Key words: hand segmentation;fingertip detection;human skeleton;depth image;complex background