• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2021, Vol. 43 ›› Issue (08): 1488-1496.

Previous Articles     Next Articles

A tongue image classification method based on deep transfer learning

SONG Chao1,WANG Bin1,XU Jia-tuo2#br#

#br#
  

  1. (1.School of Information Engineering,Nanjing University of Finance and Economics,Nanjing 210023;

    2.Department of Basic Medicine,Shanghai University of Traditional Chinese Medicine,Shanghai 201203,China)

  • Received:2020-01-15 Revised:2020-07-23 Accepted:2021-08-25 Online:2021-08-25 Published:2021-08-24

Abstract: Tongue image analysis is an important topic in the objective and quantitative research and application of computer vision technology in the diagnosis and treatment of Traditional Chinese Medicine(TCM), and its two key steps are tongue segmentation and tongue image classification. Cascade classifier is used to automatically segment the tongue region on the original image, and then the segmented tongue image is deeply trained and learned on GoogLeNet and ResNet. The obtained depth network is used to classify toothmarks, cracks and thickness of tongue coating. 2245 tongue images obtained from specialized TCM medical institutions are used to build a dataset. In the experiments of classifying the three types of tongue images (toothmarks, cracks and thickness tongue coating), this method has better classification performance than the traditional tongue image feature classification methods. The effectiveness of the tongue feature classification method based on deep transfer learning is verified.


Key words: tongue feature classification, cascade classifier, transfer learning, residual network, GoogLeNet