• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

J4 ›› 2010, Vol. 32 ›› Issue (12): 39-41.doi: 10.3969/j.issn.1007130X.2010.

• 论文 • 上一篇    下一篇

基于流形特征的视频情感分析与识别

李青1,蒋冬梅1,FAN Ping2,Ravyse Ilse2,Sahli Hichem2   

  1. (1.西北工业大学计算机学院,陕西 西安 710129;2.比利时布鲁塞尔自由大学电子与信息工程系,布鲁塞尔 1050)
  • 收稿日期:2010-01-18 修回日期:2010-04-25 出版日期:2010-12-25 发布日期:2010-12-25
  • 通讯作者: 李青
  • 作者简介:李青(1986),女,江西赣州人,硕士生,研究方向为数字语音处理;蒋冬梅,博士,副教授 ,研究方向为音频信号处理、听视觉融合语音处理和说话人头部动画;Fan Ping,博士;Ravyse Ilse,博士后;Sahli Hichem,教授,研究方向为视觉图像处理。
  • 基金资助:

    国家自然科学基金资助项目(60703104);陕西省自然科学基金资助项目(SJ08F28)

Visual Emotion Analysis and Recognition Based on Manifold Features

LI Qing1,JIANG Dongmei1,FAN Ping2,Ravyse Ilse2,Sahli Hichem2   

  1. (1.School of Computer Science,Northwestern Polytechnical University,Xi’an 710129;
    2.ETRO Department,Vrije Universiteit Brussel,Pleinlaan 2,1050 Brussels,Belgium)
  • Received:2010-01-18 Revised:2010-04-25 Online:2010-12-25 Published:2010-12-25

摘要:

本文研究了基于Isomap的非线性降维方法,对由面部表情序列提取的面部动画参数特征进行降维,
分析了降维后的流形特征空间与认知心理学情感空间之间的关系。实验结果表明,Isomap降维后的情感流
形特征能够表现情感的强度变化,而且比PCA降维特征对情感强度的描述更加合理和平滑;情感识别实验
也表明,使用Isomap降维流形特征的识别率要高于原始情感特征和PCA降维特征,而且对各种情感的识别
结果更加均衡。

关键词: Isomap, 流形, 情感空间, 非线性特征降维, 情感强度

Abstract:

This paper studies the Isomapbased nonlinear dimensionality reduction and
visualization method,applies it to the feature reduction of facial animation parameters of
emotional facial image sequences,and analyzes the relationship between the reduced
dimension space and the cognitive psychological emotion space.The experimental results show
that the coordinate of the manifold feature in the reduceddimension space shows the
emotion intensity of the corresponding image frame,and the intensity curve of an emotional
facial sequence from Isomap is more reasonable and smooth than that from PCA. The visual
emotion recognition results also show that the mainfold features from Isomap have better
performance than the original features and the manifold features from PCA.Moreover,the
recognition rates are more balanced between different emotions.

Key words: Isomap;manifold;emotional space;nonlinear feature reduction;emotional intensity