• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

J4 ›› 2010, Vol. 32 ›› Issue (6): 158-161.doi: 10.3969/j.issn.1007130X.2010.

• 论文 • 上一篇    下一篇

局部切空间对齐算法的核主成分分析解释

詹宇斌,殷建平,刘新旺   

  1. (国防科学技术大学计算机学院, 湖南 长沙 410073)
  • 收稿日期:2009-09-11 修回日期:2009-12-15 出版日期:2010-06-01 发布日期:2010-06-01
  • 通讯作者: 詹宇斌 E-mail:yubinzhan@nudt.edu.cn
  • 作者简介:詹宇斌(1980),男,湖北应城人,博士生,研究方向为机器学习和流形学习;殷建平,教授,博士生导师,研究方向为人工智能与模式识别、信息安全、网络算法。
  • 基金资助:

    国家自然科学基金资助项目(60970034)

A Kernel PCA View of the Local Tangent Space Alignment Algorithm

ZHAN Yubin,YIN Jianping,LIU Xinwang   

  1. (School of Computer Science,National University of Defense Technology,Changsha 410073,China)
  • Received:2009-09-11 Revised:2009-12-15 Online:2010-06-01 Published:2010-06-01

摘要:

基于核方法的降维技术和流形学习是两类有效而广泛应用的非线性降维技术,它们有着各自不同的出发点和理论基础,在以往的研究中很少有研究关注两者的联系。LTSA算法利用数据的局部结构构造一种特殊的核矩阵,然后利用该核矩阵进行核主成分分析。本文针对局部切空间对齐这种流形学习算法,重点研究了LTSA算法与核PCA的内在联系。研究表明,LTSA在本质上是一种基于核方法的主成分分析技术。

关键词: 降维, 流形学习, 核方法, 核主成分分析, 局部切空间对齐

Abstract:

Recently, nonlinear dimensionality reduction has attracted extensive interests of researchers in the machine learning community. The techniques for nonlinear dimensionality reduction can be divided into two categories: kernelbased methods and manifold learning. These two methods have different motivations and derivations. This paper interprets the wellknown manifold learning algorithm LTSA as a kernel method. We show that LTSA can be described as the kernel PCA, and LTSA utilizes the local neighborhood information to construct a special kernel matrix, and the global embedding obtained by LTSA with modified constraints is equivalent to principal coordinates by the kernel PCA with this special kernel.

Key words: dimensionality reduction;manifold learning;kernel method;kernel principal component analysis;local tangent space alignment

中图分类号: