• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

J4 ›› 2012, Vol. 34 ›› Issue (4): 94-101.

• 论文 • 上一篇    下一篇

信息系统中的熵理论和信息粒度

滕书华,鲁敏,张军,谭志国,庄钊文   

  1. (国防科学技术大学电子科学与工程学院,湖南 长沙 410073)
  • 收稿日期:2011-11-05 修回日期:2012-02-10 出版日期:2012-04-26 发布日期:2012-04-25
  • 基金资助:

    中国博士后科学基金资助项目(20110481511);国家自然科学基金资助项目(60972114)

Entropy Theory and Information Granularity in Information Systems

TENG Shuhua,LU Min,ZHANG Jun,TAN Zhiguo,ZHUANG Zhaowen   

  1. (School of Electronics Science and  Engineering,National University of Defense Technology,Changsha 410073,China)
  • Received:2011-11-05 Revised:2012-02-10 Online:2012-04-26 Published:2012-04-25

摘要:

不确定性是人工智能中的研究热点,而熵理论和信息粒度是度量信息系统不确定性的两种主要方法。本文在给出信息系统中熵的物理意义基础上,提出了信息系统中熵增加原理,给出了熵和信息粒度的公理化定义,据此构造了两种新的不确定性度量函数—α熵和α粒度,它们是已有熵和粒度度量的进一步推广。研究表明,α熵以及现有的熵度量都是广义熵的特殊形式,而α粒度以及现有的粒度度量都是广义粒度的特殊形式,从而统一、规范和发展了完备与不完备信息系统中的不确定性度量方法。

关键词: 信息系统, 熵, 信息粒度, 粗糙集, 不确定性

Abstract:

One of the most important issues in artificial intelligence is uncertainty. Many uncertainty measuring methods have been put forward and widely used in information systems, such as entropy theory and information granularity, which are two main approaches to study the uncertainty of an information system. In this paper, the physical meaning of entropy and the entropy increase principle in information systems are presented firstly, then the axiom definitions of entropy and information granularity are provided and two new uncertainty measureing functions αentropy and αgranularity using this method are developed. Analysis shows that some of the existing definitions of entropy and information granularity become the special forms of axiom definitions. The results unify, standardize and develop the theory of uncertainty measureing in complete and incomplete information systems.

Key words: information system;entropy;information granularity;rough sets;uncertainty