• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

J4 ›› 2008, Vol. 30 ›› Issue (8): 65-68.

• 论文 • 上一篇    下一篇

一种基于哈希链表的高效概念漂移连续属性处理算法

王涛[1] 李舟军[2] 颜跃进[1]   

  • 出版日期:2008-08-01 发布日期:2010-05-19

  • Online:2008-08-01 Published:2010-05-19

摘要:

本文重点研究了数据流挖掘中存在概念漂移情形的连续属性处理算法。数据流是一种增量、在线、实时的数据模型。VFDT是数据流挖掘中数据呈稳态分布情形下最成功的算法之一;CVFDT是有效解决数据流挖掘中概念漂移问题的算法之一。基于CVFDT,本文提出了有效地解决数据流挖掘中存在概念漂移情形的连续属性处理问题的扩展哈希表算法HashCVFDT。该算法在属性值插入、查找和删除时具有哈希表的快速性,而在选取每个连续属性的最优化划分节点时解决了哈希表不能有序输出的缺点。

关键词: 数据流挖掘 CVFDT连续属性 概念漂移 扩展哈希表

Abstract:

This paper focuses on continuous-valued attribute handling for mining concept-drifting data streams. Data stream is an incremental,online and real-tim  e model. VFDT is one of the most successful algorithms in data stream mining when data take on a state of stable distribution;CVFDT is one of the effect  ive algorithms for resolving the problem of concept drifting in data stream mining. Based on CVFDT, the paper proposes an efficient continuous-valued at tribute handling method named Hash CVFDT for mining concept-drifting data streams based on the extended hash table. The algorithm is as fast as the hash  table in attribute inserting, seeking and deleting, and solves the flaws of the hash table which cannot output. Sequently when selecting the opthnally   partitioned nodes of each continuous-valued attribute.

Key words: data streaming, CVFDT, continuous-valued attribute, concept drifting, extended hash table