关键词: ID3 决策树 信息增益 多值偏向 修正增益

Abstract:

The ID3 algorithm is a decision tree algorithm,which is important in the field of machine learning. The concept of information gain is proposed by Qui nlan in the ID3 algorithm. Information gain is the selection criteria of the best splitting attribute for inducing decision trees. This algorithm has so   me drawbacks, one of which is that it tends to choose multi-value attribute as the best splitting attribute. However, the multi-value attribute is not n ecessarily important for classification in the real world. This paper presents a revised information gain of the ID3 algorithm in an attempt to solve th  is problem. From the theoretical analysis and experimental results we can see that the new method has a good effect on multivalue orientation of the ID3  algorithm.

Key words: ID3, decision tree, information gain, multi-value orientation, revised information gain