关键词: 文本分类 n元语法模型 语种

Abstract:

The paper proposes an approach to language independent text classification without word segmentation. Unlike the case of traditional text classificati on models, the approach based on the character-level n-gram language modeling avoids word segmentation, explicit feature selection and extensive pre-pro  cessing. We systematically study the key factors in language modeling and their influence on classification, and describe an evaluation method in detail . Experimental results show that the proposed method can achieve good performance in text classification tasks.

Key words: text classification, n-gram model, language