Keyword extraction of Uyghur-Kazakh
texts based on stem units

Abstract

Abstract:

A keywords extraction method of Uyghur and Kazakh (Uyghur-Kazakh) texts based on stem units is proposed. Uyghur-Kazakh is a derivative language lacking resources. Morpheme structure analysis and stem extraction can effectively reduce the granularity capacity and improve the coverage of derivative languages. In this paper, Uyghur-Kazakh texts are downloaded from the Internet and segmented into morpheme sequences. word2vec is used to train stem vectors to represent text content in a distributed way. Then, TF-IDF (Term Frequency-Inverse Document Frequency) algorithm is used to weight the stem vectors. Keywords are extracted by using the keyword vector of training set and the stem vector similarity of testing set. The experimental results show that the proposed method based on morpheme segmentation and stem vector representation are the important steps and has more excellent performance in the extraction of keywords from derivative languages like Uygur-Kazakh.

Key words: Uyghur-Kazakh, stem vector, keyword extraction, morphology

SARDAR Parhat，MIJIT Ablimit,ASKAR Hamdulla.

Keyword extraction of Uyghur-Kazakh

texts based on stem units

[J]. Computer Engineering & Science.

References ［17］

［1］	Beliga S, Metrovic A, Martincicipsic S. An overview of graph-based keyword extraction methods and approaches［J］.Journal of Information and Organizational Sciences,2015,39(1):1-20.
［2］	Salton G, Buckley C. Term-weighting approaches in automatic text retrieval［J］.Information Processing & Management,1988,24(5):513-523.
［3］	Ruhul A,Madhusodan C.Algorithm for Bengali keyword extraction［C］∥Proc of International Conference on Bangla Speech and Language Processing(ICBSLP),2018:1-5.
［4］	He G,Wang J,Zhang Y,et al.Keyword extraction of web pages based on domain thesaurus ［C］∥Proc of IEEE International Conference on Cloud Computing & Intelligence Systems,2014:310-314.
［5］	Ablimit M,Kawahara T,Hamdulla A,et al.Stem-affix based Uyghur morphological analyzer［J］.International Journal of Future Generation Communication and Networking,2016,9(2):59-72.
［6］	Ablimit M,Parhat S,Hamdulla A,et al.Multilingual language processing tool for Uyghur,Kazak and Kirghiz［C］∥Proc of Asia-Pacific Signal and Information Processing Association Annual Summit and Conference(APSIPA ASC),2017:737-740.
［7］	Tuerxun P,Fang D, Hamdulla A.The KNN based Uyghur text classification and its performance analysis［J］.International Journal of Hybrid Information Technology,2015,8(3):63-72.
［8］	Gulinazi, Sun Tie-li,Huxidan, et al. Text categorization of Kazakh text based on improved KNN［J］.Journal of Northeastern Normal University
	(Natural Science Edition),2014,46(2):63-68.(in Chinese)
［9］	Romero M,Moreo A,Castro J L,et al.Using Wikipedia concepts and frequency in language to extract key terms from support documents［J］.Expert Systems with Applications,2012,39(18):13480-13491.
［10］	Wang Xiao-lin,Yang Lin,Wang Dong,et al.Improved TF-IDF keyword extraction algorithm［J］.Computer Science and Application,2013,3(1):64-68.(in Chinese)
［11］	López R E, Barreda D, Tejada J, et al. MFSRank:An unsupervised method to extract keyphrases using semantic information［C］∥
	Proc of the 10th Mexcian International Conference on Advances in Artificial Intelligence,2011:338-344.
［12］	Irfan R,Khan S,Qamar A M,et al.Refining Kea++ automatic keyphrase assignment［J］.Journal of Information Science,2014,40(4):446-459.
［13］	Zhang Kuo, Xu Hui, Tang Jie, et al.Keyword extraction using support vector machine［C］∥Proc of the 7th International Conference on Web-Age Information Management,2006:85-96.
［14］	Li Peng, Wang Bin, Shi Zhi-wei, et al.Tag-TextRank:A webpage keyword extraction method based on tags［J］.Journal of Computer Research and Development,2012,49(11):2344-2351.(in Chinese)
［15］	Su Xiang-kun.Study on extraction of Uygur keywords in public opinion analysis［D］.Urumqi:Xinjiang University,2015.(in Chinese)
［16］	Ghalip Abdukerim,Li Xiao.Uyghur keyword extraction and text classification based on TextRank algorithm and mutual information similarity ［J］.Computer Science,2016,43(12):43-47.(in Chinese)
［17］	Hu Bing-yao,Gulila Altenbek.Research on the Kazakh network hot keywords extraction method［J］.Computer Application and Software,2017,34(1):45-50.(in Chinese)
［18］	Bengio Y,Schwent H,Senécal J S,et al.Neural probabilistic language models［M］∥Innovations in Machine Learning.Berlin:Springer Berlin Heidelberg,2006:211-219.
［19］	Mnih A,Hinton G.Three new graphical models for statistical language modelling［C］∥Proc of the 24th International Conference on Machine Learning,2007:641-648.
［20］	Mikolov T,Sutskever T,Chen K, et al.Distributed representation of words and phrases and their compositionality［C］∥
	Proc of the 26th International Conference on Neural Information Processing Systems,2013:3111-3119.
［21］	Lai S W,Xu L H,Liu K,et al.Recurrent convolutional neural networks for text classification［C］∥Proc of the 29th AAAI Conference on Artificial Intelligence,2015:2267-2273.
［22］	Goldberg Y,Levy O. word2vec explained:Deriving Mikolov et al.’s negative-sampling word-embedding method［J］.arXiv:1402.3722,2014.
［23］	Chen Y Q,Nixon M S,Damper R I.Implementing the K-nearest neighbour rule via a neural network［C］∥Proc of IEEE International Conference on Neural Networks,1995:136-140.
	附中文参考文献：
［8］	古丽娜孜,孙铁利,胡西旦,等.一种基于改进KNN的哈萨克语文本分类［J］.东北师大学报(自然科学版),2014,46(2):63-68.
［10］	王小林,杨林,王东,等.改进的TF-IDF关键词提取方法［J］.计算机科学与应用,2013,3(1):64-68.
［14］	李鹏，王斌，石志伟，等.Tag-TextRank：一种基于Tag的网页关键词抽取方法［J］.计算机研究与发展，2012,49(11):2344-2351.
［15］	苏祥坤.舆情分析中维吾尔文关键词提取研究［D］.乌鲁木齐:新疆大学,2015.
［16］	阿力甫·阿不都克里木,李晓.基于TextRank算法和互信息相似度的维吾尔文关键词提取及文本分类［J］.计算机科学,2016,43(12):43-47.
［17］	胡冰瑶,古丽拉·阿东别克.哈萨克文网络热点关键词提取方法研究［J］.计算机应用与软件,2017,34(1):45-50.

[1]	CAI Heng1,2,3,CHU Heng1,2,4,SHAN De-ming1,2,3. ELM-based urban road extraction from remote sensing images [J]. Computer Engineering & Science, 2020, 42(01): 125-130.
[2]	NING Shan, YAN Xin, ZHOU Feng, WANG Hong-bin, ZHANG Jin-peng. A news keyword extraction method combining LSTM and LDA differences [J]. Computer Engineering & Science, 2020, 42(01): 153-160.
[3]	AN Jing,ZHANG Gui-cang,LIU Yan-ni. Adaptive color image enhancement based on multi-scale top-hat transform [J]. Computer Engineering & Science, 2017, 39(07): 1317-1321.
[4]	GAO Qingji,WEI Yuanyuan. Airline baggage classification based on the mean square error of the surface depth [J]. Computer Engineering & Science, 2017, 39(01): 125-130.
[5]	YAN Rong,GAO Guanglai. Chinese keywords identification based on strength entropy [J]. Computer Engineering & Science, 2016, 38(11): 2356-2361.
[6]	RUAN Zhiyi，SHEN Youjian，LIU Fengling. An application of mathematical morphology based fuzzy set theory in license plate characters recognition [J]. J4, 2016, 38(03): 562-568.
[7]	XIONG Chunrong1,2,HUANG Wenming2 . An Algorithm of License Plate Location Based on Extended Mathematical Morphology [J]. J4, 2010, 32(8): 87-89.
[8]	LIU Fayao，YIN Jianping，LI Kuan，LI Yong. Research on the Location of PDF417 Under the Complicated Background [J]. J4, 2010, 32(6): 55-57.
[9]	. [J]. J4, 2008, 30(9): 126-127.
[10]	. [J]. J4, 2008, 30(8): 39-41.
[11]	. [J]. J4, 2006, 28(6): 69-70.
[12]	. [J]. J4, 2005, 27(12): 90-91.
[13]	. [J]. J4, 2005, 27(11): 28-30.

Keyword extraction of Uyghur-Kazakh

texts based on stem units

PDF

Knowledge

Abstract

Cite this article

share this article

References ［17］

Related Articles 13

Recommended Articles

Metrics

Comments