• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science

Previous Articles     Next Articles

Optimization of LightGBM hyper-parameters
based on message queuing

NAN Dong-liang1,2,WANG Wei-qing1,WANG Hai-yun1   

  1. (1.School of Electrical Engineering,Xinjiang University,Urumqi 830047;
    2.Electric Power Research Institute,State Grid Xinjiang Electric Power Corporation,Urumqi 830011,China)
     
  • Received:2018-07-06 Revised:2018-12-29 Online:2019-08-25 Published:2019-08-25

Abstract:

In order to improve the optimization efficiency of light gradient boosting machine (LightGBM) hyper-parameters, and obtain the global optimal model, we propose a parallel optimization method for LightGBM hyper-parameters based on message queuing mode. According to the pre-selection range of hyper-parameters, each set of hyper-parameters is sent to the queue in message mode. Every node trains the model with the message obtained from the queue in parallel mode and verifies the accuracy rate of the model. Finally, the model with the highest accuracy is selected to calculate the dataset to be predicted. Experimental results show that compared with the traditional grid search, Bayesian optimization, random search method and message queuing serial optimization, the proposed method has the highest speed and largest area under curve (AUC ) value.
 

Key words: message queuing, LightGBM, hyper-parameter