• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science

Previous Articles     Next Articles

A satellite network resource scheduling
mechanism based on reinforcement learning
 

ZHOU Bi-ying1,WANG Ai-ping1,FEI Chang-jiang2,YU Wan-rong2,ZHAO Bao-kang2   

  1. (1.School of Computer Science and Technology,Anhui University,Hefei 230601;
    2.School of Computer,National University of Defense Technology,Changsha 410073,China)
     
  • Received:2019-06-15 Revised:2019-09-17 Online:2019-12-25 Published:2019-12-25

Abstract:

Compared with the traditional geostationary earth orbit (GEO) satellite, the new generation of medium-low-orbit satellite Internet constellation represented by SpaceX, Starlink and O3b has significant advantages such as wide-area coverage, full-time interconnection and multi-star coordination, and has become one of the research focuses in the world today. The traditional satellite resource scheduling method mainly studies the resource scheduling problems with single GEO satellite, which is difficult to meet the resource scheduling requirements of the low-orbit satellite constellation characterized by multi-satellite coordination, joint networking, and mass users. Consequently, an intelligent multi-star collaborative resource scheduling model based on user satisfaction is constructed, and a satellite network resource scheduling mechanism named IRSUP based on reinforcement learning is proposed. IRSUP designs an intelligent user service preference optimization module for the personalized needs of user service customization and an intelligent scheduling module based on reinforcement learning for the problems with joint optimization of multi-star resources. The simulation results show that IRSUP can effectively improve the rationality of resource scheduling, link resource utilization and user satisfaction, among which the business capacity is increased by 30%~60%, and user satisfaction is increased by more than twice.
 

Key words: satellite network, resource scheduling, reinforcement learning, user preference