• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2024, Vol. 46 ›› Issue (10): 1757-1764.

• Computer Network and Znformation Security • Previous Articles     Next Articles

Resource allocation algorithm for distinguished services in vehicular networks based on multi-agent deep reinforcement learning

CAI Yu,GUAN Zheng,WANG Zeng-wen,WANG Xue,YANG Zhi-jun   

  1. (School of Information Science & Engineering,Yunnan University,Kunming 650500,China)
  • Received:2024-01-03 Revised:2024-03-06 Accepted:2024-10-25 Online:2024-10-25 Published:2024-10-29

Abstract: The Internet of vehicles (IoV) generates a massive amount of network connections and diversified data. To address the challenge that a single agent struggles to collect channel state information and perform service-differentiated resource allocation and link scheduling in dynamic scenarios, a multi-agent deep reinforcement learning-based service-differentiated resource allocation method for IoV is proposed. This method aims to maximize the successful delivery rate of V2V link data packets and the total capacity of V2I links, under the constraint of minimizing interference to emergency service links. It employs deep reinforcement learning algorithms to optimize spectrum allocation and power selection strategies in a single-antenna vehicle-mounted network where multiple cellular users and device-to-device users coexist. Each agent is trained using deep Q-network(DQN), and they interact with the communication environment collectively, achieving coordination through a global reward function. Simulation results show that, in high-load scenarios, compared to traditional random allocation schemes, this scheme increases the total throughput of V2I links by 3.76 Mbps, improves the packet delivery rate of V2V links by 17.1%, and reduces the interference to emergency service links by 1.42 dB compared to ordinary links. This achieves priority guarantee for emergency service links and effectively enhances the overall transmission capacity of V2I and V2V links.

Key words: internet of vehicles, spectrum allocation, reinforcement learning, multi-agent, emergency services