Paper
3 January 2020 Multi-user dynamic spectrum access based on reinforcement learning
Jinming Xu, Zheng Dou, Lin Qi
Author Affiliations +
Proceedings Volume 11373, Eleventh International Conference on Graphics and Image Processing (ICGIP 2019); 113732Y (2020) https://doi.org/10.1117/12.2557620
Event: Eleventh International Conference on Graphics and Image Processing, 2019, Hangzhou, China
Abstract
The quantity of radio communication service is growing up with the development of wireless communication technology. While limited spectrum allocation, inefficient utilization of frequency band and plenty of unused spectrum have led to spectrum scarcity. To solve this issue, we study dynamic spectrum access technique to maximize the utilization of multi-channel wireless network. we assume that N users sharing K channels, and the users can choose any channel to transmit. each user selects a channel and transmits a packet with a certain attempt probability. After each time slot, every user receives a binary observation which indicates the result of their transmission. We aim to find an optimal strategy for spectrum access, which maximizes channel utilization in a partial observation scheme without message exchange or online coordination between users. Because of the larger scale of state space and incomplete partial observation, acquiring the optimal solution is computationally expensive in general. To solve this issue, we develop a partial observation dynamic spectrum access algorithm based on deep reinforcement leaning. We take experiments to show the strong performance of the algorithm which can increase the channel utilization to 90% in partial observation scheme.
© (2020) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Jinming Xu, Zheng Dou, and Lin Qi "Multi-user dynamic spectrum access based on reinforcement learning", Proc. SPIE 11373, Eleventh International Conference on Graphics and Image Processing (ICGIP 2019), 113732Y (3 January 2020); https://doi.org/10.1117/12.2557620
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Neural networks

Algorithm development

Wireless communications

Machine learning

Back to Top