%0 Journal Article
%T Distributed Competitive Decision Making Using Multi-Armed Bandit Algorithms
%+ Equipe Security, Intelligence and Integrity of Information (Lab-STICC_SI3)
%+ École Nationale Supérieure de Techniques Avancées Bretagne (ENSTA Bretagne)
%+ Institut d'Électronique et des Technologies du numéRique (IETR)
%+ Université Libanaise
%+ Equipe DECIDE (Lab-STICC_DECIDE)
%A Almasri, Mahmoud
%A Mansour, Ali
%A Moy, Christophe
%A Assoum, Ammar
%A Le Jeune, Denis
%A Osswald, Christophe
%< avec comité de lecture
%@ 0929-6212
%J Wireless Personal Communications
%I Springer Verlag
%V 118
%N 2
%P 1165-1188
%8 2021-05
%D 2021
%R 10.1007/s11277-020-08064-w
%K Cognitive radio
%K Multi-armed bandit
%K Opportunistic spectrum access
%K Priority access
%K Single or multi-users
%Z Engineering Sciences [physics]/Signal and Image processingJournal articles
%X This paper tackles the problem of Opportunistic Spectrum Access (OSA) in the Cognitive Radio (CR). The main challenge of a Secondary User (SU) in OSA is to learn the availability of existing channels in order to select and access the one with the highest vacancy probability. To reach this goal, we propose a novel Multi-Armed Bandit (MAB) algorithm called ϵ-UCB in order to enhance the spectrum learning of a SU and decrease the regret, i.e. the loss of reward by the selection of worst channels. We corroborate with simulations that the regret of the proposed algorithm has a logarithmic behavior. The last statement means that within a finite number of time slots, the SU can estimate the vacancy probability of targeted channels in order to select the best one for transmitting. Hereinafter, we extend ϵ-UCB to consider multiple priority users, where a SU can selfishly estimate and access the channels according to his prior rank. The simulation results show the superiority of the proposed algorithms for a single or multi-user cases compared to the existing MAB algorithms.
%G English
%2 https://hal-ensta-bretagne.archives-ouvertes.fr/hal-03151936/document
%2 https://hal-ensta-bretagne.archives-ouvertes.fr/hal-03151936/file/PersWireless.pdf
%L hal-03151936
%U https://hal-ensta-bretagne.archives-ouvertes.fr/hal-03151936
%~ UNIV-BREST
%~ UNIV-NANTES
%~ INSTITUT-TELECOM
%~ ENSTA-BRETAGNE
%~ UNIV-RENNES1
%~ CNRS
%~ UNIV-UBS
%~ INSA-RENNES
%~ IETR
%~ SUP_IETR
%~ ENSTA-BRETAGNE-STIC
%~ IETR_SCEE
%~ ENIB
%~ LAB-STICC
%~ CENTRALESUPELEC
%~ UR1-HAL
%~ UR1-MATH-STIC
%~ UR1-UFR-ISTIC
%~ TEST-UR-CSS
%~ UNIV-RENNES
%~ INSA-GROUPE
%~ INSTITUTS-TELECOM
%~ TEST-HALCNRS
%~ UR1-MATH-NUM
%~ LAB-STICC_DECIDE
%~ LAB-STICC_SI3
%~ LAB-STICC_DMID
%~ LAB-STICC_T2I3
%~ HUB-IA
%~ IETR-ASIC
%~ NANTES-UNIVERSITE
%~ UNIV-NANTES-AV2022