TY - GEN
T1 - Optimal channel-sensing policy based on Fuzzy Q-Learning process over cognitive radio systems
AU - Panahi, Fereidoun H.
AU - Ohtsuki, Tomoaki
PY - 2013/1/1
Y1 - 2013/1/1
N2 - In a cognitive radio (CR) network, the channel sensing scheme to detect the appearance of a primary user (PU) directly affects the performances of both CR and PU. However, in practical systems, the CR is prone to sensing errors due to inefficient sensing scheme. This may lead to interfering with primary user and low system performance. In this paper, we present a learning based scheme for channel sensing in CR network. Specifically, we formulate the channel sensing problem as a partially observable Markov decision process (POMDP), where the most likely channel state is derived by a learning process called Fuzzy Q-Learning (FQL). The optimal policy is derived by solving the problem. The simulation results show the effectiveness and efficiency of our proposed scheme.
AB - In a cognitive radio (CR) network, the channel sensing scheme to detect the appearance of a primary user (PU) directly affects the performances of both CR and PU. However, in practical systems, the CR is prone to sensing errors due to inefficient sensing scheme. This may lead to interfering with primary user and low system performance. In this paper, we present a learning based scheme for channel sensing in CR network. Specifically, we formulate the channel sensing problem as a partially observable Markov decision process (POMDP), where the most likely channel state is derived by a learning process called Fuzzy Q-Learning (FQL). The optimal policy is derived by solving the problem. The simulation results show the effectiveness and efficiency of our proposed scheme.
KW - Cognitive Radio (CR)
KW - Fuzzy Q-Learning (FQL)
KW - Reinforcement learning (RL)
KW - channel sensing
KW - partially observable Markov decision process (POMDP)
UR - http://www.scopus.com/inward/record.url?scp=84891347909&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84891347909&partnerID=8YFLogxK
U2 - 10.1109/ICC.2013.6654941
DO - 10.1109/ICC.2013.6654941
M3 - Conference contribution
AN - SCOPUS:84891347909
SN - 9781467331227
T3 - IEEE International Conference on Communications
SP - 2677
EP - 2682
BT - 2013 IEEE International Conference on Communications, ICC 2013
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2013 IEEE International Conference on Communications, ICC 2013
Y2 - 9 June 2013 through 13 June 2013
ER -