On myopic sensing for multi-channel opportunistic access: structure, optimality, and performance

• Published in: IEEE transactions on wireless communications 2008-12, Vol.7 (12), p.5431-5440
• Main Authors: Qing Zhao, Krishnamachari, B., Keqin Liu
• Format: Article
• Language: English
• Subjects: Applied sciences; Channels; Cognitive radio; Communication systems; Design of experiments; Detection; Detection, estimation, filtering, equalization, prediction; Downlink; Exact sciences and technology; Fading; Information, signal and communications theory; Interference; Jamming; Laboratories; multi-arm restless bandit process; multi-channel MAC; myopic policy; Networks; Opportunistic access; Optimization; Performance analysis; Policies; Radio networks; Radiocommunication specific techniques; Radiocommunications; Robustness; Signal and communications theory; Signal, noise; Studies; Systems, networks and services of telecommunications; Telecommunications; Telecommunications and information theory; Teleprocessing networks. Isdn; Throughput; Transmission and modulation (techniques and equipments); Valuation and optimization of characteristics. Simulation; Wireless communication
• ISSN: 1536-1276; 1558-2248
• DOI: 10.1109/T-WC.2008.071349

We consider a multi-channel opportunistic communication system where the states of these channels evolve as independent and statistically identical Markov chains (the Gilbert- Elliot channel model). A user chooses one channel to sense and access in each slot and collects a reward determined by the state of the chosen channel. The problem is to design a sensing policy for channel selection to maximize the average reward, which can be formulated as a multi-arm restless bandit process. In this paper, we study the structure, optimality, and performance of the myopic sensing policy. We show that the myopic sensing policy has a simple robust structure that reduces channel selection to a round-robin procedure and obviates the need for knowing the channel transition probabilities. The optimality of this simple policy is established for the two-channel case and conjectured for the general case based on numerical results. The performance of the myopic sensing policy is analyzed, which, based on the optimality of myopic sensing, characterizes the maximum throughput of a multi-channel opportunistic communication system and its scaling behavior with respect to the number of channels. These results apply to cognitive radio networks, opportunistic transmission in fading environments, downlink scheduling in centralized networks, and resource-constrained jamming and anti-jamming.