Anti-jamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning Approach

This letter investigates the problem of anti-jamming communications in dynamic and unknown environment through on-line learning. Different from existing studies which need to know (estimate) the jamming patterns and parameters, we use the spectrum waterfall, i.e., the raw spectrum environment, direc...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2017-10
Main Authors: Liu, Xin, Xu, Yuhua, Jia, Luliang, Wu, Qihui, Anpalagan, Alagan
Format: Article
Language:English
Subjects:
Algorithms
Computer simulation
Jamming
Machine learning
Parameter estimation
Unknown environments
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This letter investigates the problem of anti-jamming communications in dynamic and unknown environment through on-line learning. Different from existing studies which need to know (estimate) the jamming patterns and parameters, we use the spectrum waterfall, i.e., the raw spectrum environment, directly. Firstly, to cope with the challenge of infinite state of raw spectrum information, a deep anti-jamming Q-network is constructed. Then, a deep anti-jamming reinforcement learning algorithm is proposed to obtain the optimal anti-jamming strategies. Finally, simulation results validate the the proposed approach. The proposed approach is relying only on the local observed information and does not need to estimate the jamming patterns and parameters, which implies that it can be widely used various anti-jamming scenarios.
ISSN:2331-8422