Analysis of anomalous behaviour in network systems using deep reinforcement learning with convolutional neural network architecture

• Published in: CAAI Transactions on Intelligence Technology 2024-12, Vol.9 (6), p.1467-1484
• Main Authors: Modirrousta, Mohammad Hossein, Forghani Arani, Parisa, Kazemi, Reza, Aliyari‐Shoorehdeli, Mahdi
• Format: Article
• Language: English
• Subjects: deep reinforcement learning; intrusion detection; Q‐Learning; transferability
• ISSN: 2468-2322; 2468-2322
• DOI: 10.1049/cit2.12359

To gain access to networks, various intrusion attack types have been developed and enhanced. The increasing importance of computer networks in daily life is a result of our growing dependence on them. Given this, it is glaringly obvious that algorithmic tools with strong detection performance and dependability are required for a variety of attack types. The objective is to develop a system for intrusion detection based on deep reinforcement learning. On the basis of the Markov decision procedure, the developed system can construct patterns appropriate for classification purposes based on extensive amounts of informative records. Deep Q‐Learning (DQL), Soft DQL, Double DQL, and Soft double DQL are examined from two perspectives. An evaluation of the authors’ methods using UNSW‐NB15 data demonstrates their superiority regarding accuracy, precision, recall, and F1 score. The validity of the model trained on the UNSW‐NB15 dataset was also checked using the BoT‐IoT and ToN‐IoT datasets, yielding competitive results.