Hybrid Intrusion Detection using MapReduce based Black Widow Optimized Convolutional Long Short-Term Memory Neural Networks

• Published in: Expert systems with applications 2022-05, Vol.194, p.116545, Article 116545
• Main Authors: Kanna, P. Rajesh, Santhi, P.
• Format: Article
• Language: English
• Subjects: Algorithms; Black Widow Optimization; Classification; Communications traffic; Convolutional-Long Short-Term memory; CSE-CIC-IDS2018; Cybersecurity; Datasets; Deep Learning; Feature selection; Hyper-Parameter Optimization; Intrusion Detection Systems; ISCX-IDS; Machine learning; Neural networks; NSL-KDD; On-line systems; Performance evaluation; Swarm intelligence; UNSW-NB15
• ISSN: 0957-4174; 1873-6793
• DOI: 10.1016/j.eswa.2022.116545

•IDS using Deep Learning algorithms improve Feature learning and reduce complexity.•Built IDS using MapReduce based Black Widow Optimized Conv-LSTM Neural Network.•Artificial Bee Colony based Feature selection reduced dimensionality.•NSL-KDD, ISCX-IDS, UNSWNB15 and CSE-CIC-IDS2018 datasets are used for evaluation.•Hyper parameter tuning in BWO-CONVLSTM increased accuracy and reduced complexity. The recent advancements in information and communication technologies have led to an increasing number of online systems and services. These online systems can utilize Intrusion Detection Systems (IDS) to ensure their trustworthiness by preventing cyber security threats. Hence it has become necessary for any system to design advanced and intelligent IDS models. However, most existing IDS models are based on traditional machine learning algorithms with weak, shallow learning behaviours providing less efficient feature selection and classification performance of new attacks. Another problem is that these approaches are either Network-based or Host-based intrusion detection and it often leads to many known attacks being unrecognized by the detection module. Additionally, they lack flexible and scalable handling of the massive amounts of network traffic data due to high model complexity. To overcome these issues, an efficient hybrid IDS model is presented which is built using MapReduce based Black Widow Optimized Convolutional-Long Short-Term Memory (BWO-CONV-LSTM) network. The first stage of this IDS model is the feature selection by the Artificial Bee Colony (ABC) algorithm. The second stage is the hybrid deep learning classifier model of BWO-CONV-LSTM on a MapReduce framework for intrusion detection from the system traffic data. The proposed BWO-CONV-LSTM network is the combination of Convolutional and LSTM neural networks whose hyper-parameters are optimized by BWO to obtain the ideal architecture. Performance evaluations of the BWO-CONV-LSTM based IDS model are performed over the NSL-KDD, ISCX-IDS, UNSW-NB15, and CSE-CIC-IDS2018 datasets. The results indicate that the proposed BWO-CONV-LSTM model has high intrusion detection performance with 98.67%, 97.003%, 98.667% and 98.25% accuracy for NSL-KDD, ISCX-IDS, UNSW-NB15, and CSE-CIC-IDS2018 datasets respectively, with fewer false values, less computation time and better classification coefficients.