Deep Learning-Based Signal Detection for Rate-Splitting Multiple Access Under Generalized Gaussian Noise

• Published in: IEEE open journal of vehicular technology 2023, Vol.4, p.257-270
• Main Authors: Kowshik, Anagha K., Raghavendra, Ashwini H., Gurugopinath, Sanjeev, Muhaidat, Sami
• Format: Article
• Language: English
• Subjects: Deep learning (DL); Detectors; Downlink; generalized Gaussian noise (GGN); long short-term memory (LSTM); Maximum likelihood decoding; NOMA; non-orthogonal multiple access (NOMA); OFDM; rate-splitting multiple access (RSMA); Receivers; Signal detection
• ISSN: 2644-1330; 2644-1330
• DOI: 10.1109/OJVT.2023.3238034

In this paper, we propose a long short-term memory-based deep learning (DL) architecture for signal detection in uplink and downlink rate-splitting multiple access systems with multi-carrier modulation, over Nakagami-m fading and generalized Gaussian noise (GGN). The proposed DL detector completely eliminates the need for the use of successive interference cancellation (SIC), which suffers from disadvantages such as error propagation. In an orthogonal frequency division multiplexing setting, we show that the proposed DL detector outperforms the standard SIC receivers such as the least squares detector and the minimum mean-squared error receiver, and attains the performance of the optimal maximum likelihood detector, in terms of the symbol error rate (SER). Furthermore, we study the effects of the shaping parameter of GGN, hyperparameters of the DL network such as batch size and learning rate on the SER performance.