MSCAN: multi-scale self- and cross-attention network for RNA methylation site prediction

• Published in: BMC bioinformatics 2024-01, Vol.25 (1), p.32-32, Article 32
• Main Authors: Wang, Honglei, Huang, Tao, Wang, Dong, Zeng, Wenliang, Sun, Yanjing, Zhang, Lin
• Format: Article
• Language: English
• Subjects: Artificial neural networks; Cross-attention; Datasets; Deep learning; Experimental methods; Gene regulation; Genetic research; Genetic transcription; Long short-term memory; Machine learning; Methylation; Multi-scale; N6-methyladenosine; Natural language processing; Neural networks; Parallel processing; Post-transcription; Prediction models; Predictor; R&D; Regulatory mechanisms (biology); Research & development; Research methodology; RNA methylation; RNA modification; RNA processing; Self-attention; Support vector machines; Transcriptomes; Transformer; Transformers; Validation studies
• ISSN: 1471-2105; 1471-2105
• DOI: 10.1186/s12859-024-05649-1

Epi-transcriptome regulation through post-transcriptional RNA modifications is essential for all RNA types. Precise recognition of RNA modifications is critical for understanding their functions and regulatory mechanisms. However, wet experimental methods are often costly and time-consuming, limiting their wide range of applications. Therefore, recent research has focused on developing computational methods, particularly deep learning (DL). Bidirectional long short-term memory (BiLSTM), convolutional neural network (CNN), and the transformer have demonstrated achievements in modification site prediction. However, BiLSTM cannot achieve parallel computation, leading to a long training time, CNN cannot learn the dependencies of the long distance of the sequence, and the Transformer lacks information interaction with sequences at different scales. This insight underscores the necessity for continued research and development in natural language processing (NLP) and DL to devise an enhanced prediction framework that can effectively address the challenges presented. This study presents a multi-scale self- and cross-attention network (MSCAN) to identify the RNA methylation site using an NLP and DL way. Experiment results on twelve RNA modification sites (m A, m A, m C, m U, m Am, m G, Ψ, I, Am, Cm, Gm, and Um) reveal that the area under the receiver operating characteristic of MSCAN obtains respectively 98.34%, 85.41%, 97.29%, 96.74%, 99.04%, 79.94%, 76.22%, 65.69%, 92.92%, 92.03%, 95.77%, 89.66%, which is better than the state-of-the-art prediction model. This indicates that the model has strong generalization capabilities. Furthermore, MSCAN reveals a strong association among different types of RNA modifications from an experimental perspective. A user-friendly web server for predicting twelve widely occurring human RNA modification sites (m A, m A, m C, m U, m Am, m G, Ψ, I, Am, Cm, Gm, and Um) is available at http://47.242.23.141/MSCAN/index.php . A predictor framework has been developed through binary classification to predict RNA methylation sites.