From Sequence to Decision: Large Language Models as End-to-End Engines for Therapeutic RNA Design
DOI:
https://doi.org/10.29169/1927-5951.2026.16.03Keywords:
RNA therapeutics, large language models, RNA foundation models, mRNA design, RNA aptamersAbstract
RNA-based therapeutics have achieved remarkable clinical validation, yet rational sequence design remains a fundamental bottleneck. Large language models (LLMs) trained on tens of millions of RNA sequences are beginning to reframe this challenge, offering a unified computational framework spanning structure prediction, immunogenicity optimization, and de novo sequence generation. Here, we survey the expanding landscape of RNA-focused foundation models — from early BERT-based encoders such as RNA-FM and ERNIE-RNA to large generative systems including GRAPE-LM — and map their end-to-end utility across six therapeutic modalities: messenger RNA, siRNA, antisense oligonucleotides, aptamers, circular RNA, and CRISPR guide RNAs. We identify three critical translation barriers: the RNA structural data famine, the absence of chemical-modification-aware architectures, and the lack of in vivo benchmarking datasets. We propose a roadmap — anchored by community data-generation initiatives and pre-competitive regulatory standards — for translating LLM-driven RNA design into clinical practice.
References
[1] Adams D, et al. Patisiran, an RNAi therapeutic, for hereditary transthyretin amyloidosis. N Engl J Med 2018; 379: 11-21.
[2] Pardi N, Hogan MJ, Porter FW, Weissman D. mRNA vaccines - a new era in vaccinology. Nat Rev Drug Discov 2018; 17: 261-279.
[3] Ray KK, et al. Two phase 3 trials of inclisiran in patients with elevated LDL cholesterol. N Engl J Med 2020; 382: 1507-1519.
[4] Wesselhoeft RA, Kowalski PS, Anderson DG. Engineering circular RNA for potent and stable translation in eukaryotic cells. Nat Commun 2018; 9: 2629.
[5] Schneider B, et al. When will RNA get its AlphaFold moment? Nucleic Acids Res 2023; 51: 9522-9532.
[6] Mauger DM, et al. mRNA structure regulates protein expression through changes in functional half-life. Proc Natl Acad Sci USA 2019; 116: 24075-24083.
[7] Childs-Disney JL, et al. Targeting RNA structures with small molecules. Nat Rev Drug Discov 2022; 21: 736-762.
[8] Vaswani A, et al. Attention is all you need. Adv Neural Inf Process Syst 2017; 30: 5999-6009.
[9] Lin Z, et al. Evolutionary-scale prediction of atomic-level protein structure with a language model. Science 2023; 379: 1123-1130.
[10] Chen J, et al. Interpretable RNA foundation model from unannotated data for highly accurate RNA structure and function predictions. Nat Methods 2024.
[11] Yin W, et al. ERNIE-RNA: an RNA language model with structure-enhanced representations. Nat Commun 2025; 16: 10076.
[12] Penić RJ, et al. RiNALMo: general-purpose RNA language models can generalize well on structure prediction tasks. Nat Commun 2025; 16: 5671.
[13] Wang N, et al. AIDO.RNA: a large-scale foundation model for RNA function and structure prediction. bioRxiv [Preprint] 2024.
[14] Chu Y, et al. A 5' UTR language model for decoding untranslated regions of mRNA and function predictions. Nat Mach Intell 2024; 6: 449-460.
[15] Abramson J, et al. Accurate structure prediction of biomolecular interactions with AlphaFold 3. Nature 2024; 630: 493-500.
[16] Zhang J, et al. GRAPE-LM: single-round evolution of RNA aptamers with a generative AI framework. Nat Biotechnol 2025.
[17] Bugnon LA, et al. Comprehensive benchmarking of large language models for RNA secondary structure prediction. Brief Bioinform 2025; 26: bbaf137.
[18] Wong F, et al. Deep generative design of RNA aptamers using structural predictions. Nat Comput Sci 2024; 4: 829-839.
[19] Iwano N, et al. Generative aptamer discovery using RaptGen. Nat Comput Sci 2022; 2: 378-386.
[20] Karikó K, et al. Suppression of RNA recognition by Toll-like receptors: the impact of nucleoside modification and the evolutionary origin of RNA. Immunity 2005; 23: 165-175.
[21] Jumper J, et al. Highly accurate protein structure prediction with AlphaFold. Nature 2021; 596: 583-589.
[22] Nguyen E, et al. Sequence modeling and design from molecular to genome scale with Evo. Science 2024; 386: eado9336.
[23] Fire A, et al. Potent and specific genetic interference by double-stranded RNA in Caenorhabditis elegans. Nature 1998; 391: 806-811.
[24] Joshi CK, Liò P. gRNAde: a geometric deep learning approach for 3D RNA inverse design. Methods Mol Biol 2025; 2847: 121-135.
[25] Wang X, et al. Uni-RNA: universal pre-trained models revolutionize RNA research. bioRxiv [Preprint] 2023.
[26] Shen T, et al. Accurate RNA 3D structure prediction using a language model-based deep learning approach. Nat Methods 2024; 21: 1-12.
[27] Devlin J, et al. BERT: pre-training of deep bidirectional transformers for language understanding. Proc NAACL-HLT 2019: 4171-4186.
[28] Elnaggar A, et al. ProtTrans: toward understanding the language of life through self-supervised learning. IEEE Trans Pattern Anal Mach Intell 2022; 44: 7112-7127.
[29] Garner AL. Contemporary progress and opportunities in RNA-targeted drug discovery. ACS Med Chem Lett 2023; 14: 251-259.
[30] Riley AT, et al. Generative and predictive neural networks for the design of functional RNA molecules. Nat Commun 2025; 16: 1-17.
[31] Autour A, et al. Fluorogenic RNA Mango aptamers for imaging small non-coding RNAs in mammalian cells. Nat Commun 2018; 9: 656.
[32] Huang H, et al. RiboDiffusion: tertiary structure-based RNA inverse folding with generative diffusion models. Bioinformatics 2024; 40: i347-i356.
[33] Wang N, et al. Multi-purpose RNA language modelling with motif-aware pretraining and type-guided fine-tuning. Nat Mach Intell 2024; 6: 1-10.
[34] Wayment-Steele HK, et al. RNA secondary structure packages evaluated and improved by high-throughput experiments. Nat Methods 2022; 19: 1234-1242.
[35] Celaj A, et al. An RNA foundation model enables discovery of disease mechanisms and candidate therapeutics. bioRxiv [Preprint] 2023.
[36] Strobel EJ, Yu AM, Lucks JB. High-throughput determination of RNA structures. Nat Rev Genet 2018; 19: 615-634.
[37] Ji Y, et al. DNABERT: pre-trained bidirectional encoder representations from transformers for DNA-language in genome. Bioinformatics 2021; 37: 2112-2120.
[38] Szikszai M, et al. Deep learning models for RNA secondary structure prediction (probably) do not generalize across families. Bioinformatics 2022; 38: 3892-3899.
[39] Tan C, et al. RDesign: hierarchical data-efficient representation learning for tertiary structure-based RNA design. Proceedings of ICLR 2024.
[40] Wang Z, et al. AptaDiff: de novo design and optimization of aptamers based on diffusion models. Brief Bioinform 2024; 25: bbae517.
[41] Li S, et al. CodonBERT: large language model for mRNA vaccines. Genome Res 2024; 34: 1027-1035.
[42] Dauparas J, et al. Robust deep learning-based protein sequence design using ProteinMPNN. Science 2022; 378: 49-56.
[43] Su J, et al. RoFormer: enhanced transformer with rotary position embedding. Neurocomputing 2024; 568: 127063.
[44] Singh J, et al. RNA secondary structure prediction using an ensemble of two-dimensional deep neural networks and transfer learning. Nat Commun 2019; 10: 5407.
[45] Reuter JS, Mathews DH. RNAstructure: software for RNA secondary structure prediction and analysis. BMC Bioinform 2010; 11: 129.
[46] Lorenz R, et al. ViennaRNA Package 2.0. Algorithms Mol Biol 2011; 6: 26.
[47] Rives A, et al. Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences. Proc Natl Acad Sci USA 2021; 118: e2016239121.
[48] Tian K, et al. BEACON: a comprehensive benchmark for RNA tasks. Adv Neural Inf Process Syst 2024; 37.
[49] Notin P, et al. ProteinGym: large-scale benchmarks for protein fitness prediction and design. Adv Neural Inf Process Syst 2023; 36.
Downloads
Published
Issue
Section
License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
How to Cite
Similar Articles
- Mahmoud Zahra, Carla Frederick, Richard Thomas, Vaseem Iqbal , Drucy Borowitz, Gastrografin Enemas for Treatment of Distal Intestinal Obstruction Syndrome in Children and Adults with Cystic Fibrosis , Journal of Pharmacy and Nutrition Sciences : Vol. 4 No. 2 (2014)
- Rasheed, T. Ahmad , J.S. Siddiqi, Comparison of Outlier Detection Methods in Crossover Design Bioequivalence Studies , Journal of Pharmacy and Nutrition Sciences : Vol. 3 No. 2 (2013)
- Doaa Ahmed El-Setouhy, Emad B. Basalious, Nevine Shawky Abdelmalak, Effect of Different Meltable Binders on the Disintegration and Dissolution Behavior of Zolmitriptan Oromucosal Fast Melt Tablets , Journal of Pharmacy and Nutrition Sciences : Vol. 7 No. 1 (2017)
- Safaa A. Al-Zeidaneen , Mousa A. Ahmad , Ali D. Al-Ebuos, Impact of Chemotherapy Treatments on Dietary Intakes of Macro and Micronutrients among Jordanian Women with Breast Cancer , Journal of Pharmacy and Nutrition Sciences : Vol. 8 No. 3 (2018)
- A. Rasheed, S. Junaid, T. Ahmad, Detection of Outliers in Bioequivalence Studies Data Analysis with Williams Design , Journal of Pharmacy and Nutrition Sciences : Vol. 1 No. 1 (2011)
- Isabel Veloso Alves Pereira, Claudia Pinto Marques Souza de Oliveira, José Tadeu Stefano, Nathalia Cavalheiro Halla, João Avancini Ferreira Alves, Francisco Rafael Martins Laurindo, Flair José Carrilho, Yo Jyo Hen Shi Ko (YHK) Modulates the Expression of Proteins Involved in de novo Lipogenesis and Lipid Exportation in Experimental Nonalcoholic Steatohepatitis (NASH) , Journal of Pharmacy and Nutrition Sciences : Vol. 3 No. 1 (2013)
- Rochmy Istikharah , Vitarani Dwi Ananda Ningrum , Baiq Maylinda Gemantari, Primer Design Using Polymerase Chain Reaction for SNPs Analysis in SLC22A1 rs622342 Encoding OCT1 as Metformin Main Transporter , Journal of Pharmacy and Nutrition Sciences : Vol. 8 No. 2 (2018)
- B.M. Ambrose, G.O. Mauti, M. Nansunga, E.M. Mauti, B.M. Mabeya , G.R. Neel, To Determng the Serostatus and Frequency of HIV Exposed Infants in Ishaka Adventist Hospital , Journal of Pharmacy and Nutrition Sciences : Vol. 6 No. 2 (2016)
- David A. Areshidze , Lyudmila D. Timchenko , Igor V. Rzhepakovsky , Maria A. Kozlova , Iaroslavna A. Kusnetsova , Lyudmila A. Makartseva, Anti-Inflammatory Effect of Nicavet-2500 in Rodent Models of Acute Inflammation , Journal of Pharmacy and Nutrition Sciences : Vol. 8 No. 2 (2018)
- Satoru Sakuma, Midori Yabuuchi, Ayumi Yoshizumi, Yui Okajima, Yohko Fujimoto, Keiichiro Okuhira, Comparative Effects of Luteolin and Quercetin on Adipogenesis in 3T3-L1 Cells , Journal of Pharmacy and Nutrition Sciences : Vol. 11 (2021)
You may also start an advanced similarity search for this article.