From Sequence to Decision: Large Language Models as End-to-End Engines for Therapeutic RNA Design
DOI:
https://doi.org/10.29169/1927-5951.2026.16.03Keywords:
RNA therapeutics, large language models, RNA foundation models, mRNA design, RNA aptamersAbstract
RNA-based therapeutics have achieved remarkable clinical validation, yet rational sequence design remains a fundamental bottleneck. Large language models (LLMs) trained on tens of millions of RNA sequences are beginning to reframe this challenge, offering a unified computational framework spanning structure prediction, immunogenicity optimization, and de novo sequence generation. Here, we survey the expanding landscape of RNA-focused foundation models — from early BERT-based encoders such as RNA-FM and ERNIE-RNA to large generative systems including GRAPE-LM — and map their end-to-end utility across six therapeutic modalities: messenger RNA, siRNA, antisense oligonucleotides, aptamers, circular RNA, and CRISPR guide RNAs. We identify three critical translation barriers: the RNA structural data famine, the absence of chemical-modification-aware architectures, and the lack of in vivo benchmarking datasets. We propose a roadmap — anchored by community data-generation initiatives and pre-competitive regulatory standards — for translating LLM-driven RNA design into clinical practice.
References
[1] Adams D, et al. Patisiran, an RNAi therapeutic, for hereditary transthyretin amyloidosis. N Engl J Med 2018; 379: 11-21.
[2] Pardi N, Hogan MJ, Porter FW, Weissman D. mRNA vaccines - a new era in vaccinology. Nat Rev Drug Discov 2018; 17: 261-279.
[3] Ray KK, et al. Two phase 3 trials of inclisiran in patients with elevated LDL cholesterol. N Engl J Med 2020; 382: 1507-1519.
[4] Wesselhoeft RA, Kowalski PS, Anderson DG. Engineering circular RNA for potent and stable translation in eukaryotic cells. Nat Commun 2018; 9: 2629.
[5] Schneider B, et al. When will RNA get its AlphaFold moment? Nucleic Acids Res 2023; 51: 9522-9532.
[6] Mauger DM, et al. mRNA structure regulates protein expression through changes in functional half-life. Proc Natl Acad Sci USA 2019; 116: 24075-24083.
[7] Childs-Disney JL, et al. Targeting RNA structures with small molecules. Nat Rev Drug Discov 2022; 21: 736-762.
[8] Vaswani A, et al. Attention is all you need. Adv Neural Inf Process Syst 2017; 30: 5999-6009.
[9] Lin Z, et al. Evolutionary-scale prediction of atomic-level protein structure with a language model. Science 2023; 379: 1123-1130.
[10] Chen J, et al. Interpretable RNA foundation model from unannotated data for highly accurate RNA structure and function predictions. Nat Methods 2024.
[11] Yin W, et al. ERNIE-RNA: an RNA language model with structure-enhanced representations. Nat Commun 2025; 16: 10076.
[12] Penić RJ, et al. RiNALMo: general-purpose RNA language models can generalize well on structure prediction tasks. Nat Commun 2025; 16: 5671.
[13] Wang N, et al. AIDO.RNA: a large-scale foundation model for RNA function and structure prediction. bioRxiv [Preprint] 2024.
[14] Chu Y, et al. A 5' UTR language model for decoding untranslated regions of mRNA and function predictions. Nat Mach Intell 2024; 6: 449-460.
[15] Abramson J, et al. Accurate structure prediction of biomolecular interactions with AlphaFold 3. Nature 2024; 630: 493-500.
[16] Zhang J, et al. GRAPE-LM: single-round evolution of RNA aptamers with a generative AI framework. Nat Biotechnol 2025.
[17] Bugnon LA, et al. Comprehensive benchmarking of large language models for RNA secondary structure prediction. Brief Bioinform 2025; 26: bbaf137.
[18] Wong F, et al. Deep generative design of RNA aptamers using structural predictions. Nat Comput Sci 2024; 4: 829-839.
[19] Iwano N, et al. Generative aptamer discovery using RaptGen. Nat Comput Sci 2022; 2: 378-386.
[20] Karikó K, et al. Suppression of RNA recognition by Toll-like receptors: the impact of nucleoside modification and the evolutionary origin of RNA. Immunity 2005; 23: 165-175.
[21] Jumper J, et al. Highly accurate protein structure prediction with AlphaFold. Nature 2021; 596: 583-589.
[22] Nguyen E, et al. Sequence modeling and design from molecular to genome scale with Evo. Science 2024; 386: eado9336.
[23] Fire A, et al. Potent and specific genetic interference by double-stranded RNA in Caenorhabditis elegans. Nature 1998; 391: 806-811.
[24] Joshi CK, Liò P. gRNAde: a geometric deep learning approach for 3D RNA inverse design. Methods Mol Biol 2025; 2847: 121-135.
[25] Wang X, et al. Uni-RNA: universal pre-trained models revolutionize RNA research. bioRxiv [Preprint] 2023.
[26] Shen T, et al. Accurate RNA 3D structure prediction using a language model-based deep learning approach. Nat Methods 2024; 21: 1-12.
[27] Devlin J, et al. BERT: pre-training of deep bidirectional transformers for language understanding. Proc NAACL-HLT 2019: 4171-4186.
[28] Elnaggar A, et al. ProtTrans: toward understanding the language of life through self-supervised learning. IEEE Trans Pattern Anal Mach Intell 2022; 44: 7112-7127.
[29] Garner AL. Contemporary progress and opportunities in RNA-targeted drug discovery. ACS Med Chem Lett 2023; 14: 251-259.
[30] Riley AT, et al. Generative and predictive neural networks for the design of functional RNA molecules. Nat Commun 2025; 16: 1-17.
[31] Autour A, et al. Fluorogenic RNA Mango aptamers for imaging small non-coding RNAs in mammalian cells. Nat Commun 2018; 9: 656.
[32] Huang H, et al. RiboDiffusion: tertiary structure-based RNA inverse folding with generative diffusion models. Bioinformatics 2024; 40: i347-i356.
[33] Wang N, et al. Multi-purpose RNA language modelling with motif-aware pretraining and type-guided fine-tuning. Nat Mach Intell 2024; 6: 1-10.
[34] Wayment-Steele HK, et al. RNA secondary structure packages evaluated and improved by high-throughput experiments. Nat Methods 2022; 19: 1234-1242.
[35] Celaj A, et al. An RNA foundation model enables discovery of disease mechanisms and candidate therapeutics. bioRxiv [Preprint] 2023.
[36] Strobel EJ, Yu AM, Lucks JB. High-throughput determination of RNA structures. Nat Rev Genet 2018; 19: 615-634.
[37] Ji Y, et al. DNABERT: pre-trained bidirectional encoder representations from transformers for DNA-language in genome. Bioinformatics 2021; 37: 2112-2120.
[38] Szikszai M, et al. Deep learning models for RNA secondary structure prediction (probably) do not generalize across families. Bioinformatics 2022; 38: 3892-3899.
[39] Tan C, et al. RDesign: hierarchical data-efficient representation learning for tertiary structure-based RNA design. Proceedings of ICLR 2024.
[40] Wang Z, et al. AptaDiff: de novo design and optimization of aptamers based on diffusion models. Brief Bioinform 2024; 25: bbae517.
[41] Li S, et al. CodonBERT: large language model for mRNA vaccines. Genome Res 2024; 34: 1027-1035.
[42] Dauparas J, et al. Robust deep learning-based protein sequence design using ProteinMPNN. Science 2022; 378: 49-56.
[43] Su J, et al. RoFormer: enhanced transformer with rotary position embedding. Neurocomputing 2024; 568: 127063.
[44] Singh J, et al. RNA secondary structure prediction using an ensemble of two-dimensional deep neural networks and transfer learning. Nat Commun 2019; 10: 5407.
[45] Reuter JS, Mathews DH. RNAstructure: software for RNA secondary structure prediction and analysis. BMC Bioinform 2010; 11: 129.
[46] Lorenz R, et al. ViennaRNA Package 2.0. Algorithms Mol Biol 2011; 6: 26.
[47] Rives A, et al. Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences. Proc Natl Acad Sci USA 2021; 118: e2016239121.
[48] Tian K, et al. BEACON: a comprehensive benchmark for RNA tasks. Adv Neural Inf Process Syst 2024; 37.
[49] Notin P, et al. ProteinGym: large-scale benchmarks for protein fitness prediction and design. Adv Neural Inf Process Syst 2023; 36.
Downloads
Published
Issue
Section
License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
How to Cite
Similar Articles
- Raghad Al Nuss, Hind El-Zein, pH- Modified Solid Dispersions of Cefdinir for Dissolution Rate Enhancement: Formulation and Characterization , Journal of Pharmacy and Nutrition Sciences : Vol. 11 (2021)
- Alejandro González Álvarez, Manuel Gómez Barrera, Joaquín Borrás Blasco , Emilio José Giner Serret, Adalimumab and Etanercept in the Treatment of Rheumatoid Arthritis and Spondyloarthropathies: Budget Impact Model of Dose Reduction , Journal of Pharmacy and Nutrition Sciences : Vol. 4 No. 3 (2014)
- Viviana Loria-Kohen, Thais Lourenço-Nogueira, Isabel Espinosa-Salinas, Francisco R. Marín, Cristina Soler-Rivas , Ana Ramirez de Molina, Nutritional and Functional Properties of Edible Mushrooms: A Food with Promising Health Claims , Journal of Pharmacy and Nutrition Sciences : Vol. 4 No. 3 (2014)
- Krishna Sailaja, A. Saritha Reddy, V. Sreelola, P. Swathi , Ch. Vineela, Nanotechnology-An Overview , Journal of Pharmacy and Nutrition Sciences : Vol. 4 No. 4 (2014)
- Manoj Kumar Mishra, Dubey Deepti , Upamanyu Neeraj, Development and Evaluation of Controlled Release Bilayer Tablets of Hydrochlorothiazide and Losartan Potassium , Journal of Pharmacy and Nutrition Sciences : Vol. 5 No. 1 (2015)
- Sovan Pattanaik, Sudam Chandra Si, Sudhanshu Sekhar Rout, Anindya Bose , Siva Shankar Nayak, In Silico Design & Development of Some Selected Flavonols Against Beta–Glucuronidase Inhibitory Activity , Journal of Pharmacy and Nutrition Sciences : Vol. 5 No. 1 (2015)
- Mittal, V. Juyal , A. Singh, Standardization of Polyherbal Extract for Type-2 Diabetes , Journal of Pharmacy and Nutrition Sciences : Vol. 5 No. 2 (2015)
- Marie-Claire Cammaerts, Roger Cammaerts , Axel Dero, A 0.123% Stevia/Aspartame 91/9 Aqueous Solution Balances the Effects of the Two Substances, and may thus be a Safer and Tastier Sweetener to be Used , Journal of Pharmacy and Nutrition Sciences : Vol. 5 No. 4 (2015)
- Anchalee Sirikanchanarod, Akkarach Bumrungpert, Wiroje Kaewruang, Tipanee Senawong , Patcharanee Pavadhgul, The Effect of Mulberry Fruits Consumption on Lipid Profiles in Hypercholesterolemic Subjects: A Randomized Controlled Trial , Journal of Pharmacy and Nutrition Sciences : Vol. 6 No. 1 (2016)
- Di Viesti, G. Carnevale, M.M. Carrozzo, M. Zavatti , M. Baraldi, Influence of Parmigiano Reggiano Diet on Male Sexual Behavior in Rats: Behavioral and Neurochemical Study , Journal of Pharmacy and Nutrition Sciences : Vol. 2 No. 1 (2012)
You may also start an advanced similarity search for this article.