logo

From Sequence to Decision: Large Language Models as End-to-End Engines for Therapeutic RNA Design

Authors

  • Alfi Sophian

    The Indonesian Food and Drug Authority, Jl. Percetakan Negara, No. 23, Jakarta Pusat, 10560, Indonesia

DOI:

https://doi.org/10.29169/1927-5951.2026.16.03

Keywords:

RNA therapeutics, large language models, RNA foundation models, mRNA design, RNA aptamers

Abstract

RNA-based therapeutics have achieved remarkable clinical validation, yet rational sequence design remains a fundamental bottleneck. Large language models (LLMs) trained on tens of millions of RNA sequences are beginning to reframe this challenge, offering a unified computational framework spanning structure prediction, immunogenicity optimization, and de novo sequence generation. Here, we survey the expanding landscape of RNA-focused foundation models — from early BERT-based encoders such as RNA-FM and ERNIE-RNA to large generative systems including GRAPE-LM — and map their end-to-end utility across six therapeutic modalities: messenger RNA, siRNA, antisense oligonucleotides, aptamers, circular RNA, and CRISPR guide RNAs. We identify three critical translation barriers: the RNA structural data famine, the absence of chemical-modification-aware architectures, and the lack of in vivo benchmarking datasets. We propose a roadmap — anchored by community data-generation initiatives and pre-competitive regulatory standards — for translating LLM-driven RNA design into clinical practice.

References

[1] Adams D, et al. Patisiran, an RNAi therapeutic, for hereditary transthyretin amyloidosis. N Engl J Med 2018; 379: 11-21.

[2] Pardi N, Hogan MJ, Porter FW, Weissman D. mRNA vaccines - a new era in vaccinology. Nat Rev Drug Discov 2018; 17: 261-279.

[3] Ray KK, et al. Two phase 3 trials of inclisiran in patients with elevated LDL cholesterol. N Engl J Med 2020; 382: 1507-1519.

[4] Wesselhoeft RA, Kowalski PS, Anderson DG. Engineering circular RNA for potent and stable translation in eukaryotic cells. Nat Commun 2018; 9: 2629.

[5] Schneider B, et al. When will RNA get its AlphaFold moment? Nucleic Acids Res 2023; 51: 9522-9532.

[6] Mauger DM, et al. mRNA structure regulates protein expression through changes in functional half-life. Proc Natl Acad Sci USA 2019; 116: 24075-24083.

[7] Childs-Disney JL, et al. Targeting RNA structures with small molecules. Nat Rev Drug Discov 2022; 21: 736-762.

[8] Vaswani A, et al. Attention is all you need. Adv Neural Inf Process Syst 2017; 30: 5999-6009.

[9] Lin Z, et al. Evolutionary-scale prediction of atomic-level protein structure with a language model. Science 2023; 379: 1123-1130.

[10] Chen J, et al. Interpretable RNA foundation model from unannotated data for highly accurate RNA structure and function predictions. Nat Methods 2024.

[11] Yin W, et al. ERNIE-RNA: an RNA language model with structure-enhanced representations. Nat Commun 2025; 16: 10076.

[12] Penić RJ, et al. RiNALMo: general-purpose RNA language models can generalize well on structure prediction tasks. Nat Commun 2025; 16: 5671.

[13] Wang N, et al. AIDO.RNA: a large-scale foundation model for RNA function and structure prediction. bioRxiv [Preprint] 2024.

[14] Chu Y, et al. A 5' UTR language model for decoding untranslated regions of mRNA and function predictions. Nat Mach Intell 2024; 6: 449-460.

[15] Abramson J, et al. Accurate structure prediction of biomolecular interactions with AlphaFold 3. Nature 2024; 630: 493-500.

[16] Zhang J, et al. GRAPE-LM: single-round evolution of RNA aptamers with a generative AI framework. Nat Biotechnol 2025.

[17] Bugnon LA, et al. Comprehensive benchmarking of large language models for RNA secondary structure prediction. Brief Bioinform 2025; 26: bbaf137.

[18] Wong F, et al. Deep generative design of RNA aptamers using structural predictions. Nat Comput Sci 2024; 4: 829-839.

[19] Iwano N, et al. Generative aptamer discovery using RaptGen. Nat Comput Sci 2022; 2: 378-386.

[20] Karikó K, et al. Suppression of RNA recognition by Toll-like receptors: the impact of nucleoside modification and the evolutionary origin of RNA. Immunity 2005; 23: 165-175.

[21] Jumper J, et al. Highly accurate protein structure prediction with AlphaFold. Nature 2021; 596: 583-589.

[22] Nguyen E, et al. Sequence modeling and design from molecular to genome scale with Evo. Science 2024; 386: eado9336.

[23] Fire A, et al. Potent and specific genetic interference by double-stranded RNA in Caenorhabditis elegans. Nature 1998; 391: 806-811.

[24] Joshi CK, Liò P. gRNAde: a geometric deep learning approach for 3D RNA inverse design. Methods Mol Biol 2025; 2847: 121-135.

[25] Wang X, et al. Uni-RNA: universal pre-trained models revolutionize RNA research. bioRxiv [Preprint] 2023.

[26] Shen T, et al. Accurate RNA 3D structure prediction using a language model-based deep learning approach. Nat Methods 2024; 21: 1-12.

[27] Devlin J, et al. BERT: pre-training of deep bidirectional transformers for language understanding. Proc NAACL-HLT 2019: 4171-4186.

[28] Elnaggar A, et al. ProtTrans: toward understanding the language of life through self-supervised learning. IEEE Trans Pattern Anal Mach Intell 2022; 44: 7112-7127.

[29] Garner AL. Contemporary progress and opportunities in RNA-targeted drug discovery. ACS Med Chem Lett 2023; 14: 251-259.

[30] Riley AT, et al. Generative and predictive neural networks for the design of functional RNA molecules. Nat Commun 2025; 16: 1-17.

[31] Autour A, et al. Fluorogenic RNA Mango aptamers for imaging small non-coding RNAs in mammalian cells. Nat Commun 2018; 9: 656.

[32] Huang H, et al. RiboDiffusion: tertiary structure-based RNA inverse folding with generative diffusion models. Bioinformatics 2024; 40: i347-i356.

[33] Wang N, et al. Multi-purpose RNA language modelling with motif-aware pretraining and type-guided fine-tuning. Nat Mach Intell 2024; 6: 1-10.

[34] Wayment-Steele HK, et al. RNA secondary structure packages evaluated and improved by high-throughput experiments. Nat Methods 2022; 19: 1234-1242.

[35] Celaj A, et al. An RNA foundation model enables discovery of disease mechanisms and candidate therapeutics. bioRxiv [Preprint] 2023.

[36] Strobel EJ, Yu AM, Lucks JB. High-throughput determination of RNA structures. Nat Rev Genet 2018; 19: 615-634.

[37] Ji Y, et al. DNABERT: pre-trained bidirectional encoder representations from transformers for DNA-language in genome. Bioinformatics 2021; 37: 2112-2120.

[38] Szikszai M, et al. Deep learning models for RNA secondary structure prediction (probably) do not generalize across families. Bioinformatics 2022; 38: 3892-3899.

[39] Tan C, et al. RDesign: hierarchical data-efficient representation learning for tertiary structure-based RNA design. Proceedings of ICLR 2024.

[40] Wang Z, et al. AptaDiff: de novo design and optimization of aptamers based on diffusion models. Brief Bioinform 2024; 25: bbae517.

[41] Li S, et al. CodonBERT: large language model for mRNA vaccines. Genome Res 2024; 34: 1027-1035.

[42] Dauparas J, et al. Robust deep learning-based protein sequence design using ProteinMPNN. Science 2022; 378: 49-56.

[43] Su J, et al. RoFormer: enhanced transformer with rotary position embedding. Neurocomputing 2024; 568: 127063.

[44] Singh J, et al. RNA secondary structure prediction using an ensemble of two-dimensional deep neural networks and transfer learning. Nat Commun 2019; 10: 5407.

[45] Reuter JS, Mathews DH. RNAstructure: software for RNA secondary structure prediction and analysis. BMC Bioinform 2010; 11: 129.

[46] Lorenz R, et al. ViennaRNA Package 2.0. Algorithms Mol Biol 2011; 6: 26.

[47] Rives A, et al. Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences. Proc Natl Acad Sci USA 2021; 118: e2016239121.

[48] Tian K, et al. BEACON: a comprehensive benchmark for RNA tasks. Adv Neural Inf Process Syst 2024; 37.

[49] Notin P, et al. ProteinGym: large-scale benchmarks for protein fitness prediction and design. Adv Neural Inf Process Syst 2023; 36.

Downloads

Published

2026-08-03

Issue

Section

Articles

How to Cite

From Sequence to Decision: Large Language Models as End-to-End Engines for Therapeutic RNA Design. (2026). Journal of Pharmacy and Nutrition Sciences , 16, 18-28. https://doi.org/10.29169/1927-5951.2026.16.03

Similar Articles

1-10 of 52

You may also start an advanced similarity search for this article.