How to Benchmark RNA Secondary Structure Prediction Accuracy

Overview

Journal Methods

Specialty Biochemistry

Date 2019 Apr 6

PMID 30951834

Citations 15

Authors

David H Mathews

Affiliations

Soon will be listed here.

Abstract

RNA secondary structure prediction is widely used. As new methods are developed, these are often benchmarked for accuracy against existing methods. This review discusses good practices for performing these benchmarks, including the choice of benchmarking structures, metrics to quantify accuracy, the importance of allowing flexibility for pairs in the accepted structure, and the importance of statistical testing for significance.

Citing Articles

Analyzing aptamer structure and interactions: in silico modelling and instrumental methods.

Malysheva D, Dymova M, Richter V Biophys Rev. 2025; 16(6):685-700.

PMID: 39830127 PMC: 11735759. DOI: 10.1007/s12551-024-01252-z.

Robust RNA secondary structure prediction with a mixture of deep learning and physics-based experts.

Qiu X Biol Methods Protoc. 2025; 10(1):bpae097.

PMID: 39811444 PMC: 11729747. DOI: 10.1093/biomethods/bpae097.

DecoyFinder: Identification of Contaminants in Sets of Homologous RNA Sequences.

Zhu M, Zuber J, Tan Z, Sharma G, Mathews D bioRxiv. 2024; .

PMID: 39464058 PMC: 11507696. DOI: 10.1101/2024.10.12.618037.

Intronic RNA secondary structural information captured for the human pre-mRNA.

Eich T, OLeary C, Moss W NAR Genom Bioinform. 2024; 6(4):lqae143.

PMID: 39450312 PMC: 11500451. DOI: 10.1093/nargab/lqae143.

Discovery and Quantification of Long-Range RNA Base Pairs in Coronavirus Genomes with SEARCH-MaP and SEISMIC-RNA.

Allan M, Aruda J, Plung J, Grote S, Martin des Taillades Y, de Lajarte A Res Sq. 2024; .

PMID: 39149495 PMC: 11326378. DOI: 10.21203/rs.3.rs-4814547/v1.

References

Hofacker I . Energy-directed RNA structure prediction. Methods Mol Biol. 2014; 1097:71-84. DOI: 10.1007/978-1-62703-709-9_4. View

Sloma M, Mathews D . Improving RNA secondary structure prediction with structure mapping data. Methods Enzymol. 2015; 553:91-114. DOI: 10.1016/bs.mie.2014.10.053. View

Havgaard J, Lyngso R, Stormo G, Gorodkin J . Pairwise local structural alignment of RNA sequences with sequence similarity less than 40%. Bioinformatics. 2005; 21(9):1815-24. DOI: 10.1093/bioinformatics/bti279. View

Xia T, SantaLucia Jr J, Burkard M, Kierzek R, Schroeder S, Jiao X . Thermodynamic parameters for an expanded nearest-neighbor model for formation of RNA duplexes with Watson-Crick base pairs. Biochemistry. 1998; 37(42):14719-35. DOI: 10.1021/bi9809425. View

Nawrocki E, Eddy S . Infernal 1.1: 100-fold faster RNA homology searches. Bioinformatics. 2013; 29(22):2933-5. PMC: 3810854. DOI: 10.1093/bioinformatics/btt509. View

Longfellow C, Kierzek R, Turner D . Thermodynamic and spectroscopic study of bulge loops in oligoribonucleotides. Biochemistry. 1990; 29(1):278-85. DOI: 10.1021/bi00453a038. View

Tinoco Jr I, Bustamante C . How RNA folds. J Mol Biol. 1999; 293(2):271-81. DOI: 10.1006/jmbi.1999.3001. View

Wu L, Belasco J . Let me count the ways: mechanisms of gene regulation by miRNAs and siRNAs. Mol Cell. 2008; 29(1):1-7. DOI: 10.1016/j.molcel.2007.12.010. View

Huynen M, Gutell R, Konings D . Assessing the reliability of RNA folding using statistical mechanics. J Mol Biol. 1997; 267(5):1104-12. DOI: 10.1006/jmbi.1997.0889. View

10.

Sloma M, Mathews D . Exact calculation of loop formation probability identifies folding motifs in RNA secondary structures. RNA. 2016; 22(12):1808-1818. PMC: 5113201. DOI: 10.1261/rna.053694.115. View

11.

Rivas E, Lang R, Eddy S . A range of complex probabilistic models for RNA secondary structure prediction that includes the nearest-neighbor model and more. RNA. 2011; 18(2):193-212. PMC: 3264907. DOI: 10.1261/rna.030049.111. View

12.

Hajiaghayi M, Condon A, Hoos H . Analysis of energy-based algorithms for RNA secondary structure prediction. BMC Bioinformatics. 2012; 13:22. PMC: 3347993. DOI: 10.1186/1471-2105-13-22. View

13.

Yang H, Jossinet F, Leontis N, Chen L, Westbrook J, Berman H . Tools for the automatic identification and classification of RNA base pairs. Nucleic Acids Res. 2003; 31(13):3450-60. PMC: 168936. DOI: 10.1093/nar/gkg529. View

14.

Liu Q, Fredrick K . Intersubunit Bridges of the Bacterial Ribosome. J Mol Biol. 2016; 428(10 Pt B):2146-64. PMC: 4884490. DOI: 10.1016/j.jmb.2016.02.009. View

15.

Seetin M, Mathews D . RNA structure prediction: an overview of methods. Methods Mol Biol. 2012; 905:99-122. DOI: 10.1007/978-1-61779-949-5_8. View

16.

Zuber J, Sun H, Zhang X, McFadyen I, Mathews D . A sensitivity analysis of RNA folding nearest neighbor parameters identifies a subset of free energy parameters with the greatest impact on RNA secondary structure prediction. Nucleic Acids Res. 2017; 45(10):6168-6176. PMC: 5449625. DOI: 10.1093/nar/gkx170. View

17.

Szymanski M, Zielezinski A, Barciszewski J, Erdmann V, Karlowski W . 5SRNAdb: an information resource for 5S ribosomal RNAs. Nucleic Acids Res. 2015; 44(D1):D180-3. PMC: 4702797. DOI: 10.1093/nar/gkv1081. View

18.

Reuter J, Mathews D . RNAstructure: software for RNA secondary structure prediction and analysis. BMC Bioinformatics. 2010; 11:129. PMC: 2984261. DOI: 10.1186/1471-2105-11-129. View

19.

Lim G, Merz G, McCann M, Gruskiewicz J, Serra M . Stability of single-nucleotide bulge loops embedded in a GAAA RNA hairpin stem. RNA. 2012; 18(4):807-14. PMC: 3312567. DOI: 10.1261/rna.028308.111. View

20.

Andronescu M, Condon A, Hoos H, Mathews D, Murphy K . Efficient parameter estimation for RNA secondary structure prediction. Bioinformatics. 2007; 23(13):i19-28. DOI: 10.1093/bioinformatics/btm223. View