No retraction, correction or concern found when last checked on Oct 16, 2026.

How many biological replicates are needed in an RNA-seq experiment and which differential expression tool should you use?

Nicholas J. Schurch, Pietá Schofield, Marek Gierliński and 9 more

RNA · 2016

doi:10.1261/rna.053959.115

Abstract

RNA-seq is now the technology of choice for genome-wide differential gene expression experiments, but it is not clear how many biological replicates are needed to ensure valid biological interpretation of the results or which statistical tools are best for analyzing the data. An RNA-seq experiment with 48 biological replicates in each of two conditions was performed to answer these questions and provide guidelines for experimental design. With three biological replicates, nine of the 11 tools evaluated found only 20%–40% of the significantly differentially expressed (SDE) genes identified with the full set of 42 clean replicates. This rises to >85% for the subset of SDE genes changing in expression by more than fourfold. To achieve >85% for all SDE genes regardless of fold change requires more than 20 biological replicates. The same nine tools successfully control their false discovery rate at ≲5% for all numbers of replicates, while the remaining two tools fail to control their FDR adequately, particularly for low numbers of replicates. For future RNA-seq experiments, these results suggest that at least six biological replicates should be used, rising to at least 12 when it is important to identify SDE genes for all fold changes. If fewer than 12 replicates are used, a superior combination of true positive and false positive performances makes edgeR and DESeq2 the leading tools. For higher replicate numbers, minimizing false positives is more important and DESeq marginally outperforms the other tools.

Shown for reading. Its publisher allows quoting it, not republishing it.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 71

1.
Differential expression analysis for sequence count data · 2010
No notice
2.
HTSeq—a Python framework to work with high-throughput sequencing data · 2014
No notice
3.
Auer PL, Doerge RW. 2010 Statistical design and analysis of RNA sequencing data. Genetics 185: 405–416.
Not in our library10.1534/genetics.110.114983
4.
Becker PB, Horz W. 2002 ATP-dependent nucleosome remodeling. Annu Rev Biochem 71: 247–273.
Not in our library10.1146/annurev.biochem.71.110601.135400
5.
Bellera CA, Julien M, Hanley JA. 2010 Normal approximations to the distributions of the Wilcoxon statistics: accurate to what N? Graphical insights. J Stat Educ 18.
Not in our library
6.
Benjamini Y, Hochberg Y. 1995 Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc B (Methodol) 57: 289–300.
Not in our library
7.
Evaluating Gene Expression in C57BL/6J and DBA/2J Mouse Striatum Using RNA-Seq and Microarrays · 2011
No notice
8.
Evaluation of statistical methods for normalization and differential expression in mRNA-Seq experiments · 2010
No notice
9.
Burden C, Qureshi S, Wilson SR. 2014 Error estimates for the analysis of differential expression from RNA-seq count data. PeerJ 2: e576.
Not in our library10.7717/peerj.576
10.
Busby MA, Stewart C, Miller CA, Grzeda KR, Marth GT. 2013 Scotty: a web tool for designing RNA-Seq experiments to measure differential gene expression. Bioinformatics 29: 656–657.
Not in our library10.1093/bioinformatics/btt015
11.
The Cancer Genome Atlas Research Network. 2008 Comprehensive genomic characterization defines human glioblastoma genes and core pathways. Nature 455: 1061–1068.
Not in our library10.1038/nature07385
12.
Polymorphic Cis- and Trans-Regulation of Human Gene Expression · 2010
No notice
13.
Churchill GA. 2002 Fundamentals of experimental design for cDNA microarrays. Nat Genet 32: 490–495.
Not in our library10.1038/ng1031
14.
Colbourn CJ, Dinitz JH. 2007 Handbook of combinatorial designs. Chapman and Hall/Taylor and Francis, Boca Raton, FL.
Not in our library
15.
Cui X, Hwang JT, Qiu J, Blades NJ, Churchill GA. 2005 Improved statistical tests for differential gene expression by shrinking variance components estimates. Biostatistics 6: 59–75.
Not in our library10.1093/biostatistics/kxh018
16.
De Hertogh B, De Meulder B, Berger F, Pierre M, Bareke E, Gaigneaux A, Depiereux E. 2010 A benchmark for statistical microarray data analysis that preserves actual biological and technical variance. BMC Bioinformatics 11: 17.
Not in our library10.1186/1471-2105-11-17
17.
Dillies MA, Rau A, Aubert J, Hennequet-Antier C, Jeanmougin M, Servant N, Keime C, Marot G, Castel D, Estelle J, 2013 A comprehensive evaluation of normalization methods for Illumina high-throughput RNA sequencing data analysis. Brief Bioinform 14: 671–683.
Not in our library10.1093/bib/bbs046
18.
Efron B, Tibshirani R. 1993a An introduction to the bootstrap, pp. 203–219. Chapman and Hall, New York.
Not in our library
19.
Efron B, Tibshirani R. 1993b An introduction to the bootstrap, pp. 220–224. Chapman and Hall, New York.
Not in our library
20.
Flicek P, Amode MR, Barrell D, Beal K, Brent S, Chen Y, Clapham P, Coates G, Fairley S, Fitzgerald S, 2011 Ensembl 2011. Nucleic Acids Res 39: D800–D806.
Not in our library10.1093/nar/gkq1064
21.
Frazee AC, Langmead B, Leek JT. 2011 ReCount: a multi-experiment resource of analysis-ready RNA-seq gene count datasets. BMC Bioinformatics 12: 449.
Not in our library10.1186/1471-2105-12-449
22.
Frazee AC, Sabunciyan S, Hansen KD, Irizarry RA, Leek JT. 2014 Differential expression analysis of RNA-seq data at single-base resolution. Biostatistics 15: 413–426.
Not in our library10.1093/biostatistics/kxt053
23.
Gierliński M, Blaxter M, Cole C, Gharbi K, Owen-Hughes T, Schofield P, Schurch NJ, Sherstnev A, Singh V, Wrobel N, 2015 Statistical models for RNA-seq data derived from a two-condition 48-replicate experiment. Bioinformatics 31: 3625–3630.
Not in our library10.1093/bioinformatics/btv425
24.
Gkikopoulos T, Schofield P, Singh V, Pinskaya M, Mellor J, Smolle M, Workman JL, Barton GJ, Owen-Hughes T. 2011 A role for Snf2-related nucleosome-spacing enzymes in genome-wide nucleosome organization. Science 333: 1758–1760.
Not in our library10.1126/science.1206097
25.
Guo Y, Li CI, Ye F, Shyr Y. 2013 Evaluation of read count based RNAseq analysis methods. BMC Genomics 14: S2.
Not in our library10.1186/1471-2164-14-s8-s2
26.
Hansen KD, Wu Z, Irizarry RA, Leek JT. 2011 Sequencing technology does not eliminate biological variability. Nat Biotechnol 29: 572–573.
Not in our library10.1038/nbt.1910
27.
baySeq: Empirical Bayesian methods for identifying differential expression in sequence count data · 2010
No notice
28.
Hirschhorn JN, Brown SA, Clark CD, Winston F. 1992 Evidence that SNF2/SWI2 and SNF5 activate transcription in yeast by altering chromatin structure. Genes Dev 6: 2288–2298.
Not in our library10.1101/gad.6.12a.2288
29.
Holstege FC, Jennings EG, Wyrick JJ, Lee TI, Hengartner CJ, Green MR, Golub TR, Lander ES, Young RA. 1998 Dissecting the regulatory circuitry of a eukaryotic genome. Cell 95: 717–728.
Not in our library10.1016/s0092-8674(00)81641-4
30.
The International HapMap Consortium. 2005 A haplotype map of the human genome. Nature 437: 1299–1320.
Not in our library10.1038/nature04226
31.
Jiang L, Schlesinger F, Davis CA, Zhang Y, Li R, Salit M, Gingeras TR, Oliver B. 2011 Synthetic spike-in standards for RNA-seq experiments. Genome Res 21: 1543–1551.
Not in our library10.1101/gr.121095.111
32.
Kaisers W, Schwender H, Schaal H. 2014 Hierarchical clustering of DNA k-mer counts in RNA-seq fastq files reveals batch effects. arXiv 1405.0114.
Not in our library10.3390/ijms19113687
33.
Kohrer K, Domdey H. 1991 Preparation of high molecular weight RNA. Methods Enzymol 194: 398–405.
Not in our library10.1016/0076-6879(91)94030-g
34.
Kvam VM, Liu P, Si Y. 2012 A comparison of statistical methods for detecting differentially expressed genes from RNA-seq data. Am J Bot 99: 248–256.
Not in our library10.3732/ajb.1100340
35.
voom: precision weights unlock linear model analysis tools for RNA-seq read counts · 2014
No notice
36.
Leng N, Dawson JA, Thomson JA, Ruotti V, Rissman AI, Smits BM, Haag JD, Gould MN, Stewart RM, Kendziorski C. 2013 EBSeq: an empirical Bayes hierarchical model for inference in RNA-seq experiments. Bioinformatics 29: 1035–1043.
Not in our library10.1093/bioinformatics/btt087
37.
Li J, Tibshirani R. 2013 Finding consistent patterns: a nonparametric approach for identifying differential expression in RNA-Seq data. Stat Methods Med Res 22: 519–536.
Not in our library10.1177/0962280211428386
38.
Li J, Witten DM, Johnstone IM, Tibshirani R. 2012 Normalization, testing, and false discovery rate estimation for RNA-sequencing data. Biostatistics 13: 523–538.
Not in our library10.1093/biostatistics/kxr031
39.
Liu Y, Zhou J, White KP. 2014 RNA-seq differential expression studies: more sequence or more replication? Bioinformatics 30: 301–304.
Not in our library10.1093/bioinformatics/btt688
40.
Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2 · 2014
No notice
41.
Loven J, Orlando DA, Sigova AA, Lin CY, Rahl PB, Burge CB, Levens DL, Lee TI, Young RA. 2012 Revisiting global gene expression analysis. Cell 151: 476–482.
Not in our library10.1016/j.cell.2012.10.012
42.
Lund SP, Nettleton D, McCarthy DJ, Smyth GK. 2012 Detecting differential expression in RNA-sequence data using quasi-likelihood with shrunken dispersion estimates. Stat Appl Genet Mol Biol 11.
Not in our library10.1515/1544-6115.1826
43.
Mann HB, Whitney DR. 1947 On a test of whether one of two random variables is stochastically larger than the other. Ann Math Stat 18: 50–60.
Not in our library
44.
Marioni JC, Mason CE, Mane SM, Stephens M, Gilad Y. 2008 RNA-seq: an assessment of technical reproducibility and comparison with gene expression arrays. Genome Res 18: 1509–1517.
Not in our library10.1101/gr.079558.108
45.
Montgomery SB, Sammeth M, Gutierrez-Arcelus M, Lach RP, Ingle C, Nisbett J, Guigo R, Dermitzakis ET. 2010 Transcriptome genetics using second generation sequencing in a Caucasian population. Nature 464: 773–777.
Not in our library10.1038/nature08903
46.
Moulos P, Hatzis P. 2015 Systematic integration of RNA-Seq statistical algorithms for accurate detection of differential gene expression patterns. Nucleic Acids Res 43: e25.
Not in our library10.1093/nar/gku1273
47.
Neigeborn L, Carlson M. 1984 Genes affecting the regulation of SUC2 gene expression by glucose repression in Saccharomyces cerevisiae. Genetics 108: 845–858.
Not in our library10.1093/genetics/108.4.845
48.
Olsson U. 2005 Confidence intervals for the mean of log-normal distribution. J Stat Educ 13.
Not in our library
49.
Pan W, Lin J, Le CT. 2002 How many replicates of arrays are required to detect gene expression changes in microarray experiments? A mixture model approach. Genome Biol 3: research0022.
Not in our library10.1186/gb-2002-3-5-research0022
50.
Peterson CL, Herskowitz I. 1992 Characterization of the yeast SWI1, SWI2, and SWI3 genes, which encode a global activator of transcription. Cell 68: 573–583.
Not in our library10.1016/0092-8674(92)90192-f
51.
Peterson CL, Kruger W, Herskowitz I. 1991 A functional interaction between the C-terminal domain of RNA polymerase II and the negative regulator SIN1. Cell 64: 1135–1143.
Not in our library10.1016/0092-8674(91)90268-4
52.
Pickrell JK, Marioni JC, Pai AA, Degner JF, Engelhardt BE, Nkadori E, Veyrieras JB, Stephens M, Gilad Y, Pritchard JK. 2010 Understanding mechanisms underlying human gene expression variation with RNA sequencing. Nature 464: 768–772.
Not in our library10.1038/nature08872
53.
Comprehensive evaluation of differential gene expression analysis methods for RNA-seq data · 2013
Corrected
54.
A scaling normalization method for differential expression analysis of RNA-seq data · 2010
No notice
55.
Robinson MD, McCarthy DJ, Smyth GK. 2010 edgeR: a Bioconductor package for differential expression analysis of digital gene expression data. Bioinformatics 26: 139–140.
Not in our library10.1093/bioinformatics/btp616
56.
Ryan DP, Owen-Hughes T. 2011 Snf2-family proteins: chromatin remodellers for any occasion. Curr Opin Chem Biol 15: 649–656.
Not in our library10.1016/j.cbpa.2011.07.022
57.
Schurch NJ, Cole C, Sherstnev A, Song J, Duc C, Storey KG, McLean WH, Brown SJ, Simpson GG, Barton GJ. 2014 Improved annotation of 3′ untranslated regions and complex loci by combination of strand-specific direct RNA sequencing, RNA-Seq and ESTs. PLoS One 9: e94270.
Not in our library10.1371/journal.pone.0094270
58.
SEQC/MAQC-III Consortium. 2014 A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium. Nat Biotechnol 32: 903–914.
Not in our library10.1038/nbt.2957
59.
Comparison of software packages for detecting differential expression in RNA-seq studies · 2013
No notice
60.
Sheskin D. 2004 Handbook of parametric and nonparametric statistical procedures, 3rd ed., pp. 428–431. Chapman and Hall/CRC, Boca Raton, FL.
Not in our library
61.
Soneson C. 2014 compcodeR—an R package for benchmarking differential expression methods for RNA-seq data. Bioinformatics 30: 2517–2518.
Not in our library10.1093/bioinformatics/btu324
62.
A comparison of methods for differential expression analysis of RNA-seq data · 2013
No notice
63.
Stern M, Jensen R, Herskowitz I. 1984 Five SWI genes are required for expression of the HO gene in yeast. J Mol Biol 178: 853–868.
Not in our library10.1016/0022-2836(84)90315-2
64.
Whole-genome expression analysis of snf/swi mutants of Saccharomyces cerevisiae · 2000
Not checked
65.
Suzuki R, Shimodaira H. 2006 Pvclust: an R package for assessing the uncertainty in hierarchical clustering. Bioinformatics 22: 1540–1542.
Not in our library10.1093/bioinformatics/btl117
66.
Tarazona S, Garcia-Alcalde F, Dopazo J, Ferrer A, Conesa A. 2011 Differential expression in RNA-seq: a matter of depth. Genome Res 21: 2213–2223.
Not in our library10.1101/gr.124321.111
67.
Trapnell C, Salzberg SL. 2009 How to map billions of short reads onto genomes. Nat Biotechnol 27: 455–457.
Not in our library10.1038/nbt0509-455
68.
Trapnell C, Pachter L, Salzberg SL. 2009 TopHat: discovering splice junctions with RNA-Seq. Bioinformatics 25: 1105–1111.
Not in our library10.1093/bioinformatics/btp120
69.
Trapnell C, Roberts A, Goff L, Pertea G, Kim D, Kelley DR, Pimentel H, Salzberg SL, Rinn JL, Pachter L. 2012 Differential gene and transcript expression analysis of RNA-seq experiments with TopHat and Cufflinks. Nat Protoc 7: 562–578.
Not in our library10.1038/nprot.2012.016
70.
Wang ET, Sandberg R, Luo S, Khrebtukova I, Zhang L, Mayr C, Kingsmore SF, Schroth GP, Burge CB. 2008 Alternative isoform regulation in human tissue transcriptomes. Nature 456: 470–476.
Not in our library10.1038/nature07509
71.
Wang L, Feng Z, Wang X, Wang X, Zhang X. 2010 DEGseq: an R package for identifying differentially expressed genes from RNA-seq data. Bioinformatics 26: 136–138.
Not in our library10.1093/bioinformatics/btp612

Cited by papers we hold 15

Applications of multi‐omics analysis in human diseases · 2023
No notice
Secreted Amyloid Precursor Protein Alpha, a Neuroprotective Protein in the Brain Has Widespread Effects on the Transcriptome and Proteome of Human Inducible Pluripotent Stem Cell-Derived Glutamatergic Neurons Related to Memory Mechanisms · 2022
Not checked
Divergence of X-linked trans regulatory proteins and the misexpression of gene targets in sterile Drosophila pseudoobscura hybrids · 2022
Not checked
A simple guide to de novo transcriptome assembly and annotation · 2022
No notice
Exaggerated false positives by popular differential expression methods when analyzing human population samples · 2022
No notice
Population Genetic Structure and Gene Expression Plasticity of the Deep-Sea Vent and Seep Squat Lobster Shinkaia crosnieri · 2020
Not checked
Limits in the detection of m6A changes using MeRIP/m6A-seq · 2020
No notice
Full-length transcript characterization of SF3B1 mutation in chronic lymphocytic leukemia reveals downregulation of retained introns · 2020
No notice
West Nile virus infection and interferon alpha treatment alter the spectrum and the levels of coding and noncoding host RNAs secreted in extracellular vesicles · 2019
Not checked
Large-scale sequence comparisons with sourmash · 2019
No notice
PCR and Omics Based Techniques to Study the Diversity, Ecology and Biology of Anaerobic Fungi: Insights, Challenges and Opportunities · 2017
Not checked
Multi-omics approaches to disease · 2017
No notice
Resolving host–pathogen interactions by dual RNA-seq · 2017
No notice
RNA-Seq differential expression analysis: An extended review and a software tool · 2017
No notice
From reads to genes to pathways: differential expression analysis of RNA-Seq experiments using Rsubread and the edgeR quasi-likelihood pipeline · 2016
No notice

Reads

Read by people on this page

None yet.

Checked or read by AI through naulon

None yet.

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.

Are you an author?

Is this your paper?

Claim it to add your note and be paid when agents cite it. Free.