Large-Scale Quality Analysis of Published ChIP-seq Data

Abstract

ChIP-seq has become the primary method for identifying in vivo protein–DNA interactions on a genome-wide scale, with nearly 800 publications involving the technique appearing in PubMed as of December 2012. Individually and in aggregate, these data are an important and information-rich resource. However, uncertainties about data quality confound their use by the wider research community. Recently, the Encyclopedia of DNA Elements (ENCODE) project developed and applied metrics to objectively measure ChIP-seq data quality. The ENCODE quality analysis was useful for flagging datasets for closer inspection, eliminating or replacing poor data, and for driving changes in experimental pipelines. There had been no similarly systematic quality analysis of the large and disparate body of published ChIP-seq profiles. Here, we report a uniform analysis of vertebrate transcription factor ChIP-seq datasets in the Gene Expression Omnibus (GEO) repository as of April 1, 2012. The majority (55%) of datasets scored as being highly successful, but a substantial minority (20%) were of apparently poor quality, and another ∼25% were of intermediate quality. We discuss how different uses of ChIP-seq data are affected by specific aspects of data quality, and we highlight exceptional instances for which the metric values should not be taken at face value. Unexpectedly, we discovered that a significant subset of control datasets (i.e., no immunoprecipitation and mock immunoprecipitation samples) display an enrichment structure similar to successful ChIP-seq data. This can, in turn, affect peak calling and data interpretation. Published datasets identified here as high-quality comprise a large group that users can draw on for large-scale integrated analysis. In the future, ChIP-seq quality assessment similar to that used here could guide experimentalists at early stages in a study, provide useful input in the publication process, and be used to stratify ChIP-seq data for different community-wide uses.

Shown for reading. Its publisher allows quoting it, not republishing it.

References 203

1. 1.

   An C. I. Dong Y. Hagiwara N., 2011 Genome-wide mapping of Sox6 binding sites in skeletal muscle reveals both direct and indirect regulation of muscle terminal differentiation by Sox6. BMC Dev. Biol. 11: 59

   Not in our library10.1186/1471-213x-11-59

2. 2.

   Ang Y. S. Tsai S. Y. Lee D. F. Monk J. Su J., 2011 Wdr5 mediates self-renewal and reprogramming via the embryonic stem cell core transcriptional network. Cell 145: 183–197

   Not in our library10.1016/j.cell.2011.03.003

3. 3.

   Auerbach R. K. Euskirchen G. Rozowsky J. Lamarre-Vincent N. Moqtaderi Z., 2009 Mapping accessible chromatin regions using Sono-Seq. Proc. Natl. Acad. Sci. USA 106: 14926–14931

   Not in our library10.1073/pnas.0905443106

4. 4.

   Avvakumov N. Lalonde M. E. Saksouk N. Paquet E. Glass K. C., 2012 Conserved molecular interactions within the HBO1 acetyltransferase complexes regulate cell proliferation. Mol. Cell. Biol. 32: 689–703

   Not in our library10.1128/mcb.06455-11

5. 5.

   Barish G. D. Yu R. T. Karunasiri M. Ocampo C. B. Dixon J., 2010 Bcl-6 and NF-κB cistromes mediate opposing regulation of the innate immune response. Genes Dev. 24: 2760–2765

   Not in our library10.1101/gad.1998010

6. 6.

   Barish G. D. Yu R. T. Karunasiri M. S. Becerra D. Kim J., 2012 The Bcl6-SMRT/NCoR cistrome represses inflammation to attenuate atherosclerosis. Cell Metab. 15: 554–562

   Not in our library10.1016/j.cmet.2012.02.012

7. 7.

   Barski A. Cuddapah S. Cui K. Roh T. Schones D. E., 2007 High-resolution profiling of histone methylations in the human genome. Cell 129: 823837

   Not in our library10.1016/j.cell.2007.05.009

8. 8.

   Bergsland M. Ramsköld D. Zaouter C. Klum S. Sandberg R., 2011 Sequentially acting Sox transcription factors in neural lineage development. Genes Dev. 25: 2453–2464

   Not in our library10.1101/gad.176008.111

9. 9.

   Bernt K. M. Zhu N. Sinha A. U. Vempati S. Faber J., 2011 MLL-rearranged leukemia is dependent on aberrant H3K79 methylation by DOT1L. Cancer Cell 20: 66–78

   Not in our library10.1016/j.ccr.2011.06.010

10. 10.

    Bilodeau S. Kagey M. H. Frampton G. M. Rahl P. B. Young R. A., 2009 SetDB1 contributes to repression of genes encoding developmental regulators and maintenance of ES cell state. Genes Dev. 23: 2484–2489

    Not in our library10.1101/gad.1837309

11. 11.

    Blow M. J. McCulley D. J. Li Z. Zhang T. Akiyama J. A., 2010 ChIP-Seq identification of weakly conserved heart enhancers. Nat. Genet. 42: 806–810

    Not in our library10.1038/ng.650

12. 12.

    Boergesen M. Pedersen T. Å. Gross B. van Heeringen S. J. Hagenbeek D., 2012 Genome-wide profiling of liver X receptor, retinoid X receptor, and peroxisome proliferator-activated receptor a in mouse liver reveals extensive sharing of binding sites. Mol. Cell. Biol. 32: 852–867

    Not in our library10.1128/mcb.06175-11

13. 13.

    Botcheva K. McCorkle S. R. McCombie W. R. Dunn J. J. Anderson C. W., 2011 Distinct p53 genomic binding patterns in normal and cancer-derived human cells. Cell Cycle 10: 4237–4249

    Not in our library10.4161/cc.10.24.18383

14. 14.

    Brown S. Teo A. Pauklin S. Hannan N. Cho C. H., 2011 Activin/Nodal signaling controls divergent transcriptional networks in human embryonic stem cells and in endoderm progenitors. Stem Cells 29: 1176–1185

    Not in our library10.1002/stem.666

15. 15.

    Bugge A. Feng D. Everett L. J. Briggs E. R. Mullican S. E., 2011 Rev-erbα and Rev-erbβ coordinately protect the circadian clock and normal metabolic function. Genes Dev. 26: 657–667

    Not in our library10.1101/gad.186858.112

16. 16.

    Canella D. Bernasconi D. Gilardi F. LeMartelot G. Migliavacca E., 2012 A multiplicity of factors contributes to selective RNA polymerase III occupancy of a subset of RNA polymerase III genes in mouse liver. Genome Res. 22: 666–680

    Not in our library10.1101/gr.130286.111

17. 17.

    Cao L. Yu Y. Bilke S. Walker R. L. Mayeenuddin L. H., 2010 Genome-wide identification of PAX3-FKHR binding sites in rhabdomyosarcoma reveals candidate target genes important for development and cancer. Cancer Res. 70: 6497–6508

    Not in our library10.1158/0008-5472.can-10-0582

18. 18.

    Cardamone M. D. Krones A. Tanasa B. Taylor H. Ricci L., 2012 A protective strategy against hyperinflammatory responses requiring the nontranscriptional actions of GPS2. Mol. Cell 46: 91–104

    Not in our library10.1016/j.molcel.2012.01.025

19. 19.

    Ceol C. J. Houvras Y. Jane-Valbuena J. Bilodeau S. Orlando D. A., 2011 The histone methyltransferase SETDB1 is recurrently amplified in melanoma and accelerates its onset. Nature 471: 513–517

    Not in our library10.1038/nature09806

20. 20.

    Ceschin D. G. Walia M. Wenk S. S. Duboé C. Gaudon C., 2011 Methylation specifies distinct estrogen-induced binding site repertoires of CBP to chromatin. Genes Dev. 25: 1132–1146

    Not in our library10.1101/gad.619211

21. 21.

    Chen X. Xu H. Yuan P. Fang F. Huss M., 2008 Integration of external signaling pathways with the core transcriptional network in embryonic stem cells. Cell 133: 1106–1117

    Not in our library10.1016/j.cell.2008.04.043

22. 22.

    Cheng Y. Wu W. Kumar S. A. Yu D. Deng W., 2009 Erythroid GATA1 function revealed by genome-wide analysis of transcription factor occupancy, histone modifications, and mRNA expression. Genome Res. 19: 2172–2184

    Not in our library10.1101/gr.098921.109

23. 23.

    Cheng B. Li T. Rahl P. B. Adamson T. E. Loudas N. B., 2012 Functional association of Gdown1 with RNA polymerase II poised on human genes. Mol. Cell 45: 38–50

    Not in our library10.1016/j.molcel.2011.10.022

24. 24.

    Chi P. Chen Y. Zhang L. Guo X. Wongvipat J., 2010 ETV1 is a lineage survival factor that cooperates with KIT in gastrointestinal stromal tumours. Nature 467: 849–853

    Not in our library10.1038/nature09409

25. 25.

    Chia N. Y. Chan Y. S. Feng B. Lu X. Orlov Y. L., 2010 A genome-wide RNAi screen reveals determinants of human embryonic stem cell identity. Nature 468: 316–320

    Not in our library10.1038/nature09531

26. 26.

    Chicas A. Wang X. Zhang C. McCurrach M. Zhao Z., 2010 Dissecting the unique role of the retinoblastoma tumor suppressor during cellular senescence. Cancer Cell 17: 376–387

    Not in our library10.1016/j.ccr.2010.01.023

27. 27.

    Chlon T. M. Doré L. C. Crispino J. D., 2012 Cofactor-mediated restriction of GATA-1 chromatin occupancy coordinates lineage-specific gene expression. Mol. Cell 47: 608–621

    Not in our library10.1016/j.molcel.2012.05.051

28. 28.

    Cho H. Zhao X. Hatori M. Yu R. T. Barish G. D., 2012 Regulation of circadian behaviour and metabolism by REV-ERB-α and REV-ERB-β. Nature 485: 123–127

    Not in our library10.1038/nature11048

29. 29.

    Corbo J. C. Lawrence K. A. Karlstetter M. Myers C. A. Abdelaziz M., 2010 CRX ChIP-seq reveals the cis-regulatory architecture of mouse photoreceptors. Genome Res. 20: 1512–1525

    Not in our library10.1101/gr.109405.110

30. 30.

    Costessi A. Mahrour N. Tijchon E. Stunnenberg R. Stoel M. A., 2011 The tumour antigen PRAME is a subunit of a Cul2 ubiquitin ligase and associates with active NFY promoters. EMBO J. 30: 3786–3798

    Not in our library10.1038/emboj.2011.262

31. 31.

    Cuddapah S. Jothi R. Schones D. E. Roh T. Y. Cui K., 2009 Global analysis of the insulator binding protein CTCF in chromatin barrier regions reveals demarcation of active and repressive domains. Genome Res. 19: 24–32

    Not in our library10.1101/gr.082800.108

32. 32.

    De Santa F. Narang V. Yap Z. H. Tusi B. K. Burgold T., 2009 Jmjd3 contributes to the control of gene expression in LPS-activated macrophages. EMBO J. 28: 3341–3352

    Not in our library10.1038/emboj.2009.271

33. 33.

    Doré L. C. Chlon T. M. Brown C. D. White K. P. Crispino J. D., 2012 Chromatin occupancy analysis reveals genome-wide GATA factor switching during hematopoiesis. Blood 119: 3724–3733

    Not in our library10.1182/blood-2011-09-380634

34. 34.

    Durant L. Watford W. T. Ramos H. L. Laurence A. Vahedi G., 2010 Diverse targets of the transcription factor STAT3 contribute to T cell pathogenicity and homeostasis. Immunity 32: 605–615

    Not in our library10.1016/j.immuni.2010.05.003

35. 35.

    Ebert A. McManus S. Tagoh H. Medvedovic J. Salvagiotto G., 2011 The distal V(H) gene cluster of the Igh locus contains distinct regulatory elements with Pax5 transcription factor-dependent activity in pro-B cells. Immunity 34: 175–187

    Not in our library10.1016/j.immuni.2011.02.005

36. 36.
    A User's Guide to the Encyclopedia of DNA Elements (ENCODE) · 2011

    No notice
37. 37.

    ENCODE Project Consortium, 2012 An integrated encyclopedia of DNA elements in the human genome. Nature 489: 57–74

    Not in our library10.1038/nature11247

38. 38.

    Fan R. Bonde S. Gao P. Sotomayor B. Chen C., 2012 Dynamic HoxB4-regulatory network during embryonic stem cell differentiation to hematopoietic cells. Blood 119: e139–e147

    Not in our library10.1182/blood-2011-12-396754

39. 39.
    The SOX2 response program in glioblastoma multiforme: an integrated ChIP-seq, expression microarray, and microRNA analysis · 2011

    No notice
40. 40.

    Feng D. Liu T. Sun Z. Bugge A. Mullican S. E., 2011 A circadian rhythm orchestrated by histone deacetylase 3 controls hepatic lipid metabolism. Science 331: 1315–1319

    Not in our library10.1126/science.1198125

Cited by papers we hold 5

• Principles of RNA processing from analysis of enhanced CLIP maps for 150 RNA binding proteins · 2020
  No notice
• An atlas of dynamic chromatin landscapes in mouse fetal development · 2020
  Corrected
• Brd4 binds to active enhancers to control cell identity gene induction in adipogenesis and myogenesis · 2017
  No notice
• Characterization of the direct targets of FOXO transcription factors throughout evolution · 2016
  No notice
• Impact of artifact removal on ChIP quality metrics in ChIP-seq and ChIP-exo data · 2014
  No notice

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.