Protein Secondary Structure Prediction Using Deep Convolutional Neural Fields

Abstract

Protein secondary structure (SS) prediction is important for studying protein structure and function. When only the sequence (profile) information is used as input feature, currently the best predictors can obtain ~80% Q3 accuracy, which has not been improved in the past decade. Here we present DeepCNF (Deep Convolutional Neural Fields) for protein SS prediction. DeepCNF is a Deep Learning extension of Conditional Neural Fields (CNF), which is an integration of Conditional Random Fields (CRF) and shallow neural networks. DeepCNF can model not only complex sequence-structure relationship by a deep hierarchical architecture, but also interdependency between adjacent SS labels, so it is much more powerful than CNF. Experimental results show that DeepCNF can obtain ~84% Q3 accuracy, ~85% SOV score and ~72% Q8 accuracy, respectively, on the CASP and CAMEO test proteins, greatly outperforming currently popular predictors. As a general framework, DeepCNF can be used to predict other protein structure properties such as contact number, disorder regions and solvent accessibility.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 79

1. 1.

   Baker D. & Sali A. Protein structure prediction and structural genomics. Science 294, 93–96 (2001 ).

   Not in our library10.1126/science.1065659

2. 2.

   Dill K. A. & MacCallum J. L. The protein-folding problem, 50 years on. Science 338, 1042–1046 (2012 ).

   Not in our library10.1126/science.1219021

3. 3.

   Petsko G. A. & Ringe D. Protein structure and function. (New Science Press, 2004 ).

   Not in our library

4. 4.

   Whittle P. J. & Blundell T. L. Protein structure-based drug design. Annu. Rev. Biophys. Biomol. Struct. 23, 349–375 (1994 ).

   Not in our library10.1146/annurev.bb.23.060194.002025

5. 5.

   Schaffhausen J. Advances in structure-based drug design. Trends Pharmacol. Sci. 33, 223 (2012 ).

   Not in our library10.1016/j.tips.2012.03.011

6. 6.

   Whisstock J. C. & Lesk A. M. Prediction of protein function from protein sequence and structure. Q. Rev. Biophys. 36, 307–340 (2003 ).

   Not in our library10.1017/s0033583503003901

7. 7.

   Lee D., Redfern O. & Orengo C. Predicting protein function from sequence and structure. Nat. Rev. Mol. Cell Biol. 8, 995–1005 (2007 ).

   Not in our library10.1038/nrm2281

8. 8.

   Radivojac P. et al. A large-scale evaluation of computational protein function prediction. Nat. Methods 10, 221–227 (2013 ).

   Not in our library10.1038/nmeth.2340

9. 9.

   Rost B., Yachdav G. & Liu J. The predictprotein server. Nucleic Acids Res. 32, W321–W326 (2004 ).

   Not in our library10.1093/nar/gkh377

10. 10.

    Lin K., Simossis V. A., Taylor W. R. & Heringa J. A simple and fast secondary structure prediction method using hidden neural networks. Bioinformatics 21, 152–159 (2005 ).

    Not in our library10.1093/bioinformatics/bth487

11. 11.

    Yoo P. D., Zhou B. B. & Zomaya A. Y. Machine learning techniques for protein secondary structure prediction: an overview and evaluation. Current Bioinformatics 3, 74–86 (2008 ).

    Not in our library

12. 12.

    Faraggi E., Zhang T., Yang Y., Kurgan L. & Zhou Y. SPINE X: improving protein secondary structure prediction by multistep learning coupled with prediction of solvent accessible surface area and backbone torsion angles. J. Comp. Chem. 33, 259–267 (2012 ).

    Not in our library10.1002/jcc.21968

13. 13.

    Pauling L., Corey R. B. & Branson H. R. The structure of proteins: two hydrogen-bonded helical configurations of the polypeptide chain. Proc. Natl. Acad. Sci. USA 37, 205–211 (1951 ).

    Not in our library10.1073/pnas.37.4.205

14. 14.

    Kabsch W. & Sander C. Dictionary of protein secondary structure: pattern recognition of hydrogen - bonded and geometrical features. Biopolymers 22, 2577–2637 (1983 ).

    Not in our library10.1002/bip.360221211

15. 15.

    Myers J. K. & Oas T. G. Preorganized secondary structure as an important determinant of fast protein folding. Nat. Struct. Mol. Biol. 8, 552–558 (2001 ).

    Not in our library10.1038/88626

16. 16.

    Källberg M. et al. Template-based protein structure modeling using the RaptorX web server. Nature protocols 7, 1511–1522 (2012 ).

    Not in our library10.1038/nprot.2012.085

17. 17.
    I-TASSER server for protein 3D structure prediction · 2008

    No notice
18. 18.

    Simons K. T., Kooperberg C., Huang E. & Baker D. Assembly of protein tertiary structures from fragments with similar local sequences using simulated annealing and Bayesian scoring functions. J. Mol. Biol. 268, 209–225 (1997 ).

    Not in our library10.1006/jmbi.1997.0959

19. 19.

    Holley L. H. & Karplus M. Protein secondary structure prediction with a neural network. Proc. Natl. Acad. Sci. USA 86, 152–156 (1989 ).

    Not in our library10.1073/pnas.86.1.152

20. 20.

    Qian N. & Sejnowski T. J. Predicting the secondary structure of globular proteins using neural network models. J. Mol. Biol. 202, 865–884 (1988 ).

    Not in our library10.1016/0022-2836(88)90564-5

21. 21.

    Kneller D., Cohen F. & Langridge R. Improvements in protein secondary structure prediction by an enhanced neural network. J. Mol. Biol. 214, 171–182 (1990 ).

    Not in our library10.1016/0022-2836(90)90154-e

22. 22.

    Asai K., Hayamizu S. & Handa K. I. Prediction of protein secondary structure by the hidden Markov model. Comput. Appl. Biosci. 9, 141–146 (1993 ).

    Not in our library10.1093/bioinformatics/9.2.141

23. 23.

    Rost B. & Sander C. Prediction of protein secondary structure at better than 70% accuracy. J. Mol. Biol. 232, 584–599 (1993 ).

    Not in our library10.1006/jmbi.1993.1413

24. 24.

    Jones D. T. Protein secondary structure prediction based on position-specific scoring matrices. J. Mol. Biol. 292, 195–202 (1999 ).

    Not in our library10.1006/jmbi.1999.3091

25. 25.

    Schmidler S. C., Liu J. S. & Brutlag D. L. Bayesian segmentation of protein secondary structure. J. Comput. Biol. 7, 233–248 (2000 ).

    Not in our library10.1089/10665270050081496

26. 26.

    Pollastri G., Przybylski D., Rost B. & Baldi P. Improving the prediction of protein secondary structure in three and eight classes using recurrent neural networks and profiles. Proteins: Struct. Funct. Bioinform. 47, 228–235 (2002 ).

    Not in our library10.1002/prot.10082

27. 27.

    Kim H. & Park H. Protein secondary structure prediction based on an improved support vector machines approach. Protein Eng. 16, 553–560 (2003 ).

    Not in our library10.1093/protein/gzg072

28. 28.

    Ward J. J., McGuffin L. J., Buxton B. F. & Jones D. T. Secondary structure prediction with support vector machines. Bioinformatics 19, 1650–1655 (2003 ).

    Not in our library10.1093/bioinformatics/btg223

29. 29.

    Chu W., Ghahramani Z. & Wild D. L. A graphical model for protein secondary structure prediction. Proceedings of the Twenty-first International Conference (ICML 2004), Banff, Alberta, Canada, July 4-8, 2004. ACM International Conference Proceeding Series 69, ACM 2004, 21 (2004 ).

    Not in our library

30. 30.

    Guo J., Chen H., Sun Z. & Lin Y. A novel method for protein secondary structure prediction using dual - layer SVM and profiles. Proteins: Struct. Funct. Bioinform. 54, 738–743 (2004 ).

    Not in our library10.1002/prot.10634

31. 31.

    Aydin Z., Altunbasak Y. & Borodovsky M. Protein secondary structure prediction for a single-sequence using hidden semi-Markov models. BMC Bioinformatics 7, 178 (2006 ).

    Not in our library10.1186/1471-2105-7-178

32. 32.

    Im I. G. Predicting Protein Secondary Structure Using Markov Chain Monte-Carlo Simulation. (ProQuest, 2008 ).

    Not in our library

33. 33.

    Wang Z., Zhao F., Peng J. & Xu J. Protein 8 - class secondary structure prediction using conditional neural fields. Proteomics 11, 3786–3792 (2011 ).

    Not in our library10.1002/pmic.201100196

34. 34.

    Magnan C. N. & Baldi P. SSpro/ACCpro 5: almost perfect prediction of protein secondary structure and relative solvent accessibility using profiles, machine learning and structural similarity. Bioinformatics 30, 2592–2597 (2014 ).

    Not in our library10.1093/bioinformatics/btu352

35. 35.

    Zvelebil M. J., Barton G. J., Taylor W. R. & Sternberg M. J. Prediction of protein secondary structure and active sites using the alignment of homologous sequences. J. Mol. Biol. 195, 957–961 (1987 ).

    Not in our library10.1016/0022-2836(87)90501-8

36. 36.

    Zhou J. & Troyanskaya O. Deep Supervised and Convolutional Generative Stochastic Network for Protein Secondary Structure Prediction. Proceedings of the 31th International Conference on Machine Learning, ICML 2014, Beijing, China, 21-26 June 2014. JMLR Proceedings 32, 745-753 (2014 ).

    Not in our library

37. 37.

    Baldi P., Brunak S., Frasconi P., Soda G. & Pollastri G. Exploiting the past and the future in protein secondary structure prediction. Bioinformatics 15, 937–946 (1999 ).

    Not in our library10.1093/bioinformatics/15.11.937

38. 38.

    Higgins D. G. & Sharp P. M. CLUSTAL: a package for performing multiple sequence alignment on a microcomputer. Gene 73, 237–244 (1988 ).

    Not in our library10.1016/0378-1119(88)90330-7

39. 39.

    Edgar R. C. MUSCLE: multiple sequence alignment with high accuracy and high throughput. Nucleic Acids Res. 32, 1792–1797 (2004 ).

    Not in our library10.1093/nar/gkh340

40. 40.

    Thompson J. D., Higgins D. G. & Gibson T. J. CLUSTAL W: improving the sensitivity of progressive multiple sequence alignment through sequence weighting, position-specific gap penalties and weight matrix choice. Nucleic Acids Res. 22, 4673–4680 (1994 ).

    Not in our library10.1093/nar/22.22.4673

41. 41.

    Altschul S. F. et al. Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Res. 25, 3389–3402 (1997 ).

    Not in our library10.1093/nar/25.17.3389

42. 42.

    Maaten L., Welling M. & Saul L. K. Hidden-unit conditional random fields. Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, AISTATS 2011, Fort Lauderdale, USA, April 11-13, 2011. JMLR Proceedings 15, 479-488 (2011 ).

    Not in our library

43. 43.

    Hua S. & Sun Z. A novel method of protein secondary structure prediction with high segment overlap measure: support vector machine approach. J. Mol. Biol. 308, 397–407 (2001 ).

    Not in our library10.1006/jmbi.2001.4580

44. 44.

    Spencer M., Eickholt J. & Cheng J. A Deep Learning Network Approach to ab initio Protein Secondary Structure Prediction. IEEE/ACM Trans. Comput. Biol. Bioinform. 12, 103–112 (2015 ).

    Not in our library10.1109/tcbb.2014.2343960

45. 45.

    Hinton G. E. & Salakhutdinov R. R. Reducing the dimensionality of data with neural networks. Science 313, 504–507 (2006 ).

    Not in our library10.1126/science.1127647

46. 46.

    Hinton G. Training products of experts by minimizing contrastive divergence. Neural Comput. 14, 1771–1800 (2002 ).

    Not in our library10.1162/089976602760128018

47. 47.
    JPred4: a protein secondary structure prediction server · 2015

    No notice
48. 48.

    Cuff J. A., Clamp M. E., Siddiqui A. S., Finlay M. & Barton G. J. JPred: a consensus secondary structure prediction server. Bioinformatics 14, 892–893 (1998 ).

    Not in our library10.1093/bioinformatics/14.10.892

49. 49.

    Zemla A., Venclovas Č., Fidelis K. & Rost B. A modified definition of Sov, a segment - based measure for protein secondary structure prediction assessment. Proteins: Struct. Funct. Bioinform. 34, 220–223 (1999 ).

    Not in our library10.1002/(sici)1097-0134(19990201)34:2<220::aid-prot7>3.0.co;2-k

50. 50.

    Peng J., Bo L. & Xu J. Conditional neural fields. Advances in Neural Information Processing Systems 22: 23rd Annual Conference on Neural Information Processing Systems 2009. Proceedings of a meeting held 7-10 December 2009, Vancouver, British Columbia, Canada. Curran Associates, Inc. 2009, 1419-1427 (2009 ).

    Not in our library

51. 51.

    Lee H., Grosse R., Ranganath R. & Ng A. Y. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. Proceedings of the 26th Annual International Conference on Machine Learning, ICML 2009, Montreal, Quebec, Canada, June 14-18, 2009. ACM International Conference Proceeding Series 382, ACM 2009, 609-616 (2009 ).

    Not in our library

52. 52.

    Lafferty J., McCallum A. & Pereira F. C. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. Proceedings of the Eighteenth International Conference on Machine Learning (ICML 2001), Williams College, Williamstown, MA, USA, June 28 - July 1, 2001. Morgan Kaufmann 2001 (2001 ).

    Not in our library

53. 53.

    Wang G. & Dunbrack R. L. PISCES: a protein sequence culling server. Bioinformatics 19, 1589–1591 (2003 ).

    Not in our library10.1093/bioinformatics/btg224

54. 54.

    Kryshtafovych A. et al. Assessment of the assessment: evaluation of the model quality estimates in CASP10. Proteins: Struct. Funct. Bioinform. 82, 112–126 (2014 ).

    Not in our library10.1002/prot.24347

55. 55.

    Moult J., Fidelis K., Kryshtafovych A., Schwede T. & Tramontano A. Critical assessment of methods of protein structure prediction (CASP)—round x. Proteins: Struct. Funct. Bioinform. 82, 1–6 (2014 ).

    Not in our library10.1002/prot.24452

56. 56.
    CATH: comprehensive structural and functional annotations for genome sequences · 2014

    No notice
57. 57.
    SCOP2 prototype: a new approach to protein structure mining · 2013

    No notice
58. 58.

    Andersen C. A., Bohr H. & Brunak S. Protein secondary structure: category assignment and predictability. FEBS Lett. 507, 6–10 (2001 ).

    Not in our library10.1016/s0014-5793(01)02910-6

59. 59.

    Penel S., Morrison R. G., Dobson P. D., Mortishire - Smith R. J. & Doig A. J. Length preferences and periodicity in β - strands. Antiparallel edge β - sheets are more likely to finish in non - hydrogen bonded rings. Protein Eng. 16, 957–961 (2003 ).

    Not in our library10.1093/protein/gzg147

60. 60.

    Sha F. & Pereira F. Shallow parsing with conditional random fields. HLT-NAACL 2003, Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, May 27 - June 1, Edmonton, Canada, 134-141 (2003 ).

    Not in our library

61. 61.

    Wang S. B., Quattoni A., Morency L., Demirdjian D. & Darrell T. Hidden conditional random fields for gesture recognition. 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2006), 17-22 June 2006, New York, NY, USA. IEEE Computer Society 2006 2, 1521-1527 (2006 ).

    Not in our library

62. 62.

    Taskar B., Guestrin C. & Koller D. Max-margin Markov networks. Advances in Neural Information Processing Systems 16 [Neural Information Processing Systems, NIPS 2003, December 8-13, 2003, Vancouver and Whistler, British Columbia, Canada]. MIT Press 2004 16, 25 (2004 ).

    Not in our library

63. 63.

    Joo K., Lee S. J. & Lee J. Sann: Solvent accessibility prediction of proteins by nearest neighbor method. Proteins: Struct. Funct. Bioinform. 80, 1791–1797 (2012 ).

    Not in our library10.1002/prot.24074

64. 64.

    Faraggi E., Xue B. & Zhou Y. Improving the prediction accuracy of residue solvent accessibility and real - value backbone torsion angles of proteins by guided - learning through a two - layer neural network. Proteins: Struct. Funct. Bioinform. 74, 847–856 (2009 ).

    Not in our library10.1002/prot.22193

65. 65.

    Kinjo A. R., Horimoto K. & Nishikawa K. Predicting absolute contact numbers of native protein structure from amino acid sequence. Proteins: Struct. Funct. Bioinform. 58, 158–165 (2005 ).

    Not in our library10.1002/prot.20300

66. 66.

    Wang S. & Zheng W.-M. CLePAPS: fast pair alignment of protein structures based on conformational letters. J. Bioinf. Comput. Biol. 6, 347–366 (2008 ).

    Not in our library10.1142/s0219720008003461

67. 67.

    Wang S. & Zheng W.-M. Fast multiple alignment of protein structures using conformational letter blocks. Open Bioinformatics Journal 3, 69–83 (2009 ).

    Not in our library

68. 68.

    Wang S., Ma J., Peng J. & Xu J. Protein structure alignment beyond spatial proximity. Scientific reports 3 (2013 ).

    Not in our library10.1038/srep01448

69. 69.

    Zheng W.-M. The use of a conformational alphabet for fast alignment of protein structures. Bioinformatics Research and Applications, 331–342 (2008 ).

    Not in our library

70. 70.

    Cheng J., Sweredoski M. J. & Baldi P. Accurate prediction of protein disordered regions by mining protein structure data. Data Min. Knowl. Disc. 11, 213–222 (2005 ).

    Not in our library

71. 71.

    Ward J. J., McGuffin L. J., Bryson K., Buxton B. F. & Jones D. T. The DISOPRED server for the prediction of protein disorder. Bioinformatics 20, 2138–2139 (2004 ).

    Not in our library10.1093/bioinformatics/bth195

72. 72.

    Dosztányi Z., Csizmok V., Tompa P. & Simon I. IUPred: web server for the prediction of intrinsically unstructured regions of proteins based on estimated energy content. Bioinformatics 21, 3433–3434 (2005 ).

    Not in our library10.1093/bioinformatics/bti541

73. 73.

    Ma J., Peng J., Wang S. & Xu J. A conditional neural fields model for protein threading. Bioinformatics 28, i59–i66 (2012 ).

    Not in our library10.1093/bioinformatics/bts213

74. 74.

    Ma J., Wang S., Zhao F. & Xu J. Protein threading using context-specific alignment potential. Bioinformatics 29, i257–i265 (2013 ).

    Not in our library10.1093/bioinformatics/btt210

75. 75.

    Ma J., Wang S., Wang Z. & Xu J. MRFalign: protein homology detection through alignment of Markov random fields. PLoS Comp. Biol. 10, e1003500 (2014 ).

    Not in our library10.1371/journal.pcbi.1003500

76. 76.

    Benkert P., Künzli M. & Schwede T. QMEAN server for protein model quality estimation. Nucleic Acids Res., gkp322 (2009 ).

    Not in our library10.1093/nar/gkp322

77. 77.

    Zhao F. & Xu J. A position-specific distance-dependent statistical potential for protein structure and functional study. Structure 20, 1118–1126 (2012 ).

    Not in our library10.1016/j.str.2012.04.003

78. 78.

    Liu D. C. & Nocedal J. On the limited memory BFGS method for large scale optimization. Mathematical programming 45, 503–528 (1989 ).

    Not in our library

79. 79.

    Consortium, U. The universal protein resource (UniProt). Nucleic Acids Res. 36, D190–D195 (2008 ).

    Not in our library10.1093/nar/gkm895

Cited by papers we hold 14

• Reaching alignment-profile-based accuracy in predicting protein secondary and tertiary structural properties without alignment · 2022
  Not checked
• Simple biochemical features underlie transcriptional activation domain diversity and dynamic, fuzzy binding to Mediator · 2021
  No notice
• Generating functional protein variants with variational autoencoders · 2021
  No notice
• Non-adaptive Evolution of Trimeric Autotransporters in Brucellaceae · 2020
  Not checked
• Deep Learning in Proteomics · 2020
  No notice
• Deep learning methods in protein structure prediction · 2020
  No notice
• Optimized CRISPR guide RNA design for two high-fidelity Cas9 variants by deep learning · 2019
  No notice
• Modeling aspects of the language of life through transfer-learning protein sequences · 2019
  No notice
• In-silico design of a multi-epitope vaccine candidate against onchocerciasis and related filarial diseases · 2019
  No notice
• Improving prediction of phenotypic drug response on cancer cell lines using deep convolutional network · 2019
  No notice
• Opportunities and obstacles for deep learning in biology and medicine · 2018
  No notice
• Sequence-based prediction of protein protein interaction using a deep-learning algorithm · 2017
  No notice
• Accurate De Novo Prediction of Protein Contact Map by Ultra-Deep Learning Model · 2017
  No notice
• Self-Recalibrating Surface EMG Pattern Recognition for Neuroprosthesis Control Based on Convolutional Neural Network · 2017
  No notice

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.