Gaussian Process Regression for Materials and Molecules

Abstract

We provide an introduction to Gaussian process regression (GPR) machine-learning methods in computational materials science and chemistry. The focus of the present review is on the regression of atomistic properties: in particular, on the construction of interatomic potentials, or force fields, in the Gaussian Approximation Potential (GAP) framework; beyond this, we also discuss the fitting of arbitrary scalar, vectorial, and tensorial quantities. Methodological aspects of reference data generation, representation, and regression, as well as the question of how a data-driven model may be validated, are reviewed and critically discussed. A survey of applications to a variety of research questions in chemistry and materials science illustrates the rapid growth in the field. A vision is outlined for the development of the methodology in the years to come.

References 420

1. 1.

   Brown T. E.; LeMay H. E.; Bursten B. E.; Murphy C.; Woodward P.; Stoltzfus M. E. Chemistry: The Central Science, 14th ed.; Pearson: New York, 2018.

   Not in our library

2. 2.
   The Centrality of Chemistry · 2015

   Not checked
3. 3.

   Alberi K.; Nardelli M. B.; Zakutayev A.; Mitas L.; Curtarolo S.; Jain A.; Fornari M.; Marzari N.; Takeuchi I.; Green M. L.; et al. The 2019 Materials by Design Roadmap. J. Phys. D: Appl. Phys. 2019, 52, 013001.

   Not in our library10.1088/1361-6463/aad926 (opens in a new tab)

4. 4.

   Oganov A. R.; Pickard C. J.; Zhu Q.; Needs R. J. Structure Prediction Drives Materials Discovery. Nat. Rev. Mater. 2019, 4, 331–348..

   Not in our library10.1038/s41578-019-0101-8 (opens in a new tab)

5. 5.

   Zhang W.; Mazzarello R.; Wuttig M.; Ma E. Designing Crystallization in Phase-Change Materials for Universal Memory and Neuro-Inspired Computing. Nat. Rev. Mater. 2019, 4, 150–168..

   Not in our library10.1038/s41578-018-0076-x (opens in a new tab)

6. 6.

   Tabor D. P.; Roch L. M.; Saikin S. K.; Kreisbeck C.; Sheberla D.; Montoya J. H.; Dwaraknath S.; Aykol M.; Ortiz C.; Tribukait H.; Amador-Bedolla C.; Brabec B.; Maruyama C. J.; Persson K. A.; Aspuru-Guzik A. Accelerating the Discovery of Materials for Clean Energy in the Era of Smart Automation. Nat. Rev. Mater. 2018, 3, 5–20..

   Not in our library10.1038/s41578-018-0005-z (opens in a new tab)

7. 7.

   Louie S. G.; Chan Y.-H.; da Jornada F. H.; Li Z.; Qiu D. Y. Discovering and Understanding Materials Through Computation. Nat. Mater. 2021, 20, 728–735..

   Not in our library10.1038/s41563-021-01015-1 (opens in a new tab)

8. 8.

   Marzari N.; Ferretti A.; Wolverton C. Electronic-Structure Methods for Materials Design. Nat. Mater. 2021, 20, 736–749..

   Not in our library10.1038/s41563-021-01013-3 (opens in a new tab)

9. 9.

   Burke K. Perspective on Density Functional Theory. J. Chem. Phys. 2012, 136, 150901.

   Not in our library10.1063/1.4704546 (opens in a new tab)

10. 10.

    Jones R. O. Density Functional Theory: Its Origins, Rise to Prominence, and Future. Rev. Mod. Phys. 2015, 87, 897–923..

    Not in our library10.1103/revmodphys.87.897 (opens in a new tab)

11. 11.

    Maurer R. J.; Freysoldt C.; Reilly A. M.; Brandenburg J. G.; Hofmann O. T.; Björkman T.; Lebègue S.; Tkatchenko A. Advances in Density-Functional Calculations for Materials Modeling. Annu. Rev. Mater. Res. 2019, 49, 1–30..

    Not in our library10.1146/annurev-matsci-070218-010143 (opens in a new tab)

12. 12.

    Bonhomme C.; Gervais C.; Babonneau F.; Coelho C.; Pourpoint F.; Azaïs T.; Ashbrook S. E.; Griffin J. M.; Yates J. R.; Mauri F.; Pickard C. J. First-Principles Calculation of NMR Parameters Using the Gauge Including Projector Augmented Wave Method: A Chemist’s Point of View. Chem. Rev. 2012, 112, 5733–5779..

    Not in our library10.1021/cr300108a (opens in a new tab)

13. 13.

    Lejaeghere K.; Bihlmayer G.; Björkman T.; Blaha P.; Blügel S.; Blum V.; Caliste D.; Castelli I. E.; Clark S. J.; Dal Corso A.; et al. Reproducibility in Density Functional Theory Calculations of Solids. Science 2016, 351, aad3000.

    Not in our library10.1126/science.aad3000 (opens in a new tab)

14. 14.

    Prentice J. C. A.; Aarons J.; Womack J. C.; Allen A. E. A.; Andrinopoulos L.; Anton L.; Bell R. A.; Bhandari A.; Bramley G. A.; Charlton R. J.; et al. The ONETEP linear-scaling density functional theory program. J. Chem. Phys. 2020, 152, 174111.

    Not in our library10.1063/5.0004445 (opens in a new tab)

15. 15.

    Del Ben M.; Schönherr M.; Hutter J.; Vandevondele J. Bulk Liquid Water at Ambient Temperature and Pressure from Mp2 Theory. J. Phys. Chem. Lett. 2013, 4, 3753–3759..

    Not in our library10.1021/jz401931f (opens in a new tab)

16. 16.

    Zen A.; Luo Y.; Mazzola G.; Guidoni L.; Sorella S. Ab Initio Molecular Dynamics Simulation of Liquid Water by Quantum Monte Carlo. J. Chem. Phys. 2015, 142, 144111.

    Not in our library10.1063/1.4917171 (opens in a new tab)

17. 17.

    Wilhelm J.; VandeVondele J.; Rybkin V. V. Dynamics of the Bulk Hydrated Electron from Many-Body Wave-Function Theory. Angew. Chem., Int. Ed. 2019, 58, 3890–3893..

    Not in our library10.1002/anie.201814053 (opens in a new tab)

18. 18.

    Zhou Y.; Sun L.; Zewdie G. M.; Mazzarello R.; Deringer V. L.; Ma E.; Zhang W. Bonding Similarities and Differences between Y-Sb-Te and Sc-Sb-Te Phase-Change Memory Materials. J. Mater. Chem. C 2020, 8, 3646–3654..

    Not in our library10.1039/d0tc00096e (opens in a new tab)

19. 19.

    George J.; Hautier G. Chemist versus Machine: Traditional Knowledge versus Machine Learning Techniques. Trends Chem. 2021, 3, 86–95..

    Not in our library10.1016/j.trechm.2020.10.007 (opens in a new tab)

20. 20.

    Butler K. T.; Davies D. W.; Cartwright H.; Isayev O.; Walsh A. Machine Learning for Molecular and Materials Science. Nature2018, 559, 547–555.

    Not in our library10.1038/s41586-018-0337-2 (opens in a new tab)

21. 21.
    Data‐Driven Materials Science: Status, Challenges, and Perspectives · 2019

    Corrected
22. 22.

    Batra R.; Song L.; Ramprasad R. Emerging Materials Intelligence Ecosystems Propelled by Machine Learning. Nat. Rev. Mater. 2020, 1–24..

    Not in our library10.1038/s41578-020-00255-y (opens in a new tab)

23. 23.

    Ramprasad R.; Batra R.; Pilania G.; Mannodi-Kanakkithodi A.; Kim C. Machine Learning in Materials Informatics: Recent Applications and Prospects. npj Comput. Mater. 2017, 3, 54.

    Not in our library10.1038/s41524-017-0056-5 (opens in a new tab)

24. 24.

    Schmidt J.; Marques M. R. G.; Botti S.; Marques M. A. L. Recent Advances and Applications of Machine Learning in Solid-State Materials Science. npj Comput. Mater. 2019, 5, 83.

    Not in our library10.1038/s41524-019-0221-0 (opens in a new tab)

25. 25.

    Schleder G. R.; Padilha A. C. M.; Acosta C. M.; Costa M.; Fazzio A. From DFT to Machine Learning: Recent Approaches to Materials Science - A Review. J. Phys.: Mater. 2019, 2, 032001.

    Not in our library10.1088/2515-7639/ab084b (opens in a new tab)

26. 26.

    Dral P. O. Quantum Chemistry in the Age of Machine Learning. J. Phys. Chem. Lett. 2020, 11, 2336–2347..

    Not in our library10.1021/acs.jpclett.9b03664 (opens in a new tab)

27. 27.

    Carleo G.; Cirac I.; Cranmer K.; Daudet L.; Schuld M.; Tishby N.; Vogt-Maranto L.; Zdeborová L. Machine Learning and the Physical Sciences. Rev. Mod. Phys. 2019, 91, 045002.

    Not in our library10.1103/revmodphys.91.045002 (opens in a new tab)

28. 28.

    Behler J. First Principles Neural Network Potentials for Reactive Simulations of Large Molecular and Condensed Systems. Angew. Chem., Int. Ed. 2017, 56, 12828–12840..

    Not in our library10.1002/anie.201703114 (opens in a new tab)

29. 29.

    Deringer V. L.; Caro M. A.; Csányi G. Machine Learning Interatomic Potentials as Emerging Tools for Materials Science. Adv. Mater. 2019, 31, 1902765.

    Not in our library10.1002/adma.201902765 (opens in a new tab)

30. 30.

    Noé F.; Tkatchenko A.; Müller K.-R.; Clementi C. Machine Learning for Molecular Simulation. Annu. Rev. Phys. Chem. 2020, 71, 361–390..

    Not in our library10.1146/annurev-physchem-042018-052331 (opens in a new tab)

31. 31.

    Friederich P.; Häse F.; Proppe J.; Aspuru-Guzik A. Machine-Learned Potentials for Next-Generation Matter Simulations. Nat. Mater. 2021, 20, 750–761..

    Not in our library10.1038/s41563-020-0777-6 (opens in a new tab)

32. 32.

    Kamath A.; Vargas-Hernández R. A.; Krems R. V.; Carrington T.; Manzhos S. Neural Networks vs Gaussian Process Regression for Representing Potential Energy Surfaces: A Comparative Study of Fit Quality and Vibrational Spectrum Accuracy. J. Chem. Phys. 2018, 148, 241702.

    Not in our library10.1063/1.5003074 (opens in a new tab)

33. 33.

    Zuo Y.; Chen C.; Li X.; Deng Z.; Chen Y.; Behler J.; Csányi G.; Shapeev A. V.; Thompson A. P.; Wood M. A.; Ong S. P. Performance and Cost Assessment of Machine Learning Interatomic Potentials. J. Phys. Chem. A 2020, 124, 731–745..

    Not in our library10.1021/acs.jpca.9b08723 (opens in a new tab)

34. 34.

    Bartók A. P.; Csányi G. Gaussian Approximation Potentials: A Brief Tutorial Introduction. Int. J. Quantum Chem. 2015, 115, 1051–1057..

    Not in our library10.1002/qua.24927 (opens in a new tab)

35. 35.

    Behler J. Perspective: Machine Learning Potentials for Atomistic Simulations. J. Chem. Phys. 2016, 145, 170901.

    Not in our library10.1063/1.4966192 (opens in a new tab)

36. 36.

    Chan H.; Narayanan B.; Cherukara M. J.; Sen F. G.; Sasikumar K.; Gray S. K.; Chan M. K. Y.; Sankaranarayanan S. K. R. S. Machine Learning Classical Interatomic Potentials for Molecular Dynamics from First-Principles Training Data. J. Phys. Chem. C 2019, 123, 6941–6957..

    Not in our library10.1021/acs.jpcc.8b09917 (opens in a new tab)

37. 37.

    Mueller T.; Hernandez A.; Wang C. Machine Learning for Interatomic Potential Models. J. Chem. Phys. 2020, 152, 050902.

    Not in our library10.1063/1.5126336 (opens in a new tab)

38. 38.

    Miksch A. M.; Morawietz T.; Kästner J.; Urban A.; Artrith N. Strategies for the Construction of Machine-Learning Potentials for Accurate and Efficient Atomic-Scale Simulations. Mach. Learn.: Sci. Technol.2021,.

    Not in our library10.1088/2632-2153/abfd96 (opens in a new tab)

39. 39.

    Rasmussen C. E.; Williams C. K. I. Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning); The MIT Press, 2006.

    Not in our library

40. 40.

    Schölkopf B.; Smola A. J. Learning with kernels: support vector machines, regularization, optimization, and beyond; MIT Press: Cambridge, Mass, 2002.

    Not in our library

Cited by papers we hold 5

• The design space of E(3)-equivariant atom-centred interatomic potentials · 2025
  No notice
• MACE-OFF: Short-Range Transferable Machine Learning Force Fields for Organic Molecules · 2025
  No notice
• Machine Learning Interatomic Potentials and Long-Range Physics · 2023
  No notice
• Integration of Machine Learning and Coarse-Grained Molecular Simulations for Polymer Materials: Physical Understandings and Molecular Design · 2022
  Not checked
• Implicit Solvation Methods for Catalysis at Electrified Interfaces · 2021
  No notice

Questions about this paper

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.