Skip to content
naulon

No retraction, correction or concern found when last checked on Oct 20, 2026.

Detecting and quantifying causal associations in large nonlinear time series datasets

Jakob Runge, Peer Nowack, Marlene Kretschmer and 2 more

Science Advances · 2019

doi:10.1126/sciadv.aau4996

Abstract

A novel causal discovery method for estimating nonlinear interdependency networks from large time series datasets.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

Read at PubMed Central

References 80

  1. 1.

    IPCC, Climate Change 2013: The Physical Science Basis (Cambridge Univ. Press, 2013).

    Not in our library

  2. 2.
  3. 3.

    G. Imbens, D. Rubin, Causal Inference in Statistics, Social, and Biomedical Sciences (Cambridge Univ. Press, 2015).

    Not in our library

  4. 4.

    J. Pearl, Causality: Models, Reasoning, and Inference (Cambridge Univ. Press, 2000).

    Not in our library

  5. 5.

    P. Spirtes, C. Glymour, R. Scheines, Causation, Prediction, and Search (MIT Press, 2000).

    Not in our library

  6. 6.

    Mosedale T. J., Stephenson D. B., Collins M., Mills T. C., Granger causality of coupled climate processes: Ocean feedback on the North Atlantic Oscillation. J. Clim. 19, 1182–1194 (2006 ).

    Not in our library

  7. 7.

    Attanasio A., Pasini A., Triacca U., A contribution to attribution of recent global warming by out-of-sample Granger causality analysis. Atmos. Sci. Lett. 13, 67–72 (2012 ).

    Not in our library

  8. 8.

    Papagiannopoulou C., Miralles D. G., Decubber S., Demuzere M., Verhoest N., Dorigo W. A., Waegeman W., A non-linear Granger-causality framework to investigate climate-vegetation dynamics. Geosci. Model Dev. 10, 1945–1960 (2017 ).

    Not in our library

  9. 9.

    McGraw M. C., Barnes E. A., Memory matters: A case for Granger causality in climate variability studies. J. Clim. 31, 3289–3300 (2018 ).

    Not in our library

  10. 10.

    Bullmore E., Sporns O., Complex brain networks: Graph theoretical analysis of structural and functional systems. Nat. Rev. Neurosci. 10, 186–198 (2009 ).

    Not in our library10.1038/nrn2575

  11. 11.

    Seth A. K., Barrett A. B., Barnett L., Granger causality analysis in neuroscience and neuroimaging. J. Neurosci. 35, 3293–3297 (2015 ).

    Not in our library10.1523/jneurosci.4399-14.2015

  12. 12.

    Granger C. W. J., Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37, 424–438 (1969 ).

    Not in our library

  13. 13.

    Barnett L., Seth A. K., Granger causality for state space models. Phys. Rev. E 91, 040101 (2015 ).

    Not in our library10.1103/physreve.91.040101

  14. 14.

    Sugihara G., May R., Ye H., Hsieh C.-h., Deyle E., Fogarty M., Munch S., Detecting causality in complex ecosystems. Science 338, 496–500 (2012 ).

    Not in our library10.1126/science.1227079

  15. 15.

    Arnhold J., Grassberger P., Lehnertz K., Elger C. E., A robust method for detecting interdependences: Application to intracranially recorded EEG. Physica D 134, 419–430 (1999 ).

    Not in our library

  16. 16.

    Hoerl A. E., Kennard R. W., Ridge regression: Biased estimation for nonorthogonal problems. Dent. Tech. 12, 55–67 (1970 ).

    Not in our library

  17. 17.

    Tibshirani R., Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B Stat Methodol. 58, 267–288 (1996 ).

    Not in our library

  18. 18.

    Zou H., The Adaptive Lasso and Its Oracle Properties. J. Am. Stat. Assoc. 101, 1418–1429 (2006 ).

    Not in our library

  19. 19.

    Ebert-Uphoff I., Deng Y., Causal discovery for climate research using graphical models. J. Clim. 25, 5648–5665 (2012 ).

    Not in our library

  20. 20.

    Runge J., Petoukhov V., Kurths J., Quantifying the Strength and Delay of Climatic Interactions: The Ambiguities of Cross Correlation and a Novel Measure Based on Graphical Models. J. Clim. 27, 720–739 (2014 ).

    Not in our library

  21. 21.

    Kretschmer M., Coumou D., Donges J. F., Runge J., Using causal effect networks to analyze different arctic drivers of midlatitude winter circulation. J. Clim. 29, 4069–4081 (2016 ).

    Not in our library

  22. 22.

    Kretschmer M., Runge J., Coumou D., Early prediction of weak stratospheric polar vortex states using causal precursors. Geophys. Res. Lett. 44, 8592–8600 (2017 ).

    Not in our library

  23. 23.

    Kretschmer M., Cohen J., Matthias V., Runge J., Coumou D., The different stratospheric influence on cold-extremes in Eurasia and North America. npj Clim. Atmos. Sci. 1, 44 (2018 ).

    Not in our library

  24. 24.

    Runge J., Balasis G., Daglis I. A., Papadimitriou C., Donner R. V., Common solar wind drivers behind magnetic storm–magnetospheric substorm dependency. Sci. Rep. 8, 16987 (2018 ).

    Not in our library10.1038/s41598-018-35250-5

  25. 25.

    Spirtes P., Glymour C., An algorithm for fast recovery of sparse causal graphs. Soc. Sci. Comput. Rev. 9, 62–72 (1991 ).

    Not in our library

  26. 26.

    Bach F. R., Consistency of the group Lasso and multiple kernel learning. J. Mach. Learn. Res. 9, 1179–1224 (2008 ).

    Not in our library

  27. 27.

    Rayner N. A., Parker D. E., Horton E. B., Folland C. K., Alexander L. V., Rowell D. P., Kent E. C., Kaplan A., Global analyses of sea surface temperature, sea ice, and night marine air temperature since the late nineteenth century. J. Geophys. Res. 108, 4407 (2003 ).

    Not in our library

  28. 28.

    Jones P. D., Lister D. H., Osborn T. J., Harpham C., Salmon M., Morice C. P., Hemispheric and large-scale land-surface air temperature variations: An extensive revision and an update to 2010. J. Geophys. Res. Atmos. 117, D05127 (2012 ).

    Not in our library

  29. 29.

    Ropelewski C. F., Halpert M. S., North American Precipitation and Temperature Patterns Associated with the El Niño/Southern Oscillation (ENSO). Mon. Weather Rev. 114, 2352–2362 (1986 ).

    Not in our library

  30. 30.

    Shabbar A., Khandekar M., The impact of el Nino-Southern oscillation on the temperature field over Canada: Research note. Atmos. Ocean 34, 401–416 (1996 ).

    Not in our library

  31. 31.

    Nowack P. J., Braesicke P., Luke Abraham N., Pyle J. A., On the role of ozone feedback in the ENSO amplitude response under global warming. Geophys. Res. Lett. 44, 3858–3866 (2017 ).

    Not in our library10.1002/2016gl072418

  32. 32.

    Eichler M., Graphical modelling of multivariate time series. Probab. Theory Relat. Fields 153, 233–268 (2012 ).

    Not in our library

  33. 33.

    Runge J., Heitzig J., Petoukhov V., Kurths J., Escaping the Curse of Dimensionality in Estimating Multivariate Transfer Entropy. Phys. Rev. Lett. 108, 258701 (2012 ).

    Not in our library10.1103/physrevlett.108.258701

  34. 34.

    Runge J., Causal network reconstruction from time series: From theoretical assumptions to practical estimation. Chaos An Interdiscip. J. Nonlinear Sci. 28, 075310 (2018 ).

    Not in our library10.1063/1.5025050

  35. 35.

    Aliferis C. F., Statnikov A., Tsamardinos I., Mani S., Koutsoukos X., Local causal and markov blanket induction for causal discovery and feature selection for classification part I: Algorithms and empirical evaluation. J. Mach. Learn. Res. 11, 171–234 (2010 ).

    Not in our library

  36. 36.

    Colombo D., Maathuis M. H., Order-independent constraint-based causal structure learning. J. Mach. Learn. Res. 15, 3921–3962 (2014 ).

    Not in our library

  37. 37.

    Benjamini Y., Hochberg Y., Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. R. Stat. Soc. Ser. B 57, 289–300 (1995 ).

    Not in our library

  38. 38.

    Runge J., Petoukhov V., Donges J. F., Hlinka J., Jajcay N., Vejmelka M., Hartman D., Marwan N., Paluš M., Kurths J., Identifying causal gateways and mediators in complex spatio-temporal systems. Nat. Commun. 6, 8502 (2015 ).

    Not in our library10.1038/ncomms9502

  39. 39.

    Runge J., Quantifying information transfer and mediation along causal pathways in complex systems. Phys. Rev. E 92, 062829 (2015 ).

    Not in our library10.1103/physreve.92.062829

  40. 40.

    Rubin D. B., Estimating causal effects of treatments in randomized and nonrandomzied studies. J. Educ. Psychol. 66, 688–701 (1974 ).

    Not in our library

  41. 41.

    Pearl J., Causal inference in statistics: An overview. Stat. Surv. 3, 96–146 (2009 ).

    Not in our library

  42. 42.

    C. Rasmussen, C. Williams, Gaussian Processes for Machine Learning (MIT Press, 2006).

    Not in our library

  43. 43.

    Székely G. J., Rizzo M. L., Bakirov N. K., Measuring and testing dependence by correlation of distances. Ann. Stat. 35, 2769–2794 (2007 ).

    Not in our library

  44. 44.

    J. Runge, Conditional independence testing based on a nearest-neighbor estimator of conditional mutual information, Proceedings of the 21st International Conference on Artificial Intelligence and Statistics, F. Storkey, A. Perez-Cruz, Eds. (Playa Blanca, Lanzarote, Canary Islands: PMLR, 2018).

    Not in our library

  45. 45.

    Robins J. M., Scheines R., Spirtes P., Wasserman L., Uniform consistency in causal inference. Biometrika 90, 491–515 (2003 ).

    Not in our library

  46. 46.

    Kalisch M., Bühlmann P., Estimating high-dimensional directed acyclic graphs with the PC-algorithm. J. Mach. Learn. Res. 8, 613–636 (2007 ).

    Not in our library

  47. 47.

    Walker G. T., Correlation in seasonal variations of weather, VIII: A Preliminary Study of World Weather. Mem. Indian Meteorol. Dep. 24, 75–131 (1923 ).

    Not in our library

  48. 48.

    K.-M. Lau, S. Yang, Walker Circulation (Academic Press, 2003).

    Not in our library

  49. 49.

    Alexander M. A., Bladé I., Newman M., Lanzante J. R., Lau N.-C., Scott J. D., The atmospheric bridge: The influence of ENSO teleconnections on air sea interaction over the global oceans. J. Clim. 15, 2205–2231 (2002 ).

    Not in our library

  50. 50.

    Riedl M., Suhrbier A., Stepan H., Kurths J., Wessel N., Short-term couplings of the cardiovascular system in pregnant women suffering from pre-eclampsia. Philos. Trans. R. 368, 2237–2250 (2010 ).

    Not in our library10.1098/rsta.2010.0029

  51. 51.

    Runge J., Riedl M., Müller A., Stepan H., Kurths J., Wessel N., Quantifying the causal strength of multivariate cardiovascular couplings with momentary information transfer. Physiol. Meas. 36, 813–825 (2015 ).

    Not in our library10.1088/0967-3334/36/4/813

  52. 52.

    E. P. Widmaier, H. Raff, K. T. Strang, A. J. Vander, Vander’s Human Physiology: The Mechanisms of Body Function (McGraw-Hill Higher Education, 2016).

    Not in our library

  53. 53.

    Hirata Y., Amigó J. M., Matsuzaka Y., Yokota R., Mushiake H., Aihara K., Detecting causality by combined use of multiple methods: Climate and brain examples. PLOS ONE 11, e0158572 (2016 ).

    Not in our library10.1371/journal.pone.0158572

  54. 54.

    Witte J., Didelez V., Covariate selection strategies for causal inference: Classification and comparison. Biom. J. 61, 1270–1289 (2019 ).

    Not in our library10.1002/bimj.201700294

  55. 55.

    Runge J., Heitzig J., Marwan N., Kurths J., Quantifying causal coupling strength: A lag-specific measure for multivariate time series related to transfer entropy. Phys. Rev. E 86, 061121 (2012 ).

    Not in our library10.1103/physreve.86.061121

  56. 56.

    Smirnov D. A., Quantification of causal couplings via dynamical effects: A unifying perspective. Phys. Rev. E 90, 062921 (2014 ).

    Not in our library10.1103/physreve.90.062921

  57. 57.

    Janzing D., Balduzzi D., Grosse-Wentrup M., Schölkopf B., Quantifying causal influences. Ann. Stat. 41, 2324–2358 (2013 ).

    Not in our library

  58. 58.

    Jiang P., Kumar P., Information transfer from causal history in complex system dynamics. Phys. Rev. E 99, 012306 (2019 ).

    Not in our library10.1103/physreve.99.012306

  59. 59.

    Spirtes P., Zhang K., Causal discovery and inference: Concepts and recent methodological advances. Appl. Inform. 3, 3 (2016 ).

    Not in our library10.1186/s40535-016-0018-x

  60. 60.

    J. Peters, D. Janzing, B. Schölkopf, Elements of Causal Inference: Foundations and Learning Algorithms (MIT Press, 2017).

    Not in our library

  61. 61.

    Runge J., Donner R. V., Kurths J., Optimal model-free prediction from multivariate time series. Phys. Rev. E 91, 052909 (2015 ).

    Not in our library10.1103/physreve.91.052909

  62. 62.

    S. L. Lauritzen, Graphical Models (Oxford Univ. Press, 1996).

    Not in our library

  63. 63.

    Sun J., Taylor D., Bollt E. M., Causal network inference by optimal causation entropy. SIAM J. Appl. Dyn. Syst. 14, 73–106 (2015 ).

    Not in our library

  64. 64.

    Pompe B., Runge J., Momentary information transfer as a coupling measure of time series. Phys. Rev. E 83, 051122 (2011 ).

    Not in our library10.1103/physreve.83.051122

  65. 65.

    Kalnay E., Kanamitsu M., Kistler R., Collins W., Deaven D., Gandin L., Iredell M., Saha S., White G., Woollen J., Zhu Y., Chelliah M., Ebisuzaki W., Higgins W., Janowiak J., Mo K. C., Ropelewski C., Wang J., Leetmaa A., Reynolds R., Jenne R., Joseph D., The NCEP/NCAR 40-year reanalysis project. B. Am. Meteorol. Soc. 77, 437–472 (1996 ).

    Not in our library

  66. 66.

    I. Tsamardinos, L. E. Brown, Bounding the False Discovery Rate in Local Bayesian Network Learning, Proceedings of the 23rd Conference on Artificial Intelligence (2008), pp. 1100–1105.

    Not in our library

  67. 67.

    Schreiber T., Measuring information transfer. Phys. Rev. Lett. 85, 461–464 (2000 ).

    Not in our library10.1103/physrevlett.85.461

  68. 68.

    T. M. Cover, J. A. Thomas, Elements of Information Theory (John Wiley & Sons, 2006).

    Not in our library

  69. 69.

    Choi T., Schervish M. J., On posterior consistency in nonparametric regression problems. J. Multivar. Anal. 98, 1969–1987 (2007 ).

    Not in our library

  70. 70.

    Li Y., Genton M. G., Single-Index Additive Vector Autoregressive Time Series Models. Scand. J. Stat. 36, 369–388 (2009 ).

    Not in our library

  71. 71.

    Zhang B.-g., Li W., Shi Y., Liu X., Chen L., Detecting causality from short time-series data based on prediction of topologically equivalent attractors. BMC Syst. Biol. 11, 128 (2017 ).

    Not in our library10.1186/s12918-017-0512-3

  72. 72.

    Q. Zhang, S. Filippi, S. Flaxman, D. Sejdinovic, Feature-to-feature regression for a two-step conditional independence test, Proceedings of the 33rd Conference on Uncertainty in Artificial Intelligence (2017).

    Not in our library

  73. 73.

    Kozachenko L. F., Leonenko N. N., Sample estimate of the entropy of a random vector. Probl. Peredachi Inf. 23, 9–16 (1987 ).

    Not in our library

  74. 74.

    Kraskov A., Stögbauer H., Grassberger P., Estimating mutual information. Phys. Rev. E 69, 066138 (2004 ).

    Not in our library10.1103/physreve.69.066138

  75. 75.

    Frenzel S., Pompe B., Partial mutual information for coupling analysis of multivariate time series. Phys. Rev. Lett. 99, 204101 (2007 ).

    Not in our library10.1103/physrevlett.99.204101

  76. 76.

    Vejmelka M., Paluš M., Inferring the directionality of coupling with conditional mutual information. Phys. Rev. E 77, 026214 (2008 ).

    Not in our library10.1103/physreve.77.026214

  77. 77.

    Leonenko N. N., Pronzato L., Savani V., A class of Rényi information estimators for multidimensional densities. Ann. Stat. 36, 2153–2182 (2008 ).

    Not in our library

  78. 78.

    K. Fukumizu, A. Gretton, X. Sun, B. Schölkopf, Kernel Measures of Conditional Dependence, Proceedings of the 21st Conference on Neural Information Processing Systems (2008), vol. 20, pp. 1–13.

    Not in our library

  79. 79.

    K. Zhang, J. Peters, D. Janzing, B. Schölkopf, Kernel-based Conditional Independence Test and Application in Causal Discovery, Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence (2011), pp. 804–813.

    Not in our library

  80. 80.

    Strobl E. V., Zhang K., Visweswaran S., Approximate kernel-based conditional independence tests for fast non-parametric causal discovery. J. Causal Inference 7, (2019 ).

    Not in our library

Cited by papers we hold 3

Reads

Read by people on this page

None yet.

Checked or read by AI through naulon

None yet.

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.

Are you an author?

Is this your paper?

Claim it to add your note and be paid when agents cite it. Free.