Chaos as an intermittently forced linear system

Abstract

Understanding the interplay of order and disorder in chaos is a central challenge in modern quantitative science. Approximate linear representations of nonlinear dynamics have long been sought, driving considerable interest in Koopman theory. We present a universal, data-driven decomposition of chaos as an intermittently forced linear system. This work combines delay embedding and Koopman theory to decompose chaotic dynamics into a linear model in the leading delay coordinates with forcing by low-energy delay coordinates; this is called the Hankel alternative view of Koopman (HAVOK) analysis. This analysis is applied to the Lorenz system and real-world examples including Earth’s magnetic field reversal and measles outbreaks. In each case, forcing statistics are non-Gaussian, with long tails corresponding to rare intermittent forcing that precedes switching and bursting phenomena. The forcing activity demarcates coherent phase space regions where the dynamics are approximately linear from those that are strongly nonlinear.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 62

1. 1.

   Guckenheimer, J. & Holmes, P. Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields, Vol. 42 of Applied Mathematical Sciences (Springer, 1983).

   Not in our library

2. 2.

   Poincaré H. Sur le probleme des trois corps et les équations de la dynamique. Acta Math. 1890;13:A3-A270.

   Not in our library

3. 3.

   Lorenz EN. Deterministic nonperiodic flow. J. Atmosph. Sci. 1963;20:130-141.

   Not in our library10.1175/1520-0469(1963)020<0130:dnf>2.0.co;2 (opens in a new tab)

4. 4.

   Bjørnstad ON, Grenfell BT. Noisy clockwork: time series analysis of population fluctuations in animals. Science. 2001;293:638-643.

   Not in our library10.1126/science.1062226 (opens in a new tab)

5. 5.

   Sugihara G, et al. Detecting causality in complex ecosystems. Science. 2012;338:496-500.

   Not in our library10.1126/science.1227079 (opens in a new tab)

6. 6.

   Ye H, et al. Equation-free mechanistic ecosystem forecasting using empirical dynamic modeling. Proc. Natl Acad. Sci. 2015;112:E1569-E1576.

   Not in our library10.1073/pnas.1417063112 (opens in a new tab)

7. 7.

   Sugihara G, May RM. Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series. Nature. 1990;344:734-741.

   Not in our library10.1038/344734a0 (opens in a new tab)

8. 8.

   Kolmogorov A. The local structure of turbulence in incompressible viscous fluid for very large Reynolds number. Dokl. Akad. Nauk. SSSR. 1941;30:9-13.

   Not in our library

9. 9.

   Takens F. Detecting strange attractors in turbulence. Lect. Notes Math. 1981;898:366-381.

   Not in our library10.1007/bfb0091924 (opens in a new tab)

10. 10.

    Tsonis AA, Elsner JB. Nonlinear prediction as a way of distinguishing chaos from random fractal sequences. Nature. 1992;358:217-220.

    Not in our library10.1038/358217a0 (opens in a new tab)

11. 11.

    Crutchfield JP. Between order and chaos. Nat. Phys. 2012;8:17-24.

    Not in our library10.1038/nphys2190 (opens in a new tab)

12. 12.

    Sapsis TP, Majda AJ. Statistically accurate low-order models for uncertainty quantification in turbulent dynamical systems. Proc. Natl Acad. Sci. 2013;110:13705-13710.

    Not in our library10.1073/pnas.1313065110 (opens in a new tab)

13. 13.

    Majda AJ, Lee Y. Conceptual dynamical models for turbulence. Proc. Natl Acad. Sci. 2014;111:6548-6553.

    Not in our library10.1073/pnas.1404914111 (opens in a new tab)

14. 14.

    Brunton SL, Noack BR. Closed-loop turbulence control: Progress and challenges. Appl. Mech. Rev. 2015;67:050801–1-050801–48.

    Not in our library10.1115/1.4031175 (opens in a new tab)

15. 15.

    Parish EJ, Duraisamy K. Non-local closure models for large eddy simulations using the mori-zwanzig formalism. arXiv preprint arXiv. 2016;1611:03311.

    Not in our library

16. 16.

    Duriez, T., Brunton, S. L. & Noack, B. R. Machine Learning Control: Taming Nonlinear Dynamics and Turbulence (Springer, 2016).

    Not in our library

17. 17.

    Bongard J, Lipson H. Automated reverse engineering of nonlinear dynamical systems. Proc. Natl Acad. Sci. 2007;104:9943-9948.

    Not in our library10.1073/pnas.0609476104 (opens in a new tab)

18. 18.

    Schmidt M, Lipson H. Distilling free-form natural laws from experimental data. Science. 2009;324:81-85.

    Not in our library10.1126/science.1165893 (opens in a new tab)

19. 19.

    Brunton SL, Proctor JL, Kutz JN. Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proc. Natl Acad. Sci. 2016;113:3932-3937.

    Not in our library10.1073/pnas.1517384113 (opens in a new tab)

20. 20.

    Mangan NM, Brunton SL, Proctor JL, Kutz JN. Inferring biological networks by sparse identification of nonlinear dynamics. IEEE Trans. Mol. Biol. Multi-Scale Commun. 2016;2:52-63.

    Not in our library10.1109/tmbmc.2016.2633265 (opens in a new tab)

21. 21.

    Tran G, Ward R. Exact recovery of chaotic systems from highly corrupted data. arXiv preprint arXiv. 2016;1607:01067.

    Not in our library

22. 22.

    Loiseau J-C, Brunton SL. Constrained sparse Galerkin regression. arXiv preprint arXiv. 2016;1611:03271.

    Not in our library

23. 23.

    Quade M, Abel M, Shafi K, Niven RK, Noack BR. Prediction of dynamical systems by symbolic regression. Phys. Rev. E. 2016;94:012214.

    Not in our library10.1103/physreve.94.012214 (opens in a new tab)

24. 24.

    Schaeffer, H. Learning partial differential equations via data discovery and sparse optimization. In Proc. R. Soc. A, Vol. 473, 20160446 (The Royal Society, 2017).

    Not in our library10.1098/rspa.2016.0446 (opens in a new tab)

25. 25.

    Rudy SH, Brunton SL, Proctor JL, Kutz JN. Data-driven discovery of partial differential equations. Sci. Adv. 2017;3:e1602614.

    Not in our library10.1126/sciadv.1602614 (opens in a new tab)

26. 26.

    Raissi M, Karniadakis GE. Machine learning of linear differential equations using gaussian processes. arXiv preprint arXiv. 2017;1701:02440.

    Not in our library

27. 27.

    Mangan NM, Kutz JN, Brunton SL, Proctor JL. Model selection for dynamical systems via sparse regression and information criteria. arXiv preprint arXiv. 2017;1701:01773.

    Not in our library10.1098/rspa.2017.0009 (opens in a new tab)

28. 28.

    Farmer JD, Sidorowich JJ. Predicting chaotic time series. Phys. Rev. Lett. 1987;59:845.

    Not in our library10.1103/physrevlett.59.845 (opens in a new tab)

29. 29.

    Crutchfield JP, McNamara BS. Equations of motion from a data series. Comp. Sys. 1987;1:417-452.

    Not in our library

30. 30.

    Rowlands G, Sprott JC. Extraction of dynamical equations from chaotic data. Phys. D. 1992;58:251-259.

    Not in our library10.1016/0167-2789(92)90113-2 (opens in a new tab)

31. 31.

    Abarbanel HDI, Brown R, Sidorowich JJ, Tsimring LS. The analysis of observed chaotic data in physical systems. Rev. Mod. Phys. 1993;65:1331.

    Not in our library10.1103/revmodphys.65.1331 (opens in a new tab)

32. 32.

    Juang JN, Pappa RS. An eigensystem realization algorithm for modal parameter identification and model reduction. J. Guid. Control Dyn. 1985;8:620-627.

    Not in our library10.2514/3.20031 (opens in a new tab)

33. 33.

    Broomhead DS, Jones R. Time-series analysis. Proc. Roy. Soc. A. 1989;423:103-121.

    Not in our library10.1098/rspa.1989.0044 (opens in a new tab)

34. 34.

    Giannakis D, Majda AJ. Nonlinear Laplacian spectral analysis for time series with intermittency and low-frequency variability. Proc. Natl Acad. Sci. 2012;109:2222-2227.

    Not in our library10.1073/pnas.1118984109 (opens in a new tab)

35. 35.

    Mezić I. Spectral properties of dynamical systems, model reduction and decompositions. Nonlinear Dynam. 2005;41:309-325.

    Not in our library10.1007/s11071-005-2824-x (opens in a new tab)

36. 36.

    Mezić I. Analysis of fluid flows via spectral properties of the Koopman operator. Ann. Rev. Fluid Mech. 2013;45:357-378.

    Not in our library10.1146/annurev-fluid-011212-140652 (opens in a new tab)

37. 37.

    Giannakis D. Data-driven spectral decomposition and forecasting of ergodic dynamical systems. arXiv preprint arXiv. 2015;1507:02338.

    Not in our library

38. 38.

    Koopman BO. Hamiltonian systems and transformation in Hilbert space. PNAS. 1931;17:315-318.

    Not in our library10.1073/pnas.17.5.315 (opens in a new tab)

39. 39.

    Brunton SL, Brunton BW, Proctor JL, Kutz J. Koopman observable subspaces and finite linear representations of nonlinear dynamical systems for control. PLoS ONE. 2016;11:e0150171.

    Not in our library10.1371/journal.pone.0150171 (opens in a new tab)

40. 40.

    Schmid PJ. Dynamic mode decomposition of numerical and experimental data. J. Fluid Mech. 2010;656:5-28.

    Not in our library10.1017/s0022112010001217 (opens in a new tab)

41. 41.

    Rowley CW, Mezić I, Bagheri S, Schlatter P, Henningson D. Spectral analysis of nonlinear flows. J. Fluid Mech. 2009;645:115-127.

    Not in our library10.1017/s0022112009992059 (opens in a new tab)

42. 42.

    Tu JH, Rowley CW, Luchtenburg DM, Brunton SL, Kutz JN. On dynamic mode decomposition: theory and applications. J. Comput. Dyn. 2014;1:391-421.

    Not in our library10.3934/jcd.2014.1.391 (opens in a new tab)

43. 43.

    Kutz, J. N., Brunton, S. L., Brunton, B. W. & Proctor, J. L. Dynamic Mode Decomposition: Data-Driven Modeling of Complex Systems (SIAM, 2016).

    Not in our library

44. 44.

    Williams MO, Kevrekidis IG, Rowley CW. A data-driven approximation of the Koopman operator: extending dynamic mode decomposition. J. Nonlin. Sci. 1992;25:1307-1346.

    Not in our library10.1007/s00332-015-9258-5 (opens in a new tab)

45. 45.

    Mezić I, Banaszuk A. Comparison of systems with complex behavior. Phys. D: Nonlin. Phenom. 2004;197:101-133.

    Not in our library10.1016/j.physd.2004.06.015 (opens in a new tab)

46. 46.

    Majda AJ, Harlim J. Physics constrained nonlinear regression models for time series. Nonlinearity. 2012;26:201.

    Not in our library10.1088/0951-7715/26/1/201 (opens in a new tab)

47. 47.

    Luzzatto S, Melbourne I, Paccaut F. The lorenz attractor is mixing. Commun. Math. Phys. 2005;260:393-401.

    Not in our library10.1007/s00220-005-1411-9 (opens in a new tab)

48. 48.

    Froyland G. Statistically optimal almost-invariant sets. Phys. D. 2005;200:205-219.

    Not in our library10.1016/j.physd.2004.11.008 (opens in a new tab)

49. 49.

    Pétrélis F, Fauve S, Dormy E, Valet J-P. Simple mechanism for reversals of Earth’s magnetic field. Phys. Rev. Lett. 2009;102:144503.

    Not in our library10.1103/physrevlett.102.144503 (opens in a new tab)

50. 50.

    Gavish M, Donoho DL. The optimal hard threshold for singular values is 4/√3. IEEE Trans. Inf. Theory. 2014;60:5040-5053.

    Not in our library10.1109/tit.2014.2323359 (opens in a new tab)

51. 51.

    Brunton BW, Johnson LA, Ojemann JG, Kutz JN. Extracting spatial–temporal coherent patterns in large-scale neural recordings using dynamic mode decomposition. J. Neurosci. Methods. 2016;258:1-15.

    Not in our library10.1016/j.jneumeth.2015.10.010 (opens in a new tab)

52. 52.

    Budišić M, Mohr R, Mezić I. Applied Koopmanism a). Chaos: An Interdisciplinary J. Nonlin. Sci. 2012;22:047510.

    Not in our library10.1063/1.4772195 (opens in a new tab)

53. 53.

    Lan Y, Mezić I. Linearization in the large of nonlinear systems and Koopman operator spectrum. Phys. D. 2013;242:42-53.

    Not in our library10.1016/j.physd.2012.08.017 (opens in a new tab)

54. 54.

    Bagheri S. Koopman-mode decomposition of the cylinder wake. J. Fluid Mech. 2013;726:596-623.

    Not in our library10.1017/jfm.2013.249 (opens in a new tab)

55. 55.

    Surana, A. Koopman operator based observer synthesis for control-affine nonlinear systems. 2016 IEEE 55th Conference on Decision and Control (CDC) 6492–6499 (2016).

    Not in our library

56. 56.

    Surana A, Banaszuk A. Linear observer synthesis for nonlinear systems using Koopman operator framework. IFAC-PapersOnLine. 2016;49:716-723.

    Not in our library10.1016/j.ifacol.2016.10.250 (opens in a new tab)

57. 57.

    Dellnitz, M., Froyland, G. & Junge, O. in Ergodic Theory, Analysis, and Efficient Simulation of Dynamical Systems (ed. Fielder, B.) 145–174 (Springer, 2001).

    Not in our library

58. 58.

    Froyland G, Padberg K. Almost-invariant sets and invariant manifolds – connecting probabilistic and geometric descriptions of coherent structures in flows. Phys. D. 2009;238:1507-1523.

    Not in our library10.1016/j.physd.2009.03.002 (opens in a new tab)

59. 59.

    Froyland G, Gottwald GA, Hammerlindl A. A computational method to extract macroscopic variables and their dynamics in multiscale systems. SIAM J. Appl. Dynam. Sys. 2014;13:1816-1846.

    Not in our library10.1137/130943637 (opens in a new tab)

60. 60.

    Kaiser E, et al. Cluster-based reduced-order modelling of a mixing layer. J. Fluid Mech. 2014;754:365-414.

    Not in our library10.1017/jfm.2014.355 (opens in a new tab)

61. 61.

    Gouasmi A, Parish E, Duraisamy K. Characterizing memory effects in coarse-grained nonlinear systems using the mori-zwanzig formalism. arXiv preprint arXiv. 2016;1611:06277.

    Not in our library

62. 62.

    Shinbrot T, Grebogi C, Ott E, Yorke JA. Using small perturbations to control chaos. Nature. 1993;363:411-417.

    Not in our library10.1038/363411a0 (opens in a new tab)

Cited by papers we hold 7

• Dynamic mode decomposition for analysis and prediction of metabolic oscillations from time-lapse imaging of cellular autofluorescence · 2025
  Not checked
• Novel Data-Driven Spatial-Spectral Correlated Scheme for Dimensionality Reduction of Hyperspectral Images · 2022
  Not checked
• A Toolkit for Data-Driven Discovery of Governing Equations in High-Noise Regimes · 2022
  Not checked
• Persistent thermal input controls steering behavior in Caenorhabditis elegans. · 2021
  Not checked
• Information Transfer With Respect to Relative Entropy in Multi-Dimensional Complex Dynamical Systems · 2020
  Not checked
• Data-driven discovery of coordinates and governing equations · 2019
  No notice
• Deep learning for universal linear embeddings of nonlinear dynamics · 2018
  No notice

Questions about this paper

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.