Foundational Papers in Complexity Science pp. 735–775
DOI: 10.37911/9781947864535.23
The Revolutionary Discovery of Chaos
Author: J. Doyne Farmer, University of Oxford and Santa Fe Institute
Excerpt
The realization in the late twentieth century that deterministic dynamics can be chaotic fundamentally changed our view of predictability vs. unpredictability. Although pieces of the puzzle were understood in the late nineteenth century, Ed Lorenz’s famous 1963 paper brought it all together, explaining the how, why and “so what” of chaos in one fell swoop. In this essay I will explain what chaos is, why this paper was a key original contribution, why it triggered a revolution, how chaos fits into the broader framework of complex systems, and its practical and philosophical implications.
As most readers will know, chaos implies fundamental limits to prediction, but it is more than that: Chaos is a remarkable example of endogenous motion, that is, motion that spontaneously emerges in an otherwise static environment. It is also an example of an unsolvable phenomenon, the dynamical systems analog of Gödel’s proof or Turing’s halting problem. In fact, chaos is a double-edged sword: In some circumstances, the realization that chaos underpins random-looking phenomena leads to vastly improved predictions (Farmer and Sidorowich 1987).
Many phenomena in nature and social science are chaotic. Fluid turbulence and weather are the most famous examples, but there are many others. Celestial mechanics is the canonical example of predictability, but, nonetheless, chaos places a fundamental limit on predicting motion in the solar system of about 20 million years. The first experimental system to be definitively shown to be chaotic was a chemical oscillator, in which the chemical composition fluctuates irregularly in time—a phenomenon that was believed to be theoretically impossible until past the middle of the twentieth century. Chaos explains why populations of species can change spontaneously and unpredictably. Though this is controversial, many (like me) believe that business cycles are due at least in part to chaotic dynamics. At a more theoretical level, the ergodic hypothesis, which underpins all of statistical mechanics, depends on chaotic behavior at the microscopic level. And there are important implications for free will.
Bibliography
Abraham, R., and C. Shaw. 1985. Dynamics: The Geometry of Behavior: Part III. Santa Cruz, CA: Ariel Press.
Cartwright, M. L., and J. E. Littlewood. 1945. “On Non-Linear Differential Equations of the Second Order: I. The Equation ÿ −k(1 − y2)y ̇ + y = bλkcos(t + a),k Large.” Journal of the London Mathematical Society s1-20 (3): 180–189. https://doi.org/10.1112/jlms/s1-20.3.180.
Crutchfield, J. P., J. D. Farmer, N. H. Packard, and R. S. Shaw. 1986. “Chaos.” Scientific American 255 (6): 46–57. https://doi.org/10.1038/scientificamerican1286-46.
Farmer, J. D., and J. J. Sidorowich. 1987. “Predicting Chaotic Time Series.” Physical Review Letters 59 (8): 845. https://doi.org/10.1103/PhysRevLett.59.845.
Feigenbaum, M. J. 1978. “Quantitative Universality for a Class of Nonlinear Transformations.” Journal of Statistical Physics 19: 25–52. https://doi.org/10.1007/BF01020332.
Laplace, P.-S. 1814. A Philosophical Essay on Probabilities. Paris, France: V Courcier.
Lorenz, E. N. 1993. The Essence of Chaos. London, UK: UCL Press Ltd.
Metropolis, N., M. L. Stein, and P. R. Stein. 1973. “On Finite Limit Sets for Transformations on the Unit Interval.” Journal of Combinatorial Theory, Series A 15 (1): 25–44. https://doi.org/10.1016/0097-3165(73)90033-2.
Palmer, T. N. 2022. The Primacy of Doubt: From Climate Change to Quantum Physics, How the Science of Uncertainty Can Help Predict and Understand Our Chaotic World. Oxford, UK: Oxford University Press.
Poincaré. 1893. Les Méthodes Nouvelles de la Mécanique Céleste. Paris, France: Gauthiers-Villar.
Shaw, R. 1981. “Strange Attractors, Chaotic Behavior, and Information Flow.” Zeitschrift für Naturforschung A 36 (1): 80–112. https://doi.org/10.1515/zna-1981-0115.
Stein, P. R., and S. M. Ulam. 1962. Non-Linear Transformation Studies on Electronic Computers. Technical report LADC-5688. Los Alamos, NM: Los Alamos Scientific Laboratory.
Ueda, Y. 1991. “Survey of Regular and Chaotic Phenomena in the Forced Duffing Oscillator.” (Ueda first discovered chaotic behavior in 1961.) Chaos, Solitons & Fractals 1 (3): 199–231. https://doi.org/10.1016/0960-0779(91)90032-5.