55-axelrod-1981

Foundational Papers in Complexity Science pp. 1611–1640
DOI: 10.37911/9781947864542.55

Complexity in the Evolution of Cooperation

Author: Michael E. Hochberg, University of Montpellier and Santa Fe Institute

 

Excerpt

The mathematical theory on cooperation can be traced to foundational research on pure strategy games by John von Neumann and Oskar Morgenstern and mixed strategies by John F. Nash, Jr. Although not focusing on cooperation per se, this work introduced important concepts and tools for the disciplines of behavioral economics and evolutionary biology that would become the seeds of cooperation theory. Specifically, the posing of the prisoner’s dilemma (PD) in 1950 was a springboard for scientific inquiry into why individual agents cooperate. PD says barring any information beyond payoffs of the game and knowledge that it is only played once, the best response is to avoid a sucker’s payoff—that is, not risking giving without receiving. Mutual defection as a unique evolutionarily stable strategy (ESS) in the PD game posed a challenge to discover the additional ingredients for a cooperative ESS. Other one-shot coordination games (e.g., the Stag Hunt) can yield multiple Nash equilibria, including cooperative outcomes, but these emerge from incentives contained within the payoff matrix.

More than a decade after key developments in game theory, plausible scenarios and formal theories were advanced to explain cooperation as a product of evolution. In 1962 V. C. Wynne Edwards proposed that many social behaviors, including altruism, were favored by natural selection for the benefit of the group. His theory was discredited and impeded the acceptance of what was to be a coherent theory of multilevel selection, since the latter was based in part on group-level traits. In parallel to group selection theory, a new theory based on gene selection was proposed in 1964 by William D. Hamilton, a mathematical biologist and remarkable naturalist. Drawing on work by Fisher, Haldane, and Wright dating back to the 1930s, Hamilton proposed a rule for the evolution of altruism based on kin selection. Almost a decade after Hamilton, Robert Trivers (1971), an evolutionary biologist conducting his thesis on parental investment and the evolution of altruism, temporalized game theory to multiple rounds to show how distantly or unrelated individuals who reciprocate helping behaviors could maintain cooperation in the face of defection.

Bibliography

Adami, C., J. Schossau, and Hintze A. 2016. “Evolutionary Game Theory Using Agent-Based Methods.” Physics of Life Reviews 19:1–26. https://doi.org/https://doi.org/10.1016/j.plrev.2016.08.015.

Axelrod, R. 1980. “More Effective Choice in the Prisoner’s Dilemma.” Journal of Conflict Resolution 24:379–403. https://www.jstor.org/stable/173638.

Fletcher, J. A., and Doebeli M. 2009. “A Simple and General Explanation for the Evolution of Altruism.” Proceedings of the Royal Society B: Biological Sciences 276 (1654): 13–19. https://doi.org/10.1098/rspb.2008.0829.

Granato, E. T., T. A. Meiller-Legrand, and K. R. Foster. 2019. “The Evolution and Ecology of Bacterial Warfare.” Current Biology 29 (11): PR521–R537. https://doi.org/10.1016/j.cub.2019.04.024.

Hamilton, W. D. 1964. “The Genetical Evolution of Social Behaviour. I II.” Journal of Theoretical Biology 7:1–52. https://doi.org/10.1016/0022-5193(64)90038-4.

—. 2002. Narrow Roads of Gene Land, Volume 2: Evolution of Sex. Oxford, UK: Oxford University Press.

Hochberg, M. E., B. Sinervo, and S. P. Brown. 2003. “Socially Mediated Speciation.” Evolution 57 (1): 154–58. https://doi.org/10.1111/j.0014-3820.2003.tb00224.x.

Imhof, L. A., D. Fudenberg, and M. A. Nowak. 2007. “Tit-for-Tat or Win-Stay, Lose-Shift?” Journal of Theoretical Biology 247 (3): 574–80. https://doi.org/10.1016/j.jtbi.2007.03.027.

McElreath, R., R. Boyd, and P. J. Richerson. 2003. “Shared Norms and the Evolution of Ethnic Markers.” Current Anthropology 44:122–29. https://doi.org/10.1086/345689.

Press, W. H., and F. J. Dyson. 2012. “Iterated Prisoner’s Dilemma Contains Strategies That Dominate Any Evolutionary Opponent.” PNAS 109:10409–13. https://doi.org/10.1073/pnas.1206569109.

Rapoport, A., Seale D. A., and A. M. Colman. 2015. “Is Tit-for-Tat the Answer? On the Conclusions Drawn from Axelrod’s Tournaments.” PLoS ONE 10 (7): e0134128. https://doi.org/10.1371/journal.pone.0134128.

Riolo, R., M. Cohen, and R. Axelrod. 2001. “Evolution of Cooperation Without Reciprocity.” Nature 414:441–43. https://doi.org/10.1038/35106555.

Roberts, G. 2008. “Evolution of Direct and Indirect Reciprocity.” Proceedings of the Royal Society B: Biological Sciences 275:173–179. https://doi.org/10.1098/rspb.2007.1134.

Smith, W. P. J., M. Brodmann, D. Unterweger, Y. Davit, L. E. Comstock, M. Basler, and K. R. Foster. 2020. “The Evolution of Tit-for-Tat in Bacteria Via the Type VI Secretion System.” Nature Communications 11:5395. https://doi.org/10.1038/s41467-020-19017-z.

Trivers, R. L. 1971. “The Evolution of Reciprocal Altruism.” Quarterly Review of Biology 46:35–57. https://www.jstor.org/stable/2822435.

BACK TO Foundational Papers in Complexity Science