Game changing game changes

July 10, 2018

All it took for rewriting the rules of understanding evolution of cooperation was a series of chance encounters between Martin Nowak, Krishnendu Chatterjee and Christian Hilbe.

Chatterjee, a computer science professor at IST Austria, mentioned the idea of stochastic games - games which can change based on players' actions - during his first visit to Harvard in 2008, and the idea sent Nowak down a years-long path to merge the concept with evolutionary dynamics.

"People who study evolution of cooperation do not use stochastic games," said Nowak, who developed the new framework in collaboration with Chatterjee, Hilbe, a post-doctoral fellow in Chatterjee's group at IST, and Stepan Simsa of the Charles University in Prague. "Instead in a sequence of repeated encounters, it is assumed that the same game with the same payoff matrix is played again and again. In a stochastic game, the game itself can change probabilistically depending on the player's actions."

That new approach, described in a July 4 paper published in Nature, describes a system that can model the evolution of cooperation based on repeated stochastic games. In the simplest form only a pair of games is used - one with a larger reward and the other with a smaller reward - in which players make a choice of whether to cooperate or to defect.

Both games work in the same way: If one player defects while the other cooperates, the defector collects a larger reward, while the other person gets nothing. If both defect, both receive a reward, albeit one that is smaller than the reward for cooperation. Under normal conditions, cooperation rarely emerges in such games, because the most logical response is for players to defect in an effort to maximize their reward.

The innovation is that whether or not players cooperate affects which game they subsequently play.

At the start, the players begin with the higher-value game. As long as both players cooperate, they continue to play that game, but a defection from either player results in them moving to the lower-value game. Once both players again cooperate, they might return to the higher-value game.

"Amazingly even if both games are set up so that cooperation does not evolve, when we put them together, we get cooperation," Nowak said. "It's almost like a paradox."

The key to making the system work, Nowak said, is the difference in value between the two games.

"If we defect, we are destroying something, but if we cooperate we are building something," he said. "So when we cooperate, we play subsequently for something that is more valuable, and if we defect, we play subsequently for something that is less valuable.

"That's what makes the new approach exciting," Nowak added. "The idea is so simple and yet it changes everything. If you defect in the first game, you lose out twice, because your opponent will retaliate and you have to play a less valuable game."

The stochastic framework can also be applied to multi-player games, including public goods games and there resolve what is known as the "Tragedy of the commons".

"Humans are exploiting the environment in a public goods game," Nowak said. "In the old framework, we decide to cooperate or defect, but the next day we play the same game again, and the state of the environment is always the same. But in our new theory, if we exploit the environment badly, in the next round it may be deteriorated, and then we face a less valuable public good," he added.

If the environment deteriorates sharply in response to defection, then there is a strong incentive to maintain cooperation. If the environment deteriorates slowly or not at all, then achieving cooperation is - paradoxically -more difficult.

"This has interesting implications for some of the major problems humans are facing, such as climate change, environmental destruction and migration" Nowak said. "If people understand that defection today means that we will play a game with a lower payoff tomorrow, then cooperation becomes a winning strategy."

If we realize that we are at a breaking point, there is a strong rational to cooperate.

The concept can also be used by public officials and policy makers to design programs that empower cooperation. If players cooperate they have the chance to move to more valuable games./p>

Harvard University

Related Climate Change Articles from Brightsurf:

Are climate scientists being too cautious when linking extreme weather to climate change?
Climate science has focused on avoiding false alarms when linking extreme events to climate change.

Mysterious climate change
New research findings underline the crucial role that sea ice throughout the Southern Ocean played for atmospheric CO2 in times of rapid climate change in the past.

Mapping the path of climate change
Predicting a major transition, such as climate change, is extremely difficult, but the probabilistic framework developed by the authors is the first step in identifying the path between a shift in two environmental states.

Small change for climate change: Time to increase research funding to save the world
A new study shows that there is a huge disproportion in the level of funding for social science research into the greatest challenge in combating global warming -- how to get individuals and societies to overcome ingrained human habits to make the changes necessary to mitigate climate change.

Sub-national 'climate clubs' could offer key to combating climate change
'Climate clubs' offering membership for sub-national states, in addition to just countries, could speed up progress towards a globally harmonized climate change policy, which in turn offers a way to achieve stronger climate policies in all countries.

Review of Chinese atmospheric science research over the past 70 years: Climate and climate change
Over the past 70 years since the foundation of the People's Republic of China, Chinese scientists have made great contributions to various fields in the research of atmospheric sciences, which attracted worldwide attention.

A CERN for climate change
In a Perspective article appearing in this week's Proceedings of the National Academy of Sciences, Tim Palmer (Oxford University), and Bjorn Stevens (Max Planck Society), critically reflect on the present state of Earth system modelling.

Fairy-wrens change breeding habits to cope with climate change
Warmer temperatures linked to climate change are having a big impact on the breeding habits of one of Australia's most recognisable bird species, according to researchers at The Australian National University (ANU).

Believing in climate change doesn't mean you are preparing for climate change, study finds
Notre Dame researchers found that although coastal homeowners may perceive a worsening of climate change-related hazards, these attitudes are largely unrelated to a homeowner's expectations of actual home damage.

Older forests resist change -- climate change, that is
Older forests in eastern North America are less vulnerable to climate change than younger forests, particularly for carbon storage, timber production, and biodiversity, new research finds.

Read More: Climate Change News and Climate Change Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to