Nav: Home

Evolution of cooperation through longer memory

April 19, 2017

When we make a decision about whether or not to cooperate with someone, we usually base our decision on past experiences -- how has this person behaved in the past? -- and on future reciprocity--will they return the favor? -- and weigh these against the possible benefits of defecting. However, when analyzing strategies for repeated dilemmas, modeling long-term memory in cooperative strategies quickly becomes computationally intractable, and in the past, researchers have either restricted the possible strategy types, or only allowed players to make their decisions based on the previous round ("memory-1").

One basic but important example of a social situation is the prisoner's dilemma. In this situation, two prisoners are given the same options: remain silent or snitch on the other. If they both remain silent, they each get one year in jail. If one talks, and the other remains silent, the one who talks goes free, and the other gets three years in jail. If they both talk, they both get two years. For repeated versions of this game, a variety of successful memory-1 strategies have been found, including "Win-Stay Lose-Shift" (WSLS), where prisoners continue to cooperate or defect until this strategy gives the less desirable outcome. However, if players can remember the last two rounds (memory-2), there are 65'536 possible strategies, and if they can remember up to three rounds (memory-3), this increases to 1.84x10^19--this is already computationally infeasible, not to mention other kinds of social situations with more than two players.

To overcome this computational challenge, IST Austria scientists and their collaborators have proposed an alternative approach to the problem of simulating these dilemmas: they have distilled a set of axioms that every robust cooperative strategy should have, and characterize the strategies that satisfy these conditions. In this way, they reduce the computation necessary for an open-ended search of all possible strategies. In particular, their axioms state that a successful cooperative strategy should be: (1) mutually cooperative, (2) able to correct errors, and (3) sufficiently retaliatory against defectors (in Figure A, MCk, ECk, and REk correspond to properties (1), (2), and (3), respectively. "C" indicates cooperation, "D" indicates defection.). The first condition corresponds to continuing to cooperate after rounds of mutual cooperation. The second means that even if a player makes a mistake, after a certain number of rounds, the players return to mutual cooperation. The last protects the group from players who might take advantage of altruism, or who might make the group too altruistic, and thus vulnerable.

They found that players with these strategies and memories of length k (that is, they remember the past k rounds of play) will only cooperate if all players took the same actions for the last k rounds (i.e. if they all cooperated or if they all defected)--giving rise to the name all-or-none (AONk) strategies. The WSLS strategy, in particular, is AON1. They moreover show that these strategies evolve naturally in a variety of different social dilemmas, and for groups of arbitrary size. Of course, not every cooperative strategy needs to be AONk to be stable. However, the authors have numerical results that indicate that all-or-none strategies (or delayed versions thereof) in fact make up all memory-2 strategies for the prisoner's dilemma. They also make several predictions: First, if cooperation evolves in the context of a social dilemma, it is the result of all-or-none-type strategies. Second, cooperation evolves more readily in memory-2 strategies than in memory-1 strategies, under reasonable conditions. In other words, a longer-term memory increases the chance that cooperation will evolve. The group further examined the implications of players remembering only how often other players cooperated (and not when). In this case, longer memory did not lead to a greater degree of cooperation, thus indicating that successful strategies depend not only on the degree of past cooperation, but also its context.
-end-
Krishnendu Chatterjee joined IST Austria in 2009, and became full professor in 2014. He and his group are broadly interested in game theory and computer-aided verification, and one specialty of the group is evolutionary game theory. Post-doc Christian Hilbe is particularly interested in the applications of evolutionary game theory in economics and biology: "It's fascinating to see how mathematics can be used to describe human and animal behavior in a wide range of different situations."

Institute of Science and Technology Austria

Related Memory Articles:

Taking photos of experiences boosts visual memory, impairs auditory memory
A quick glance at any social media platform will tell you that people love taking photos of their experiences -- whether they're lying on the beach, touring a museum, or just waiting in line at the grocery store.
Think you know how to improve your memory? Think again
Research from Katherine Duncan at the University of Toronto suggests we may have to rethink how we improve memory.
Improving memory with magnets
The ability to remember sounds, and manipulate them in our minds, is incredibly important to our daily lives -- without it we would not be able to understand a sentence, or do simple arithmetic.
Who has the better memory -- men or women?
In the battle of the sexes, women have long claimed that they can remember things better and longer than men can.
New study of the memory through optogenetics
A collaboration between Universitat Autònoma de Barcelona and Harvard University pioneers the increase of memory using optogenetics in mice in Spain.
Peppermint tea can help improve your memory
Peppermint tea can improve long-term and working memory and in healthy adults.
A new glimpse into working memory
MIT study finds bursts of neural activity as the brain holds information in mind, overturns a long-held model.
Memory ensembles
For over forty years, neuro-scientists have been interested in the biological mechanisms underlying the storage of the information that our brain records every day.
What is your memory style?
Why is it that some people have richly detailed recollection of past experiences (episodic memory), while others tend to remember just the facts without details (semantic memory)?
Watching a memory form
Neuroscientists at Rosalind Franklin University of Medicine and Science have discovered a novel mechanism for memory formation.

Related Memory Reading:

Unlimited Memory: How to Use Advanced Learning Strategies to Learn Faster, Remember More and be More Productive
by Kevin Horsley (Author)

Kevin Horsley Broke a World Memory Record in 2013...

And You're About to Learn How to Use His Memory Strategies to Learn Faster, Be More Productive and Achieve More Success

Most people never tap into 10% of their potential for memory. In this book, you're about to learn:

How the World's Top Memory Experts Concentrate and Remember Any Information at Will, and How You Can Too

Do you ever feel like you're too busy, too stressed or just too distracted to concentrate and get work done? In Unlimited Memory, you'll learn how the world's best memory masters... View Details


Memory Rescue: Supercharge Your Brain, Reverse Memory Loss, and Remember What Matters Most
by Daniel G. Amen (Author)

A proven program from #1 New York Times bestselling author and brain researcher Dr. Daniel Amen to help you change your brain and improve your memory today!
Brain imaging research demonstrates that memory loss actually starts in the brain decades before you have any symptoms. Learn the actions you can take to help not just prevent memory loss later in life . . . but to begin restoring the memory you may have already lost.

Expert physician Dr. Amen reveals how a multipronged strategy―including dietary changes, physical and mental exercises, and spiritual... View Details


Moonwalking with Einstein: The Art and Science of Remembering Everything
by Joshua Foer (Author)

The blockbuster phenomenon that charts an amazing journey of the mind while revolutionizing our concept of memory

An instant bestseller that is poised to become a classic, Moonwalking with Einstein recounts Joshua Foer's yearlong quest to improve his memory under the tutelage of top "mental athletes." He draws on cutting-edge research, a surprising cultural history of remembering, and venerable tricks of the mentalist's trade to transform our understanding of human memory. From the United States Memory Championship to deep within the author's own mind, this is an... View Details


The Memory Book: The Classic Guide to Improving Your Memory at Work, at School, and at Play
by Harry Lorayne (Author), Jerry Lucas (Author)

Unleash the hidden power of your mind through Harry Lorayne and Jerry Lucas's simple, fail-safe memory system, and you can become more effective, more imaginative, and more powerful, at work, at school, in sports and play. Discover how easy it is to: file phone numbers, data, figures, and appointments right in your head; learn foreign words and phrases with ease; read with speed--and greater understanding; shine in the classroom--and shorten study hours; dominate social situations, and more.
From the Paperback edition. View Details


Memory Man (Memory Man series)
by David Baldacci (Author)


With over 110 million copies of his novels in print, David Baldacci is one of the most widely read storytellers in the world. Now he introduces a startling, original new character: a man with perfect memory who must solve his own family's murder.
MEMORY MAN
Amos Decker's life changed forever--twice.
The first time was on the gridiron. A big, towering athlete, he was the only person from his hometown of Burlington ever to go pro. But his career ended before it had a chance to begin. On his very first play, a violent helmet-to-helmet collision knocked him off the... View Details


Memory (Miles Vorkosigan Adventures)
by Lois McMaster Bujold (Author)

Restored to life after being pronounced dead, Miles Vorkosigan realizes that the event has left him with a profound weakness and is dismissed from his job, but things are further complicated when he remembers something he saw while dead. Reprint. View Details


The Seven Sins of Memory: How the Mind Forgets and Remembers
by Daniel L. Schacter (Author)

A groundbreaking work by one of the world's foremost psychologists that delves into the complex behavior of memory.

 

In this fascinating study, Daniel L. Schacter explores instances of what we would consider memory failure—absent-mindedness, transience, blocking, misattribution, suggestibility, bias, and persistence—and suggests instead that these miscues are actually indications that memory is functioning as designed. Drawing from vivid scientific research and creative literature, as well as high-profile events in which memory has figured significantly (Bill... View Details


How to Develop a Brilliant Memory Week by Week: 50 Proven Ways to Enhance Your Memory Skills
by Dominic O'Brien (Author)

Written by eight times World Memory Champion, Dominic O'Brien this book is a complete course in memory enhancement.  Dominic takes you step-by-step through an ingenious program of skills, introducing all his tried and tested techniques on which he has built his triumphant championship performances.  Pacing the course in line with his expert understanding of how the brain responds to basic memory training, Dominic offers strategies and tips that will expand your mental capacities at a realistic but impressive rate. View Details


In Search of Memory: The Emergence of a New Science of Mind
by Eric R. Kandel (Author)

“A stunning book.”―Oliver Sacks

Memory binds our mental life together. We are who we are in large part because of what we learn and remember. But how does the brain create memories? Nobel Prize winner Eric R. Kandel intertwines the intellectual history of the powerful new science of the mind―a combination of cognitive psychology, neuroscience, and molecular biology―with his own personal quest to understand memory. A deft mixture of memoir and history, modern biology and behavior, In Search of Memory brings readers from Kandel's childhood in... View Details


Memory
by Alan Baddeley (Author), Michael W. Eysenck (Author), Michael C. Anderson (Author)

This best-selling textbook presents a comprehensive and accessible overview of the study of memory. Written by three of the world’s leading researchers in the field, it contains everything the student needs to know about the scientific approach to memory and its applications.

Each chapter of the book is written by one of the three authors, an approach which takes full advantage of their individual expertise and style, creating a more personal and accessible text. This enhances students’ enjoyment of the book, allowing them to share the authors’ own fascination with human... View Details

Best Science Podcasts 2018

We have hand picked the best science podcasts for 2018. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

The Person You Become
Over the course of our lives, we shed parts of our old selves, embrace new ones, and redefine who we are. This hour, TED speakers explore ideas about the experiences that shape the person we become. Guests include aerobatics pilot and public speaker Janine Shepherd, writers Roxane Gay and Taiye Selasi, activist Jackson Bird, and fashion executive Kaustav Dey.
Now Playing: Science for the People

#479 Garden of Marvels (Rebroadcast)
This week we're learning about botany and the colorful science of gardening. Author Ruth Kassinger joins us to discuss her book "A Garden of Marvels: How We Discovered that Flowers Have Sex, Leaves Eat Air, and Other Secrets of the Way Plants Work." And we'll speak to NASA researcher Gioia Massa about her work to solve the technical challenges of gardening in space.