Nav: Home

Multilab replication project examines cooperation under time pressure

March 07, 2017

In 2012, a trio of psychological scientists reported research showing that people who made quick decisions under time pressure were more likely to cooperate than were people who were required to take longer in their deliberations. A new multi-laboratory effort was partially successful in replicating those results.

In the original study, participants who did not follow the instructions to respond quickly (or slowly) were excluded from the data analyses. In the replication project, about 65% of participants failed to adhere to the time pressure constraints, and the results depend on whether or not such noncompliant participants are included in the analysis. When noncompliant participants were excluded, as in the original study, the pattern replicated the original results: People responding under time pressure cooperated at a higher rate than those who had to delay their responses. However, when those non-compliant participants were included in the analysis, time pressure had little or no effect on cooperation. The findings raise questions about the best approach to measuring the relationship between time pressure and cooperation.

The results are published as part of a Registered Replication Report (RRR) in Perspectives on Psychological Science, a journal of the Association for Psychological Science.

The RRR, proposed by psychological scientists Samantha Bouwmeester and Peter Verkoeijen of Erasmus University Rotterdam in the Netherlands, aimed to replicate a study conducted in 2012 by David G. Rand (Yale University), Joshua D. Greene (Harvard University), and Martin A. Nowak (Harvard University).

The original study tested one prediction of the social heuristic hypothesis, which holds that when people make cooperative decisions intuitively, they default to the behavior that is typically optimal in their daily lives. Because cooperation usually pays off in the long run for most study participants, this means that their automatic responses should favor prosocial behavior. Given time to make a more deliberative decision, though, decision makers tend to make more selfish responses.

In the original study, Rand and colleagues manipulated the amount of time participants had to decide how much money they would contribute to a communal pot. Participants randomly assigned to the "intuition" group were told to make their decision about how much to allocate in less than 10 seconds, whereas participants in the "deliberation" group were told to wait 10 seconds before deciding.

Many of the participants in the intuition group in the original study did not respond quickly enough, and the researchers chose to exclude data from noncompliant participants in their analyses. Among compliant participants, those who were told to decide quickly contributed more money to the communal pot than did those who were told to wait.

Some follow-up studies replicated the original study's result, while others did not. With this in mind, Bouwmeester and Verkoeijen proposed a preregistered replication of the original 2012 study. The replication's primary analysis examined data from all participants, compliant and noncompliant, because of concerns that excluding data from noncompliant participants undermines random assignment. More participants tend to be excluded from the time pressure condition, and those excluded participants may differ in systematic ways from the ones who adhered to the time constraints. For example, it's possible that fast participants are also more likely to cooperate - if this is true, excluding participants who respond too slowly would lead to a time pressure group with a disproportionate number of the more cooperative, "fast" participants.

The researchers developed the RRR protocol, with input and guidance from Rand, first author on the original study.

A total of 21 labs from 12 countries participated in the RRR, testing a total sample of 3,596 participants. All labs used the same experimental materials and scripts (translated when necessary) and preregistered their implementation of the protocol.

A meta-analysis combining data from all participating labs showed no effect of time pressure on cooperation when all participants were included in the analyses.

When only compliant participants were included, however, the results indicated that participants under time pressure cooperated more than those who delayed their response, in line with the original study.

"The most straightforward interpretation of the pattern of results is that the difference in the compliant-only analysis resulted from selection biases and that the RRR does not provide evidence for an effect of speeded versus delayed responses on cooperation," the RRR authors conclude.

Ultimately, the RRR authors conclude that "future studies of the effect of intuition on cooperation should strive to avoid high rates of non-compliance."

In a commentary accompanying the RRR report, Rand thanks the replicators for their time and effort, noting that he was glad to see that the RRR results with compliant participants echoed those reported in the original 2012 study.

He also acknowledges that "the lack of effect when including noncompliant participants in the RRR does raise important questions about the existence of a causal effect of time pressure on cooperation," because the RRR results are ambiguous: they are consistent with both a true causal effect and with selection bias. Rand then provides additional analyses to support the argument that the positive effect when excluding noncompliant participants reflects a real effect of time pressure and not just selection bias.

"I hope the results of this RRR, and the questions that they raise, will inspire future work to more fully illuminate the impact of time pressure--and intuition more broadly--on human cooperative behavior," Rand concludes.
The RRR and commentary are available online.

Perspectives on Psychological Science is ranked among the top 10 general psychology journals for impact by the Institute for Scientific Information. It publishes an eclectic mix of thought-provoking articles on the latest important advances in psychology. For a copy of the Registered Replication Report and access to other Perspectives on Psychological Science research findings, please contact Anna Mikulak at 202-293-9300 or

Association for Psychological Science

Related Cooperation Articles:

Exploring a strategy that leads to mutual cooperation without non-cooperative actions
A research team led by Hitoshi Yamamoto from Rissho University analyzed which strategies would be effective in the prisoner's dilemma game, into which a new behavior of not participating in the game was introduced.
Sex for cooperation
To understand the origins of human sociality studying the social dynamics of our closest relatives, chimpanzees and bonobos, is important.
Migration can promote or inhibit cooperation between individuals
A new mathematical analysis suggests that migration can generate patterns in the spatial distribution of individuals that promote cooperation and allow populations to thrive, in spite of the threat of exploitation.
Cooperation among fishers can improve fish stock in coral reefs
Cooperation within a group of people is key to many successful endeavors, including scientific ones.
How the brain 'mentalizes' cooperation
Researchers identify a part of the brain that helps execute cooperative tasks.
More Cooperation News and Cooperation Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Rethinking Anger
Anger is universal and complex: it can be quiet, festering, justified, vengeful, and destructive. This hour, TED speakers explore the many sides of anger, why we need it, and who's allowed to feel it. Guests include psychologists Ryan Martin and Russell Kolts, writer Soraya Chemaly, former talk radio host Lisa Fritsch, and business professor Dan Moshavi.
Now Playing: Science for the People

#537 Science Journalism, Hold the Hype
Everyone's seen a piece of science getting over-exaggerated in the media. Most people would be quick to blame journalists and big media for getting in wrong. In many cases, you'd be right. But there's other sources of hype in science journalism. and one of them can be found in the humble, and little-known press release. We're talking with Chris Chambers about doing science about science journalism, and where the hype creeps in. Related links: The association between exaggeration in health related science news and academic press releases: retrospective observational study Claims of causality in health news: a randomised trial This...