Nav: Home

Multilab replication project examines cooperation under time pressure

March 07, 2017

In 2012, a trio of psychological scientists reported research showing that people who made quick decisions under time pressure were more likely to cooperate than were people who were required to take longer in their deliberations. A new multi-laboratory effort was partially successful in replicating those results.

In the original study, participants who did not follow the instructions to respond quickly (or slowly) were excluded from the data analyses. In the replication project, about 65% of participants failed to adhere to the time pressure constraints, and the results depend on whether or not such noncompliant participants are included in the analysis. When noncompliant participants were excluded, as in the original study, the pattern replicated the original results: People responding under time pressure cooperated at a higher rate than those who had to delay their responses. However, when those non-compliant participants were included in the analysis, time pressure had little or no effect on cooperation. The findings raise questions about the best approach to measuring the relationship between time pressure and cooperation.

The results are published as part of a Registered Replication Report (RRR) in Perspectives on Psychological Science, a journal of the Association for Psychological Science.

The RRR, proposed by psychological scientists Samantha Bouwmeester and Peter Verkoeijen of Erasmus University Rotterdam in the Netherlands, aimed to replicate a study conducted in 2012 by David G. Rand (Yale University), Joshua D. Greene (Harvard University), and Martin A. Nowak (Harvard University).

The original study tested one prediction of the social heuristic hypothesis, which holds that when people make cooperative decisions intuitively, they default to the behavior that is typically optimal in their daily lives. Because cooperation usually pays off in the long run for most study participants, this means that their automatic responses should favor prosocial behavior. Given time to make a more deliberative decision, though, decision makers tend to make more selfish responses.

In the original study, Rand and colleagues manipulated the amount of time participants had to decide how much money they would contribute to a communal pot. Participants randomly assigned to the "intuition" group were told to make their decision about how much to allocate in less than 10 seconds, whereas participants in the "deliberation" group were told to wait 10 seconds before deciding.

Many of the participants in the intuition group in the original study did not respond quickly enough, and the researchers chose to exclude data from noncompliant participants in their analyses. Among compliant participants, those who were told to decide quickly contributed more money to the communal pot than did those who were told to wait.

Some follow-up studies replicated the original study's result, while others did not. With this in mind, Bouwmeester and Verkoeijen proposed a preregistered replication of the original 2012 study. The replication's primary analysis examined data from all participants, compliant and noncompliant, because of concerns that excluding data from noncompliant participants undermines random assignment. More participants tend to be excluded from the time pressure condition, and those excluded participants may differ in systematic ways from the ones who adhered to the time constraints. For example, it's possible that fast participants are also more likely to cooperate - if this is true, excluding participants who respond too slowly would lead to a time pressure group with a disproportionate number of the more cooperative, "fast" participants.

The researchers developed the RRR protocol, with input and guidance from Rand, first author on the original study.

A total of 21 labs from 12 countries participated in the RRR, testing a total sample of 3,596 participants. All labs used the same experimental materials and scripts (translated when necessary) and preregistered their implementation of the protocol.

A meta-analysis combining data from all participating labs showed no effect of time pressure on cooperation when all participants were included in the analyses.

When only compliant participants were included, however, the results indicated that participants under time pressure cooperated more than those who delayed their response, in line with the original study.

"The most straightforward interpretation of the pattern of results is that the difference in the compliant-only analysis resulted from selection biases and that the RRR does not provide evidence for an effect of speeded versus delayed responses on cooperation," the RRR authors conclude.

Ultimately, the RRR authors conclude that "future studies of the effect of intuition on cooperation should strive to avoid high rates of non-compliance."

In a commentary accompanying the RRR report, Rand thanks the replicators for their time and effort, noting that he was glad to see that the RRR results with compliant participants echoed those reported in the original 2012 study.

He also acknowledges that "the lack of effect when including noncompliant participants in the RRR does raise important questions about the existence of a causal effect of time pressure on cooperation," because the RRR results are ambiguous: they are consistent with both a true causal effect and with selection bias. Rand then provides additional analyses to support the argument that the positive effect when excluding noncompliant participants reflects a real effect of time pressure and not just selection bias.

"I hope the results of this RRR, and the questions that they raise, will inspire future work to more fully illuminate the impact of time pressure--and intuition more broadly--on human cooperative behavior," Rand concludes.
The RRR and commentary are available online.

Perspectives on Psychological Science is ranked among the top 10 general psychology journals for impact by the Institute for Scientific Information. It publishes an eclectic mix of thought-provoking articles on the latest important advances in psychology. For a copy of the Registered Replication Report and access to other Perspectives on Psychological Science research findings, please contact Anna Mikulak at 202-293-9300 or

Association for Psychological Science

Related Cooperation Articles:

Maternal and paternal cooperation
Researchers disprove the assumption that parents conflict with one another during a plant's embryonic development.
Evolution of cooperation through longer memory
When we make a decision about whether or not to cooperate with someone, we usually base our decision on past experiences.
Wise deliberation sustains cooperation
Giving people time to think about cooperating on a task can have a positive effect if they are big-picture thinkers, but if they tend to focus on their own, immediate experience, the time to think may make them less cooperative, University of Waterloo research has found.
Multilab replication project examines cooperation under time pressure
In 2012, a trio of psychological scientists reported research showing that people who made quick decisions under time pressure were more likely to cooperate than were people who were required to take longer in their deliberations.
Blood ties fuel cooperation among species, not survival instinct
A new Oxford University study has found that survival instinct does not influence species cooperative breeding decisions.
More Cooperation News and Cooperation Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Do animals grieve? Do they have language or consciousness? For a long time, scientists resisted the urge to look for human qualities in animals. This hour, TED speakers explore how that is changing. Guests include biological anthropologist Barbara King, dolphin researcher Denise Herzing, primatologist Frans de Waal, and ecologist Carl Safina.
Now Playing: Science for the People

#534 Bacteria are Coming for Your OJ
What makes breakfast, breakfast? Well, according to every movie and TV show we've ever seen, a big glass of orange juice is basically required. But our morning grapefruit might be in danger. Why? Citrus greening, a bacteria carried by a bug, has infected 90% of the citrus groves in Florida. It's coming for your OJ. We'll talk with University of Maryland plant virologist Anne Simon about ways to stop the citrus killer, and with science writer and journalist Maryn McKenna about why throwing antibiotics at the problem is probably not the solution. Related links: A Review of the Citrus Greening...