Science Current Events | Science News | Brightsurf.com
 

The importance of (experimental) design

February 25, 2014
One of the hottest debates in evolutionary biology concerns the origin of behaviour: is it genetically encoded or do animals and birds copy their parents or other individuals? A classic experiment published in 2000 seemed to provide overwhelming evidence that a particular behavioural choice (whether individuals of a species of swallow breed in a small colony or a large one) is largely genetically determined. Together with colleagues in France, Richard Wagner of the University of Veterinary Medicine, Vienna has re-examined the data and shown that the findings could be explained by random choice. The design of the original experiment - which represents a blueprint for a vast range of studies of heritability of behaviour - contains two pitfalls that combine to undermine the conclusions. The results are published in the journal Scientific Reports.

There are clear advantages to living in cities: safety, ready availability of infrastructure, plenty of company etc. Nevertheless, a large number of people eschew them for the benefits of country life, such as clean air and lots of space. Many species of animals, and particularly birds, face the same choice between living in large groups or remaining in smaller ones, thereby avoiding disadvantages of larger colonies such as the increased risk of disease and increased aggression from neighbours. What causes different individuals of a particular species to take the decisions they do?

It's all in the genes

One possible explanation is that animals and birds might be genetically influenced to breed in smaller or larger colonies. This idea gained widespread acceptance in 2000, when Charles and Mary Brown reported the results of a field experiment of unprecedented scope. The Browns worked on Cliff Swallows, a species of American swallow that breeds in colonies of variable size. Some individuals appear to be more resistant to nest parasites so can breed in larger, more parasite-infested colonies where they can achieve higher foraging efficiencies by following their many neighbours to the insect swarms on which they feed. The scientists cross-fostered an astounding 2,000 nestlings from nests in small colonies to nests in large colonies and vice versa and recaptured over 700 of the birds when they returned to breed in the following years. Analysis of the data showed convincingly that swallows hatched in larger colonies (but reared in smaller ones) chose to breed in large colonies, whereas the reverse was true for swallows hatched in small colonies. In other words, the birds' choice is determined by genetic factors.

Or is it?

Appealing though the conclusion might be, something does not sound quite right. How would a genetic component of the choice of group size be selected and maintained throughout evolution? Étienne Danchin of the University of Toulouse and Richard Wagner of the Vetmeduni's Konrad Lorenz Institute of Ethology wondered whether the results might not be influenced too much by the experimental design. Together with Éric Wajnberg, a modelling specialist at the INRA in Sophia Antipolis, they simulated the data in the original paper and found that the results could be generated by chance.

The problem stems largely from the fallacy known as "regression to the mean" (RTM), which was first identified by Sir Francis Galton, a cousin of Charles Darwin, in the 19th century. It results from the fact that uncommonly large or small measurements are generally followed by more normal measurements simply because normal values are by definition far more common than extreme ones. In the Browns' experiment, when individuals are fostered from small to large colonies they will on average recruit to colonies that are statistically smaller than their foster colony because these are closer to the mean colony size and vice versa.

Danchin and Wagner actually found a second problem with the original data analysis. The so-called "spatial fallacy" was discovered by Arie van Noorwijk in 1984 and occurs when the set of potential dispersal sites differs among individuals according to where they were born. Together the two fallacies can account for the experiment's results, even in the absence of an inherited component of the selection of colony size.

A question of design

The latest calculations are important for two reasons. First, they call the original conclusions into question and should thus encourage researchers to reconsider the role of genetic factors in certain behavioural decisions. Secondly, they sound a clear warning to all those working in behavioural science. As Wagner says, "The biggest shock is that the very experimental design that is widely used to control for all extraneous effects actually creates the RTM fallacy. Even the most carefully designed studies can suffer from the problem, making their results invalid." Fortunately the scientists have proposed a way to avoid both pitfalls. Their simulations showed that restricting comparisons to individuals with the same set of options (in the present case by fostering all offspring to a single colony) can give rise to data that are immune to the pitfalls.

The Nature Publishing Group has just published the paper "Avoiding pitfalls in estimating heritability with the common options approach" by Étienne Danchin, Éric Wajnberg and Richard H. Wagner in its online journal Scientific Reports, where it is freely available. (Scientific Reports Volume 4, doi:10.1038/srep03974)

University of Veterinary Medicine Vienna


Related Experimental Design Current Events and Experimental Design News Articles


4 Lessons for Effective, Efficient Research in Health Care Settings
Thousands of studies take place every year in healthcare settings. A report published recently in the American Journal of Preventative Medicine describes how to do many of these studies more rapidly.

Scientists discover how to turn light into matter after 80-year quest
Imperial College London physicists have discovered how to create matter from light - a feat thought impossible when the idea was first theorised 80 years ago.

Better sleep predicts longer survival time for women with advanced breast cancer
A new study reports that sleep efficiency, a ratio of time asleep to time spent in bed, is predictive of survival time for women with advanced breast cancer.

'Horsing around' reduces stress hormones in youth
New research from Washington State University reveals how youth who work with horses experience a substantial reduction in stress - and the evidence lies in kids' saliva.

Program to move families out of high-poverty neighborhoods helps girls, harms boys' mental health
A program designed to move families out of high-poverty neighborhoods resulted in reduced rates of depression and conduct disorder among girls, but increased rates of depression, post-traumatic stress disorder (PTSD) and conduct disorder among boys, according to a study published in the March 5 issue of JAMA.

Stanford researchers discover how brain regions work together, or alone
Our brains have billions of neurons grouped into different regions. These regions often work alone, but sometimes must join forces. How do regions communicate selectively?

Ways of the photoelectric effect; How physicists have learned how to select them
In contrast to its apparent simplicity (that brought Einstein his Nobel Prize), the photoelectric effect, when an electron is knocked out from its parent atom by a photon, is quite complicated to analyze in general, especially when the atom contains a large number of electrons.

Chimpanzees are rational, not conformists
Chimpanzees are sensitive to social influences but they maintain their own strategy to solve a problem rather than conform to what the majority of group members are doing.

Clinical Ovarian Cancers Display Extensive Genetic Heterogeneity, Study Suggests Multiple Treatment Protocols May Be Necessary
One of the most comprehensive studies of genetic mutations in ovarian cancer was published today, demonstrating an unprecedented level of genetic variation that exists in both primary tumors and metastatic lesions of ovarian cancer.

Program improves Ph.D. student diversity
In the four years since Brown University established the Initiative to Maximize Student Development in its life sciences Ph.D. programs, enrollment and academic achievement among underrepresented minority students has increased markedly, according to new data published in the journal CBE-Life Sciences Education.
More Experimental Design Current Events and Experimental Design News Articles

Experimental Design: Procedures for the Behavioral Sciences

Experimental Design: Procedures for the Behavioral Sciences
by Roger E. Kirk (Author)


Experimental Design: Procedures for Behavioral Sciences, Fourth Edition is a classic text with a reputuation for accessibility and readability. It has been revised and updated to make learning design concepts even easier. Roger E. Kirk shows how three simple experimental designs can be combined to form a variety of complex designs. He provides diagrams illustrating how subjects are assigned to treatments and treatment combinations. New terms are emphasized in boldface type, there are summaries of the advantages and disadvantages of each design, and real-life examples show how the designs are used.

Design and Analysis of Experiments

Design and Analysis of Experiments
by Douglas C. Montgomery (Author)


The eighth edition of Design and Analysis of Experiments continues to provide extensive and in-depth information on engineering, business, and statistics-as well as informative ways to help readers design and analyze experiments for improving the quality, efficiency and performance of working systems.  Furthermore, the text maintains its comprehensive coverage by including: new examples, exercises, and problems (including in the areas of biochemistry and biotechnology); new topics and problems in the area of response surface; new topics in nested and split-plot design; and the residual maximum likelihood method is now emphasized throughout the book.

Experimental and Quasi-Experimental Designs for Generalized Causal Inference

Experimental and Quasi-Experimental Designs for Generalized Causal Inference
by William R. Shadish (Author), Thomas D. Cook (Author), Donald T. Campbell (Author)


This long awaited successor of the original Cook/Campbell Quasi-Experimentation: Design and Analysis Issues for Field Settings represents updates in the field over the last two decades. The book covers four major topics in field experimentation:

Experimental Design for the Life Sciences

Experimental Design for the Life Sciences
by Graeme Ruxton (Author), Nick Colegrave (Author)


At the core of good research lies the careful design of experiments. However, all too often a successful design comes only after a painful trial-and-error process that wastes valuable time and resources.

Now in a new edition, Experimental Design for the Life Sciences teaches today's students how to effectively design experiments, equipping them with the skills they need to become tomorrow's top researchers. Employing a refreshingly approachable and articulate style, the text explains the essential elements of experimental design in clear, practical terms, so that students can grasp and apply even the most challenging concepts, including power analysis and pseudoreplication. In addition, it emphasizes the interrelatedness of experimental design, statistics, and ethical...

Experimental Design for Biologists

Experimental Design for Biologists
by David J. Glass (Author)


The effective design of scientific experiments is critical to success, yet graduate students receive very little formal training in how to do it. Based on a well-received course taught by the author, Experimental Design for Biologists fills this gap.

Experimental Design for Biologists explains how to establish the framework for an experimental project, how to set up a system, design experiments within that system, and how to determine and use the correct set of controls. Separate chapters are devoted to negative controls, positive controls, and other categories of controls that are perhaps less recognized, such as "assumption controls," and "experimentalist controls." Furthermore, there are sections on establishing the experimental system, which include performing critical "system...

Experimental Design and Data Analysis for Biologists

Experimental Design and Data Analysis for Biologists
by Gerry P. Quinn (Author), Michael J. Keough (Author)


This essential textbook is designed for students or researchers in biology who need to design experiments, sampling programs, or analyze resulting data. The text begins with a revision of estimation and hypothesis testing methods, before advancing to the analysis of linear and generalized linear models. The chapters include such topics as linear and logistic regression, simple and complex ANOVA models, log-linear models, and multivariate techniques. The main analyses are illustrated with many examples from published papers and an extensive reference list to both the statistical and biological literature is also included. The book is supported by a web-site that provides all data sets, questions for each chapter and links to software.

Statistics for Experimenters: An Introduction to Design, Data Analysis, and Model Building (Wiley Series in Probability and Statistics)

Statistics for Experimenters: An Introduction to Design, Data Analysis, and Model Building (Wiley Series in Probability and Statistics)
by George E. P. Box (Author), William G. Hunter (Author), J. Stuart Hunter (Author)


Introduces the philosophy of experimentation and the part that statistics play in experimentation. Emphasizes the need to develop a capability for ``statistical thinking'' by using examples drawn from actual case studies.

Design and Analysis of Experiments (Springer Texts in Statistics)

Design and Analysis of Experiments (Springer Texts in Statistics)
by Angela M. Dean (Author), Daniel Voss (Author)


This book offers a step-by-step guide to the experimental planning process and the ensuing analysis of normally distributed data, emphasizing the practical considerations governing the design of an experiment. Data sets are taken from real experiments and sample SAS programs are included with each chapter. Experimental design is an essential part of investigation and discovery in science; this book will serve as a modern and comprehensive reference to the subject.

Statistics for Experimenters: Design, Innovation, and Discovery , 2nd Edition

Statistics for Experimenters: Design, Innovation, and Discovery , 2nd Edition
by George E. P. Box (Author), J. Stuart Hunter (Author), William G. Hunter (Author)


A Classic adapted to modern timesRewritten and updated, this new edition of Statistics for Experimenters adopts the same approaches as the landmark First Edition by teaching with examples, readily understood graphics, and the appropriate use of computers. Catalyzing innovation, problem solving, and discovery, the Second Edition provides experimenters with the scientific and statistical tools needed to maximize the knowledge gained from research data, illustrating how these tools may best be utilized during all stages of the investigative process. The authors’ practical approach starts with a problem that needs to be solved and then examines the appropriate statistical methods of design and analysis.Providing even greater accessibility for its users, the Second Edition is thoroughly...

Experimental and Quasi-Experimental Designs for Research

Experimental and Quasi-Experimental Designs for Research
by Donald T. Campbell (Author), Julian Stanley (Author)


A survey drawn from social-science research which deals with correlational, ex post facto, true experimental, and quasi-experimental designs and makes methodological recommendations. Bibliogs.

© 2014 BrightSurf.com