Why don't we understand statistics? Fixed mindsets may be to blame

October 12, 2018

Unfavorable methods of teaching statistics in schools and universities may be to blame for people ignoring simple solutions to statistical problems, making them hard to solve. This can have serious consequences when applied to professional settings like court cases. Published in Frontiers in Psychology, the study shows for the first time that fixed mindsets -- potentially triggered by suboptimal education curricula -- lead to difficulties finding the simple solution to statistical problems.

We are faced with probabilities and statistics on a daily basis. These are most commonly presented as percentages (i.e. 10% of the population), but a more intuitive way of understanding this information -- called natural frequencies -- is to present it as two whole numbers (i.e. 1 in 10 people).

Does this remind you of math problems you had to try solving in school? You're not alone.

"Even though natural frequencies are much easier to understand, people are more familiar with probabilities represented by percentages because of their education," says Patrick Weber of the University of Regensburg, Germany, who led the study with colleagues Karin Binder and Stefan Krauss.

However, although people are more familiar with probabilities, it does not mean they are any better at understanding them.

"A recent meta-analysis showed the vast majority of people have difficulties solving a task presented in probability format," says Weber. "This can result in severe misjudgments when applied in professional settings."

Weber refers to a famous example of the misuse of statistics in court when the prosecution relied heavily on flawed statistical evidence presented by a medical professional. An insufficient understanding of statistical probability led to Sally Clark being wrongly convicted of the murder of her two sons, based on the misjudgment of the probability that they could have died from natural causes.

The researchers believe that people are 'blind' to probabilities -- yet have a fear of changing them into simpler natural frequencies which would make them easier to understand.

"The same meta-analysis showed that when the task was presented in natural frequency format instead of probabilities, performance rates increased from 4% to 24%," says Weber. (See below for an example task.)

But while the success rate was much higher when the data was presented as two whole numbers rather than a percentage, around three-quarters of participants still could not solve the task at all. Weber and his colleagues were keen to find out why.

They gave groups of university students different reasoning tasks, one presented in probability format and the other in natural frequency. Participants were asked to show their working so the researchers could understand their cognitive processes behind answering the questions.

They found that, when the questions were presented in natural frequencies, half the participants did not use natural frequencies to solve the problems, but instead 'translated' them into the more difficult probability format.

Weber and his team believe that a fixed mindset -- known as the Einstellung effect -- may explain participants' preference to change the data.

"Students are a lot more familiar with probabilities than with natural frequencies due to their education. In high school and university contexts, natural frequencies are not considered as equally mathematically valid as probabilities," says Weber.

"This means that working with probabilities is a well-established strategy when it comes to solving statistical problems," Weber continues. "While in many situations students profit from such an established strategy, the mental sets developed over a long period of time during school and university can make them 'blind' to simpler solutions -- or unable to find a solution at all."

Weber and his team believe this is a widespread problem deeply rooted in school and university curricula all over the world. They do, however, recognize their study only consisted of university students which may produce different results from the general population.

"We assume that while overall solution rates might vary, the tendency to avoid using natural frequencies is widespread across the whole population," says Weber.

The researchers hope their new insights-- published in a research collection on judgment and decision making under uncertainty -- will encourage global change to statistical teaching strategies in schools and universities.

"We want our findings to encourage curriculum designers to incorporate natural frequencies systematically into school mathematics and statistics. This would give students a helpful tool to understand the concept of uncertainty -- in addition to the 'standard' probabilities."

Example of a problem posed in probability and natural frequency format

Probability format: The probability of being addicted to heroin is 0.01% for a person randomly picked from a population (base rate). If a randomly picked person from this population is addicted to heroin, the probability is 100% that he or she will have fresh needle pricks (sensitivity). If a randomly picked person from this population is not addicted to heroin, the probability is 0.19% that he or she will still have fresh needle pricks (false alarm rate). What is the probability that a randomly picked person with fresh needle pricks is addicted to heroin (posterior probability)?

Solution: With the help of Bayes' theorem, the corresponding posterior probability P(H|N), with H denoting "person is addicted to heroin" and N denoting "person has fresh needle pricks", can be calculated:

P(H|N) = (P(N|H) x P(H)) / (P(N|H) x P(H) + P(N|¬H) x P(¬H)) = (100% x 0.01%) / (100% x 0.01% + 0.19% x 99.99%) = 5%

Natural frequencies format: 10 out of 100,000 people from a given population are addicted to heroin. 10 out of 10 people who are addicted to heroin will have fresh needle pricks. 190 out of 99,990 people who are not addicted to heroin will nevertheless have fresh needle pricks. What percentage of the people with fresh needle pricks is addicted to heroin?

Solution:

Number of heroin addicts: 10

Number of people with needle pricks: All the heroin addicts + 190 non-addicts = 200

Percentage of people with needle pricks who are addicts = 10/200 = 5%
-end-
Please include a link to the original research article in your reporting: https://www.frontiersin.org/articles/10.3389/fpsyg.2018.01833/full

Frontiers is an award-winning Open Science platform and leading open-access scholarly publisher. Our mission is to make high-quality, peer-reviewed research articles rapidly and freely available to everybody in the world, thereby accelerating scientific and technological innovation, societal progress and economic growth. For more information, visit http://www.frontiersin.org and follow @Frontiersin on Twitter.

Frontiers

Related Education Articles from Brightsurf:

Applying artificial intelligence to science education
A new review published in the Journal of Research in Science Teaching highlights the potential of machine learning--a subset of artificial intelligence--in science education.

Dementia education
School-based dementia education could deliver much needed empathy and understanding for older generations as new research from the University of South Australia shows it can significantly improve dementia knowledge and awareness among younger generations.

How can education researchers support education and public health and institutions during COVID-19?
As education researchers' ongoing work is interrupted by school closures, what can they do to support education and public health institutions dealing with the Covid-19 pandemic?

Online education platforms could scale high-quality STEM education for universities
Online and blended (online and in-person) STEM instruction can produce the same learning outcomes for students as traditional, in-person classes at a fraction of the cost, finds research published today in Science Advances.

Technology in higher education: learning with it instead of from it
Technology has shifted the way that professors teach students in higher education.

The new racial disparity in special education
Racial disparity in special education is growing, and it's more complex than previously thought.

Education may be key to a healthier, wealthier US
A first-of-its-kind study estimate the economic value of education for better health and longevity.

How education may stave off cognitive decline
Prefrontal brain regions linked to higher educational attainment are characterized by increased expression of genes involved in neurotransmission and immunity, finds a study of healthy older adults published in JNeurosci.

Does more education stem political violence?
In a study released online today in Review of Educational Research, a peer-reviewed journal of the American Educational Research Association, three Norwegian researchers attempt to bring clarity to this question by undertaking the first systematic examination of quantitative research on this topic.

Individual education programs not being used as intended in special education
Gone are the days when students with disabilities were placed in a separate classroom, or even in a completely different part of the school.

Read More: Education News and Education Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.