Nav: Home

Your brain activity can be used to measure how well you understand a concept

June 21, 2019

As students learn a new concept, measuring how well they grasp it has often depended on traditional paper and pencil tests. Dartmouth researchers have developed a machine learning algorithm, which can be used to measure how well a student understands a concept based on his or her brain activity patterns. The findings are published in Nature Communications.

The study is one of the first to look at how knowledge learned in school is represented in the brain. To test knowledge of concepts in STEM, Dartmouth researchers examined how novices and intermediate learners' knowledge and brain activity compared when testing mechanical engineering and physics concepts, and then developed a new method to assess their conceptual understanding.

"Learning about STEM topics is exciting but it can also be quite challenging. Yet, through the course of learning, students develop a rich understanding of many complex concepts. Presumably, this acquired knowledge must be reflected in new patterns of brain activity. However, we currently don't have a detailed understanding of how the brain supports this kind of complex and abstract knowledge, so that's what we set out to study," said senior author David Kraemer, an assistant professor of education at Dartmouth College.

Twenty-eight Dartmouth students participated in the study, broken into two equal groups: engineering students and novices. Engineering students had taken at least one mechanical engineering course and an advanced physics course, whereas novices had not taken any college-level engineering or physics classes. The study was comprised of three tests, which focused on how structures are built and assessed participants' understanding of Newton's third law--for every action there is an equal and opposite reaction. Newton's third law is often used to describe the interactions of objects in motion, but it also applies to objects that are static, or nonmoving: all of the forces in a static structure need to be in equilibrium, a principle fundamental to understanding whether a structure will collapse under its own weight or whether it can support more weight.

At the start of the study, participants were provided with a brief overview of the different types of forces in mechanical engineering. In an fMRI scanner, they were presented with images of real-world structures (bridges, lampposts, buildings, and more) and were asked to think about how the forces in a given structure balanced out to keep the structure in equilibrium. Then, participants were prompted with a subsequent image of the same structure, where arrows representing forces were overlaid onto the structure. Participants were asked to identify if the Newtonian forces had been labeled correctly in this diagram. Engineering students (intermediate learners) answered 75 percent of the diagrams correctly and outperformed the novices, who answered 53.6 percent correctly.

Before the fMRI session, participants were also asked to complete two standardized, multiple-choice tests that measured other mechanical engineering and physics knowledge. For both tests, the engineering students had significantly higher scores than the novices with 50.2 percent versus 16.9 percent, and 79.3 percent versus 35.9 percent.

In cognitive neuroscience, studies on how information is stored in the brain often rely on averaging data across participants within a group, and then comparing their results to those from another group (such as experts versus novices). For this study, the Dartmouth researchers wanted to devise a data-driven method, which could generate an individual "neural score" based on the brain activity alone, without having to specify which group the participant was a part of. The team created a new method called an informational network analysis, a machine learning algorithm which "produced neural scores that significantly predicted individual differences in performance" testing knowledge of specific STEM concepts. To validate the neural score method, the researchers compared each student's neural score with his/her performance on the three tests. The results demonstrated that the higher the neural score, the higher the student scored on the concept knowledge tests.

"In the study, we found that when engineering students looked at images of real-world structures, the students would automatically apply their engineering knowledge, and would see the differences between structures such as whether it was a cantilever, truss or vertical load," explained Kraemer. "Based on the similarities in brain activity patterns, our machine learning algorithm method was able to distinguish the differences between these mechanical categories and generate a neural score that reflected this underlying knowledge. The idea here is that an engineer and novice will see something different when they look at a photograph of a structure, and we're picking up on that difference," he added.

The study found that while both engineering students and novices use the visual cortex similarly when applying concept knowledge about engineering, they use the rest of the brain very differently to process the same visual image. Consistent with prior research, the results demonstrated that the engineering students' conceptual knowledge was associated with patterns of activity in several brain regions, including the dorsal frontoparietal network that helps enable spatial cognition, and regions of ventral occipitotemporal cortex that are implicated in visual object recognition and category identification.

The informational network analysis could also have broader applications, as it could be used to evaluate the effectiveness of different teaching approaches. The research team is currently testing the comparison between hands-on labs versus virtual labs to determine if either approach leads to better learning and retention of knowledge over time.
-end-
Kraemer is available for comment at: david.j.m.kraemer@dartmouth.edu. The other co-authors from Dartmouth College include: Joshua S. Cetron, a former Dartmouth undergraduate student and currently a Harvard University graduate student; Andrew C. Connolly; Solomon G. Diamond and Vicki V. May of the Thayer School of Engineering; and James V. Haxby.

Dartmouth College

Related Brain Activity Articles:

What is your attitude towards a humanoid robot? Your brain activity can tell us!
Researchers at IIT-Istituto Italiano di Tecnologia in Italy found that people's bias towards robots, that is, attributing them intentionality or considering them as 'mindless things', can be correlated with distinct brain activity patterns.
Using personal frequency to control brain activity
Individual frequency can be used to specifically influence certain areas of the brain and thus the abilities processed in them - solely by electrical stimulation on the scalp, without any surgical intervention.
Rats' brain activity reveals their alcohol preference
The brain's response to alcohol varies based on individual preferences, according to new research in rats published in eNeuro.
Studies of brain activity aren't as useful as scientists thought
Hundreds of published studies over the last decade have claimed it's possible to predict an individual's patterns of thoughts and feelings by scanning their brain in an MRI machine as they perform some mental tasks.
A child's brain activity reveals their memory ability
A child's unique brain activity reveals how good their memories are, according to research recently published in JNeurosci.
How dopamine drives brain activity
Using a specialized magnetic resonance imaging (MRI) sensor that can track dopamine levels, MIT neuroscientists have discovered how dopamine released deep within the brain influences distant brain regions.
Brain activity intensity drives need for sleep
The intensity of brain activity during the day, notwithstanding how long we've been awake, appears to increase our need for sleep, according to a new UCL study in zebrafish, published in Neuron.
Do babies like yawning? Evidence from brain activity
Contagious yawning is observed in many mammals, but there is no such report in human babies.
Understanding brain activity when you name what you see
Using complex statistical methods and fast measurement techniques, researchers found how the brain network comes up with the right word and enables us to say it.
Your brain activity can be used to measure how well you understand a concept
As students learn a new concept, measuring how well they grasp it has often depended on traditional paper and pencil tests.
More Brain Activity News and Brain Activity Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: The Power Of Spaces
How do spaces shape the human experience? In what ways do our rooms, homes, and buildings give us meaning and purpose? This hour, TED speakers explore the power of the spaces we make and inhabit. Guests include architect Michael Murphy, musician David Byrne, artist Es Devlin, and architect Siamak Hariri.
Now Playing: Science for the People

#576 Science Communication in Creative Places
When you think of science communication, you might think of TED talks or museum talks or video talks, or... people giving lectures. It's a lot of people talking. But there's more to sci comm than that. This week host Bethany Brookshire talks to three people who have looked at science communication in places you might not expect it. We'll speak with Mauna Dasari, a graduate student at Notre Dame, about making mammals into a March Madness match. We'll talk with Sarah Garner, director of the Pathologists Assistant Program at Tulane University School of Medicine, who takes pathology instruction out of...
Now Playing: Radiolab

What If?
There's plenty of speculation about what Donald Trump might do in the wake of the election. Would he dispute the results if he loses? Would he simply refuse to leave office, or even try to use the military to maintain control? Last summer, Rosa Brooks got together a team of experts and political operatives from both sides of the aisle to ask a slightly different question. Rather than arguing about whether he'd do those things, they dug into what exactly would happen if he did. Part war game part choose your own adventure, Rosa's Transition Integrity Project doesn't give us any predictions, and it isn't a referendum on Trump. Instead, it's a deeply illuminating stress test on our laws, our institutions, and on the commitment to democracy written into the constitution. This episode was reported by Bethel Habte, with help from Tracie Hunte, and produced by Bethel Habte. Jeremy Bloom provided original music. Support Radiolab by becoming a member today at Radiolab.org/donate.     You can read The Transition Integrity Project's report here.