Machine learning predicts how long museum visitors will engage with exhibits

October 13, 2020

In a proof-of-concept study, education and artificial intelligence researchers have demonstrated the use of a machine-learning model to predict how long individual museum visitors will engage with a given exhibit. The finding opens the door to a host of new work on improving user engagement with informal learning tools.

"Education is an important part of the mission statement for most museums," says Jonathan Rowe, co-author of the study and a research scientist in North Carolina State University's Center for Educational Informatics (CEI). "The amount of time people spend engaging with an exhibit is used as a proxy for engagement and helps us assess the quality of learning experiences in a museum setting. It's not like school - you can't make visitors take a test."

"If we can determine how long people will spend at an exhibit, or when an exhibit begins to lose their attention, we can use that information to develop and implement adaptive exhibits that respond to user behavior in order to keep visitors engaged," says Andrew Emerson, first author of the study and a Ph.D. student at NC State.

"We could also feed relevant data to museum staff on what is working and what people aren't responding to," Rowe says. "That can help them allocate personnel or other resources to shape the museum experience based on which visitors are on the floor at any given time."

To determine how machine-learning programs might be able to predict user interaction times, the researchers closely monitored 85 museum visitors as they engaged with an interactive exhibit on environmental science. Specifically, the researchers collected data on study participants' facial expressions, posture, where they looked on the exhibit's screen and which parts of the screen they touched.

The data were fed into five different machine-learning models to determine which combinations of data and models resulted in the most accurate predictions.

"We found that a particular machine-learning method called 'random forests' worked quite well, even using only posture and facial expression data," Emerson says.

The researchers also found that the models worked better the longer people interacted with the exhibit, since that gave them more data to work with. For example, a prediction made after a few minutes would be more accurate than a prediction made after 30 seconds. For context, user interactions with the exhibit lasted as long as 12 minutes.

"We're excited about this, because it paves the way for new approaches to study how visitors learn in museums," says Rowe. "Ultimately, we want to use technology to make learning more effective and more engaging."
-end-
The paper, "Early Prediction of Visitor Engagement in Science Museums with Multimodal Learning Analytics," will be presented at the 22nd ACM International Conference on Multimodal Interaction (ICMI '20), being held online Oct. 25-29. The paper was co-authored by Nathan Henderson, a Ph.D. student at NC State; Wookhee Min and Seung Lee, research scientists at NC State's CEI; James Minogue, an associate professor of teacher education and learning sciences at NC State; and James Lester, Distinguished University Professor of Computer Science and the director of CEI at NC State.

The work was done with support from the National Science Foundation under grant 1713545.

North Carolina State University

Related Learning Articles from Brightsurf:

Learning the language of sugars
We're told not to eat too much sugar, but in reality, all of our cells are covered in sugar molecules called glycans.

When learning on your own is not enough
We make decisions based on not only our own learning experience, but also learning from others.

Learning more about particle collisions with machine learning
A team of Argonne scientists has devised a machine learning algorithm that calculates, with low computational time, how the ATLAS detector in the Large Hadron Collider would respond to the ten times more data expected with a planned upgrade in 2027.

Getting kids moving, and learning
Children are set to move more, improve their skills, and come up with their own creative tennis games with the launch of HomeCourtTennis, a new initiative to assist teachers and coaches with keeping kids active while at home.

How expectations influence learning
During learning, the brain is a prediction engine that continually makes theories about our environment and accurately registers whether an assumption is true or not.

Technology in higher education: learning with it instead of from it
Technology has shifted the way that professors teach students in higher education.

Learning is optimized when we fail 15% of the time
If you're always scoring 100%, you're probably not learning anything new.

School spending cuts triggered by great recession linked to sizable learning losses for learning losses for students in hardest hit areas
Substantial school spending cuts triggered by the Great Recession were associated with sizable losses in academic achievement for students living in counties most affected by the economic downturn, according to a new study published today in AERA Open, a peer-reviewed journal of the American Educational Research Association.

Lessons in learning
A new Harvard study shows that, though students felt like they learned more from traditional lectures, they actually learned more when taking part in active learning classrooms.

Learning to look
A team led by JGI scientists has overhauled the perception of inovirus diversity.

Read More: Learning News and Learning Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.