Nav: Home

Lacking other meaningful data, university faculty devise their own evaluation systems

August 23, 2016

CORVALLIS, Ore. - In the fast-growing and job-rich disciplines of science, technology, engineering, and mathematics, or STEM, improving instruction at the college level is critical to keeping students engaged in these fields.

But filling in bubbles on institutionalized end-of-term teacher evaluation questionnaires, a standard practice at many large research universities, often fails to produce timely and meaningful data for improving instruction, according to a new study from Oregon State University that explores how faculty are evaluating their teaching practice.

The researchers found that faculty teaching in the STEM disciplines at large research universities are devising their own systems to collect instructional data from their classrooms and using that data to inform their teaching.

Instructors are using quantitative data about their students' classroom performance as well as qualitative data such as student feedback from mid-term surveys or informal conversations, said Jana Bouwma-Gearhart, an associate professor of science and mathematics education at OSU and lead author of the study.

"Some faculty have really created these elaborate data and analysis systems, even though they are not yet required to," said Bouwma-Gearhart, who also serves as an associate dean in OSU's College of Education. "They are using these systems to talk about their instruction and to help inform decisions about programs and curriculum."

The findings were published recently in the Journal of Higher Education Management. The research was supported by a grant from the National Science Foundation.

As universities continue to look at ways to improve student success, there is a growing emphasis in higher education for teaching faculty to be good educators who spend time developing and improving their skills in response to valid and reliable data. This may be particularly critical to retaining students in the STEM fields because students who struggle often opt to leave these disciplines altogether, Bouwma-Gearhart said.

In large enrollment universities -those with 15,000 or more students enrolled - many undergraduate courses in the STEM disciplines are taught by full- time educators who would likely be considered experts in that discipline.

However, Bouwma-Gearhart and colleagues found that instructors who teach these courses often lack access to structured or formal opportunities to reflect on meaningful data about their teaching beyond the typical end-of-term evaluations - the results of which often arrive too late; are too vague; and have too little student participation to be of much use.

Bouwma-Gearhart and co-author Matthew T. Hora, of the University of Wisconsin-Madison, interviewed 59 STEM faculty and 20 administrators at large research universities. They wanted to know whether teaching faculty were using data to inform their teaching, and, if so, what kinds of data. They also wanted to better understand how educators are using data while in their classrooms.

"We found that faculty are gathering and responding to data, often using their own systems, and they are sometimes using it to advance their teaching in ways that go beyond what is required of them," Bouwma-Gearhart said

Given the push from policymakers and education leaders toward more data-driven decision-making, documenting and understanding these real-world practices could ultimately lead to the design of more systematic data collection that is useful and helpful for faculty as well as administrators, she said.

"People for the most part buy into the idea that data is good and that decision-making based on data is good," Bouwma-Gearhart said. "But we also see that faculty need flexibility with respect to what kind of data is useful and how the data is used. One-size-fits-all doesn't work when it comes to data to inform teaching practices."

Bouwma-Gearhart said additional research is needed to better understand what motivates some faculty, more than others, to use data to inform their teaching practice. She is currently studying what factors may induce organizational changes related to instructional data use and teaching practice within departments, programs or institutions.

"We found that there is no lack of STEM faculty caring about their teaching or saying that data is ultimately relevant to evaluate and inform their teaching," Bouwma-Gearhart said. "There is a rich conversation and effort underway. The question is how do we engage more faculty in meaningful conversations?"
-end-


Oregon State University

Related Education Articles:

The new racial disparity in special education
Racial disparity in special education is growing, and it's more complex than previously thought.
Education may be key to a healthier, wealthier US
A first-of-its-kind study estimate the economic value of education for better health and longevity.
How education may stave off cognitive decline
Prefrontal brain regions linked to higher educational attainment are characterized by increased expression of genes involved in neurotransmission and immunity, finds a study of healthy older adults published in JNeurosci.
Does more education stem political violence?
In a study released online today in Review of Educational Research, a peer-reviewed journal of the American Educational Research Association, three Norwegian researchers attempt to bring clarity to this question by undertaking the first systematic examination of quantitative research on this topic.
Education interventions improve economic rationality
This study proves that education can be leveraged as a tool to help enhance an individual's economic decision-making quality, or economic rationality.
Protestantism still matters when it comes to education, study shows
A new academic study, the first of its kind, reveals a significant and positive historical legacy of Protestant religion in education around the world.
Individual education programs not being used as intended in special education
Gone are the days when students with disabilities were placed in a separate classroom, or even in a completely different part of the school.
How does limited education limit young people?
A recent nationally-representative US Department of Education study found that 28 percent of fall 2009 ninth-graders had not yet enrolled in a trade school or college by February 2016 -- roughly six-and-a-half years later.
'Depression education' effective for some teens
In an assessment of their 'depression literacy' program, which has already been taught to tens of thousands, Johns Hopkins researchers say the Adolescent Depression Awareness Program (ADAP) achieved its intended effect of encouraging many teenagers to speak up and seek adult help for themselves or a peer.
Teenagers gamble away their education
The odds are stacked against teenagers who regularly gamble. A new study in Springer's Journal of Gambling Studies shows that a 14-year-old who gambles is more likely to struggle at school.
More Education News and Education Current Events

Top Science Podcasts

We have hand picked the top science podcasts of 2019.
Now Playing: TED Radio Hour

Risk
Why do we revere risk-takers, even when their actions terrify us? Why are some better at taking risks than others? This hour, TED speakers explore the alluring, dangerous, and calculated sides of risk. Guests include professional rock climber Alex Honnold, economist Mariana Mazzucato, psychology researcher Kashfia Rahman, structural engineer and bridge designer Ian Firth, and risk intelligence expert Dylan Evans.
Now Playing: Science for the People

#540 Specialize? Or Generalize?
Ever been called a "jack of all trades, master of none"? The world loves to elevate specialists, people who drill deep into a single topic. Those people are great. But there's a place for generalists too, argues David Epstein. Jacks of all trades are often more successful than specialists. And he's got science to back it up. We talk with Epstein about his latest book, "Range: Why Generalists Triumph in a Specialized World".
Now Playing: Radiolab

Dolly Parton's America: Neon Moss
Today on Radiolab, we're bringing you the fourth episode of Jad's special series, Dolly Parton's America. In this episode, Jad goes back up the mountain to visit Dolly's actual Tennessee mountain home, where she tells stories about her first trips out of the holler. Back on the mountaintop, standing under the rain by the Little Pigeon River, the trip triggers memories of Jad's first visit to his father's childhood home, and opens the gateway to dizzying stories of music and migration. Support Radiolab today at Radiolab.org/donate.