Nav: Home

Lacking other meaningful data, university faculty devise their own evaluation systems

August 23, 2016

CORVALLIS, Ore. - In the fast-growing and job-rich disciplines of science, technology, engineering, and mathematics, or STEM, improving instruction at the college level is critical to keeping students engaged in these fields.

But filling in bubbles on institutionalized end-of-term teacher evaluation questionnaires, a standard practice at many large research universities, often fails to produce timely and meaningful data for improving instruction, according to a new study from Oregon State University that explores how faculty are evaluating their teaching practice.

The researchers found that faculty teaching in the STEM disciplines at large research universities are devising their own systems to collect instructional data from their classrooms and using that data to inform their teaching.

Instructors are using quantitative data about their students' classroom performance as well as qualitative data such as student feedback from mid-term surveys or informal conversations, said Jana Bouwma-Gearhart, an associate professor of science and mathematics education at OSU and lead author of the study.

"Some faculty have really created these elaborate data and analysis systems, even though they are not yet required to," said Bouwma-Gearhart, who also serves as an associate dean in OSU's College of Education. "They are using these systems to talk about their instruction and to help inform decisions about programs and curriculum."

The findings were published recently in the Journal of Higher Education Management. The research was supported by a grant from the National Science Foundation.

As universities continue to look at ways to improve student success, there is a growing emphasis in higher education for teaching faculty to be good educators who spend time developing and improving their skills in response to valid and reliable data. This may be particularly critical to retaining students in the STEM fields because students who struggle often opt to leave these disciplines altogether, Bouwma-Gearhart said.

In large enrollment universities -those with 15,000 or more students enrolled - many undergraduate courses in the STEM disciplines are taught by full- time educators who would likely be considered experts in that discipline.

However, Bouwma-Gearhart and colleagues found that instructors who teach these courses often lack access to structured or formal opportunities to reflect on meaningful data about their teaching beyond the typical end-of-term evaluations - the results of which often arrive too late; are too vague; and have too little student participation to be of much use.

Bouwma-Gearhart and co-author Matthew T. Hora, of the University of Wisconsin-Madison, interviewed 59 STEM faculty and 20 administrators at large research universities. They wanted to know whether teaching faculty were using data to inform their teaching, and, if so, what kinds of data. They also wanted to better understand how educators are using data while in their classrooms.

"We found that faculty are gathering and responding to data, often using their own systems, and they are sometimes using it to advance their teaching in ways that go beyond what is required of them," Bouwma-Gearhart said

Given the push from policymakers and education leaders toward more data-driven decision-making, documenting and understanding these real-world practices could ultimately lead to the design of more systematic data collection that is useful and helpful for faculty as well as administrators, she said.

"People for the most part buy into the idea that data is good and that decision-making based on data is good," Bouwma-Gearhart said. "But we also see that faculty need flexibility with respect to what kind of data is useful and how the data is used. One-size-fits-all doesn't work when it comes to data to inform teaching practices."

Bouwma-Gearhart said additional research is needed to better understand what motivates some faculty, more than others, to use data to inform their teaching practice. She is currently studying what factors may induce organizational changes related to instructional data use and teaching practice within departments, programs or institutions.

"We found that there is no lack of STEM faculty caring about their teaching or saying that data is ultimately relevant to evaluate and inform their teaching," Bouwma-Gearhart said. "There is a rich conversation and effort underway. The question is how do we engage more faculty in meaningful conversations?"
-end-


Oregon State University

Related Education Articles:

Online education platforms could scale high-quality STEM education for universities
Online and blended (online and in-person) STEM instruction can produce the same learning outcomes for students as traditional, in-person classes at a fraction of the cost, finds research published today in Science Advances.
Technology in higher education: learning with it instead of from it
Technology has shifted the way that professors teach students in higher education.
The new racial disparity in special education
Racial disparity in special education is growing, and it's more complex than previously thought.
Education may be key to a healthier, wealthier US
A first-of-its-kind study estimate the economic value of education for better health and longevity.
How education may stave off cognitive decline
Prefrontal brain regions linked to higher educational attainment are characterized by increased expression of genes involved in neurotransmission and immunity, finds a study of healthy older adults published in JNeurosci.
Does more education stem political violence?
In a study released online today in Review of Educational Research, a peer-reviewed journal of the American Educational Research Association, three Norwegian researchers attempt to bring clarity to this question by undertaking the first systematic examination of quantitative research on this topic.
Protestantism still matters when it comes to education, study shows
A new academic study, the first of its kind, reveals a significant and positive historical legacy of Protestant religion in education around the world.
Individual education programs not being used as intended in special education
Gone are the days when students with disabilities were placed in a separate classroom, or even in a completely different part of the school.
How does limited education limit young people?
A recent nationally-representative US Department of Education study found that 28 percent of fall 2009 ninth-graders had not yet enrolled in a trade school or college by February 2016 -- roughly six-and-a-half years later.
'Depression education' effective for some teens
In an assessment of their 'depression literacy' program, which has already been taught to tens of thousands, Johns Hopkins researchers say the Adolescent Depression Awareness Program (ADAP) achieved its intended effect of encouraging many teenagers to speak up and seek adult help for themselves or a peer.
More Education News and Education Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: Reinvention
Change is hard, but it's also an opportunity to discover and reimagine what you thought you knew. From our economy, to music, to even ourselves–this hour TED speakers explore the power of reinvention. Guests include OK Go lead singer Damian Kulash Jr., former college gymnastics coach Valorie Kondos Field, Stockton Mayor Michael Tubbs, and entrepreneur Nick Hanauer.
Now Playing: Science for the People

#562 Superbug to Bedside
By now we're all good and scared about antibiotic resistance, one of the many things coming to get us all. But there's good news, sort of. News antibiotics are coming out! How do they get tested? What does that kind of a trial look like and how does it happen? Host Bethany Brookeshire talks with Matt McCarthy, author of "Superbugs: The Race to Stop an Epidemic", about the ins and outs of testing a new antibiotic in the hospital.
Now Playing: Radiolab

Speedy Beet
There are few musical moments more well-worn than the first four notes of Beethoven's Fifth Symphony. But in this short, we find out that Beethoven might have made a last-ditch effort to keep his music from ever feeling familiar, to keep pushing his listeners to a kind of psychological limit. Big thanks to our Brooklyn Philharmonic musicians: Deborah Buck and Suzy Perelman on violin, Arash Amini on cello, and Ah Ling Neu on viola. And check out The First Four Notes, Matthew Guerrieri's book on Beethoven's Fifth. Support Radiolab today at Radiolab.org/donate.