Teacher quality scores change depending on students, school, PSU study finds

November 12, 2020

School districts across the U.S. are increasingly using student test scores to rate the effectiveness of teachers, but a new Portland State University study found that the scores have less to do with individual teachers and more to do with their students and the schools.

The study looked at the value-added scores of 4,500 teachers in a large urban district as they changed schools between 2007 and 2013. The idea of value-added models is to measure the impact a teacher has on student learning by comparing new test scores to previous ones, and comparing test score gains across teachers. Supporters of the approach say looking at how much a student has progressed in a year, regardless of where they started from, captures the effectiveness of a teacher.

Dara Shifrer, the study's author and sociology professor at PSU's College of Liberal Arts and Sciences, said that if that's true, then a teacher's score should remain constant regardless of the school they work in or the type of students they teach.

Instead, when she tracked individual teachers, she found that their scores increased when they switched into high-performing (often low-poverty) schools and decreased when they switched into low-performing (often high-poverty) schools.

"If the teacher moved to a school where there were more poor students, more English language learners or generally more challenging teaching environments, then their scores dropped," Shifrer said. "The changes in individual teachers' scores over time were consistent with shifts in the economic status and race of students in their classrooms and schools."

The study focused on scores from the Education Value-Added Assessment System (EVAAS), which is used in a dozen states, including Arkansas, California, Delaware, Georgia, Indiana, North Carolina, Ohio, Pennsylvania, South Carolina, Tennessee, Texas and Virginia.

Shifrer said the study is more evidence that the factors beyond a teacher's control -- socioeconomic background, the impact of social inequality, racial segregation -- affect students' learning and whether teachers and schools are seen as effective.

"These value-added scores haven't solved the problem of how to evaluate teacher quality and they limit our ability to understand how students learn and what affects it," she said. "Policymakers need to recognize how powerfully social inequality outside of schools affects what's happening inside of schools."

Shifrer said that educational disparities will be most effectively addressed by targeting inequality in society. The study recommends that teachers who work in high-poverty schools be paid a higher salary and schools should be sufficiently funded to provide the social services that are necessary to support their students.
The study was published in the journal Social Problems.

Portland State University

Related Learning Articles from Brightsurf:

Learning the language of sugars
We're told not to eat too much sugar, but in reality, all of our cells are covered in sugar molecules called glycans.

When learning on your own is not enough
We make decisions based on not only our own learning experience, but also learning from others.

Learning more about particle collisions with machine learning
A team of Argonne scientists has devised a machine learning algorithm that calculates, with low computational time, how the ATLAS detector in the Large Hadron Collider would respond to the ten times more data expected with a planned upgrade in 2027.

Getting kids moving, and learning
Children are set to move more, improve their skills, and come up with their own creative tennis games with the launch of HomeCourtTennis, a new initiative to assist teachers and coaches with keeping kids active while at home.

How expectations influence learning
During learning, the brain is a prediction engine that continually makes theories about our environment and accurately registers whether an assumption is true or not.

Technology in higher education: learning with it instead of from it
Technology has shifted the way that professors teach students in higher education.

Learning is optimized when we fail 15% of the time
If you're always scoring 100%, you're probably not learning anything new.

School spending cuts triggered by great recession linked to sizable learning losses for learning losses for students in hardest hit areas
Substantial school spending cuts triggered by the Great Recession were associated with sizable losses in academic achievement for students living in counties most affected by the economic downturn, according to a new study published today in AERA Open, a peer-reviewed journal of the American Educational Research Association.

Lessons in learning
A new Harvard study shows that, though students felt like they learned more from traditional lectures, they actually learned more when taking part in active learning classrooms.

Learning to look
A team led by JGI scientists has overhauled the perception of inovirus diversity.

Read More: Learning News and Learning Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.