The GRE fails to identify students that will graduate and hurts diversity, new study finds

January 29, 2019

Researchers are urging universities across the United States to find a new way to identify the next generation of scientists. A new study discovered that traditional admissions metrics for physics Ph.D. programs such as the Graduate Record Examination (GRE) do not predict completion and hurt the growth of diversity in physics, which is already the least diverse of the sciences.

A team of researchers led by Rochester Institute of Technology Professor and Associate Dean for Research and Faculty Casey Miller completed a multivariate statistical analysis of about one in eight physics Ph.D. students from 2000 to 2010 and published the findings in Science Advances. They discovered that while women and underrepresented minorities tend to perform worse on the GRE Physics Subject Test, students' performance had no bearing on Ph.D. completion. Undergraduate GPA was the most robust predictor of Ph.D. completion they found. Miller said this the largest study that has ever been done in physics specifically looking at the correlations between admissions data and outcomes at the graduate level.

"What we show here is that there is no correlation with the physics GRE test and graduation," said Miller. "That's a big deal because the test is used in a large fraction of the Ph.D. programs in the U.S. and they use it with a minimum acceptable score. First off, if it's meaningless then it doesn't make any sense to use it that way. The second problem is that the test, like all standardized tests, shows significant gender and race-based differences. When you use a minimum acceptable score on a tool that has race and gender-based differences, the outcome is fewer women of all races and underrepresented minorities of all gender identities get into Ph.D. programs, despite the tool being ineffective at telling us who will finish."

Studies indicate that less than 5 percent of physics Ph.D. degrees are granted annually to people who identify as Black, Latino or Native American, and just 20 percent of physics Ph.D. degrees are granted to women. Miller said that to help close the gap, universities need to develop better methods to assess the non-academic factors that make successful Ph.D. students.

"If you ask faculty, the most important things that make a great student are non-cognitive things like perseverance and grit that we don't measure right now," said Miller. "One of my goals is to develop an assessment of such competencies for the front end of the admissions process. The advantage of that is that decades of research on such measures has not shown any significant race or gender-based differences on performance."
-end-
The study was funded in part by the NSF INCLUDES Alliance: IGEN (HRD-1834516) and the NSF's Innovations in Graduate Education program (DGE-1806705). Other researchers who contributed to the study include Benjamin M. Zwickl, assistant professor of physics at RIT; Julie R. Posselt, assistant professor of higher education in the USC Rossier School of Education; Rachel Silvestrini, associate professor of industrial and systems engineering at RIT; and Theodore Hodapp, director of education at the American Physical Society.

To read the full study, visit http://advances.sciencemag.org/content/5/1/eaat7550.

For more information, contact Luke Auburn at 585-475-4335, lraits@rit.edu or on Twitter: @lukeauburn.

Rochester Institute of Technology

Related Diversity Articles from Brightsurf:

More plant diversity, less pesticides
Increasing plant diversity enhances the natural control of insect herbivory in grasslands.

Insect diversity boosted by combination of crop diversity and semi-natural habitats
To enhance the number of beneficial insect species in agricultural land, preserving semi-natural habitats and promoting crop diversity are both needed, according to new research published in the British Ecological Society's Journal of Applied of Ecology.

Ethnolinguistic diversity slows down urban growth
Where various ethnic groups live together, cities grow at a slower rate.

Protecting scientific diversity
The COVID-19 pandemic means that scientists face great challenges because they have to reorient, interrupt or even cancel research and teaching.

Cultural diversity in chimpanzees
Termite fishing by chimpanzees was thought to occur in only two forms with one or multiple tools, from either above-ground or underground termite nests.

Bursts of diversity in the gut microbiota
The diversity of bacteria in the human gut is an important biomarker of health, influences multiple diseases, such as obesity and inflammatory bowel diseases and affects various treatments.

Underestimated chemical diversity
An international team of researchers has conducted a global review of all registered industrial chemicals: some 350,000 different substances are produced and traded around the world -- well in excess of the 100,000 reached in previous estimates.

New world map of fish genetic diversity
An international research team from ETH Zurich and French universities has studied genetic diversity among fish around the world for the first time.

Biological diversity as a factor of production
Can the biodiversity of ecosystems be considered a factor of production?

Fungal diversity and its relationship to the future of forests
Stanford researchers predict that climate change will reduce the diversity of symbiotic fungi that help trees grow.

Read More: Diversity News and Diversity Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.