Renorming IQ tests due to Flynn effect may have unintended consequences

October 19, 2003

WASHINGTON -- The steady rising of IQ scores over the last century - known as the Flynn effect - causes IQ tests norms to become obsolete over time. To counter this effect, IQ tests are "renormed" (made harder) every 15-20 years by resetting the mean score to 100 to account for the previous gains in IQ scores. But according to new research, such renorming may have unintended consequences, particularly in the area of special education placements for children with borderline or mild mental retardation. The findings are reported on in the October issue of American Psychologist, a journal of the American Psychological Association (APA).

Researchers Tomoe Kanaya, M.A. and Stephen J. Ceci, Ph.D., of Cornell University and Matthew H. Scullin, Ph.D., of West Virginia University used IQ data from nearly 9,000 school psychologist special education assessments from nine school districts across the U.S. to document how the Flynn effect influences mental retardation diagnoses for several years after a new test is introduced. The students (ages 6 - 17) were from different geographical regions, neighborhood types and socioeconomic status.

The results show that the test renorming due to the Flynn effect influences which children are diagnosed with mental retardation regardless of their actual cognitive ability. According to the researchers, children in the same classroom with the same cognitive ability could be diagnosed differently simply because different test norms were used for each child. Students in the borderline and mild mental retardation range lost an average of 5.6 IQ points when retested on a renormed test and were more likely to be classified mentally retarded compared with peers retested on the same test, according to the study.

Specifically, when a commonly used IQ test (the Wechsler Intelligence Scale for Children or WISC) was renormed to account for the Flynn effect, the number of children in the borderline mental retardation range (IQ 66-70) recommended for special school programs due to mild mental retardation tripled during the first five years of the new test compared to an equivalent IQ range during the last five years of the previous test.

"Some students who would be eligible for mental retardation services under new IQ norms will fail to receive them because the older norms of the IQ test they were given allowed them to score above the cutoff," write the researchers. "Also, students who would not have qualified for mental retardation services had they been tested a year earlier will now do so if they are given an IQ test with newer, harder norms." Not only does this deny services to some students who need them, it wreaks havoc with school system's special education budgets because there are dramatic changes in the numbers of children that will qualify for special educational services.

Besides educational and financial issues, the Flynn effect and the renormed IQ tests can also have important legal implications. Nowhere are the consequences of IQ score fluctuations due to the Flynn effect more critical, say the authors, than in the determination of whether a death row inmate can be considered mentally retarded. "Our results imply that the year that a capital murder defendant was tested can determine whether she or he is sentenced to die as opposed to life imprisonment. This raises concerns regarding inmates on death row who tested above the 70-75 IQ cutoff on a test that was near the end of its norming cycle - when scores are highly inflated as well as an inmate who tested in the mental retardation range during the earliest years of a new norm - when the test is hardest," according to the researchers.

The Flynn effect also has military occupational consequences, according to the study. Depending on which IQ norms are used, a military recruit might be eligible or not for military service and influence whether they will be allowed to enter certain occupations or occupy certain ranks in the military.

"The main conclusion that can be drawn from these results is that caution should be used when basing important financial, social or legal decision on IQ scores," say the researchers. "Perhaps the most important times to be particularly cautious are when a test is either at the beginning or at the tail end of its norming cycle. Although test scores are most valid at the beginning of a norming cycle, they run the greatest risk of being compared to highly inflated scores from the waning years of the previous norming cycle."
-end-
Article: "The Flynn Effect and U.S. Policies. The Impact of Rising IQ Scores on American Society Via Mental Retardation Diagnoses," Tomoe Kanaya, Cornell University, Matthew H. Scullin, West Virginia University and Stephen J. Ceci, Cornell University; American Psychologist, Vol. 58, No. 10.

Full text of the article is available from the APA Public Affairs Office or at http://www.apa.org/releases/flynneffect_article.pdf.

Reporters: Tomoe Kanaya can be reached at 212-302-0903 or by e-mail at tk74@cornell.edu and Matthew Scullin can be reached at 304-293-2001, ext. 31676 or by e-mail at matthew.scullin@mail.wvu.edu.

The American Psychological Association (APA), in Washington, DC, is the largest scientific and professional organization representing psychology in the United States and is the world's largest association of psychologists. APA's membership includes more than 150,000 researchers, educators, clinicians, consultants and students. Through its divisions in 53 subfields of psychology and affiliations with 60 state, territorial and Canadian provincial associations, APA works to advance psychology as a science, as a profession and as a means of promoting health, education and human welfare.

American Psychological Association

Related Mental Retardation Articles from Brightsurf:

Mental health strained by disaster
A new study found that suicide rates increase during all types of disasters -- including severe storms, floods, hurricanes and ice storms -- with the largest overall increase occurring two years after a disaster.

World Mental Health Day -- CACTUS releases report of largest researcher mental health survey
On the occasion of 'World Mental Health Day' 2020, CACTUS, a global scientific communications company, has released a global survey on mental health, wellbeing and fulfilment in academia.

Mental illness, mental health care use among police officers
A survey study of Texas police officers examines how common mental illness and mental health care use are in a large urban department.

COVID-19 may have consequences for mental health
The COVID-19 pandemic appears to be adversely affecting mental health among hospitalised patients, the healthcare professionals treating them and the general population.

Skills training opens 'DOORS' to digital mental health for patients with serious mental illness
Digital technologies, especially smartphone apps, have great promise for increasing access to care for patients with serious mental illness such as schizophrenia.

Can Facebook improve your mental health?
Contrary to popular belief, using social media and the internet regularly could improve mental health among adults and help fend off serious psychological distress, such as depression and anxiety, finds a new Michigan State University study.

Empathy often avoided because of mental effort
Even when feeling empathy for others isn't financially costly or emotionally draining, people will still avoid it because they think empathy requires too much mental effort, according to new research published by the American Psychological Association.

A gut feeling for mental health
The first population-level study on the link between gut bacteria and mental health identifies specific gut bacteria linked to depression and provides evidence that a wide range of gut bacteria can produce neuroactive compounds.

Student-run mental health education efforts may improve college mental health climate
Studies estimate that 20 percent to 36 percent of college students cope with some form of serious psychological distress, yet only about a third receive any services despite the fact they often have access to on-campus help.

How mental health diagnosis should be more collaborative
New research published in The Lancet Psychiatry finds that mental health diagnosis should be more collaborative.

Read More: Mental Retardation News and Mental Retardation Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.