By

Ed Yong /

Discover/ April 26, 2011, 2:13 PM

New evidence that IQ is not set in stone

Ever since there have been IQ tests, people have debated what they actually measure. Is it "intelligence", is it an abstract combination of mental abilities, or is it, as Edwin Boring said, "the capacity to do well in an intelligence test"? Regardless of the answer, studies have repeatedly shown that people who achieve higher scores in IQ tests are more likely to do well in school, perform well in their jobs, earn more money, avoid criminal convictions, and even live longer. Say what you like about the tests, but they have predictive power.

However, Angela Lee Duckworth from the University of Pennsylvania has found that this power is overrated. The link between our IQs and our fates becomes muddier when we consider motivation - an aspect of test-taking that is often ignored. Simply put, some people try harder in IQ tests than others. If you take this into account, the association between your IQ and your success in life becomes considerably weaker. The tests are not measuring intelligence alone, but also the desire to prove it.

Many standardized tests assume that the people who take them are alert and motivated. As such, their scores reflect the height of their abilities. IQ tests are no different. The questions are ordered by difficulty to keep people's morale up. Edward Thorndike, a pioneer of intelligence testing, wrote that "all our measurements assume that the individual in question tries as hard as he can to make as high a score as possible", although he admitted that no one knew if that was the case.

To look at how motivation affects IQ scores, Duckworth reviewed 25 previous studies, which included a total of 2,008 people. She found that people achieved higher IQ scores on average if they were given material incentives to take the tests, such as money or sweets, particularly if they had above-average IQs anyway. This alone suggests that motivation can skew the results of the tests.

Next, Duckworth looked at the scores of 508 young boys who had taken an IQ test in 1987. The boys were part of the Pittsburgh Youth Study, and researchers kept in touch with them into adulthood, for at least 12 years after the original test. As usual, their scores predicted their eventual academic performance, the number of years they spent in education, their odds of being employed as adults, and their number of criminal convictions.

But there was more. The original tests were all delivered verbally and the sessions were filmed. Duckworth recruited three independent researchers to review the footage for signs of low motivation, such as refusing to take part, or wanting the session to end. The team found that boys with lower IQ scores were also less motivated when they took the test, and their degree of motivation also predicted the course of their lives. Accounting for motivation weakened the link between IQ and life-success, especially for employment and criminal convictions.

Duckworth says, "It is important not to overstate our conclusions." IQ tests can still predict other aspects of our lives. Motivation reduces that predictive power, but it doesn't destroy it altogether. The point is that people with above-average IQs also tend to try harder on IQ tests, and they do so more consistently. Duckworth writes, "These findings imply that earning a high IQ score requires high intelligence in addition to high motivation. Lower IQ scores, however, might result from either lower intelligence or lack of motivation."

The problem, as ever, lies in making too much of the test results, in seeing them as a sign of natural ability and future potential. After all, motivation is itself affected by a person's background, and their beliefs in their future options and their chances of success. It could partially explain differences in test scores between people of different genders, social backgrounds and nationalities.

If you think it's obvious that motivation would confound the results of IQ tests, then Robert Stenberg, who studies intelligence at Oklahoma State University, agrees with you. "D'uh!", he says. Sternberg thinks that Duckworth has produced a "great research study" but adds, "To almost anyone except some subset of psychologists who study IQ testing, it will come as little surprise that motivation is an extremely powerful determinant of performance in school and in life. Most employers, for example, are at least as eager to know about job applicants' motivation as they are to know about their cognitive skills. Teachers also know that ability without high motivation typically results in little success in a challenging curriculum."

Duckworth herself recognizes that people who actually administer the tests will be well aware of the issue of motivation. She says, "Where the problem lies, in our view, is in the interpretation of IQ scores by economists, sociologists, and research psychologists who have not witnessed variation in test motivation firsthand. [They] might erringly assume that a low IQ score invariably indicates low intelligence."

Is this view common? Sternberg thinks so, pointing to the fact that Duckworth's study was newsworthy enough to be published in PNAS, one of the world's most prestigious scientific journals. "[This shows] how off-track our society has gone in its acceptance of commercial persuasive appeals to buy into standardized tests as some kind of panacea for predicting almost any outcome in life that we value.

"The irony of the study is that it shows the tests indeed can be useful, but as joint measures of cognitive skills and motivation. The tests also indirectly measure many other variables, such as quality of schooling, type of socialization in the home, and parents' ability to provide their children with a home environment that fosters the kinds of skills that tests measure. IQ tests, like all tests, are agglomerate measures of many things. They are not pure measures of some kind of "intelligence" or anything else.

"Ultimately, it would be desirable if we recognized that many skills are required for success in life and if we grew beyond using contemporary tests, which are minor cosmetic variants of tests used a century ago. (Imagine where we would be if our medical testing were essentially the same as it was 100 years ago.) Instead of limiting ourselves to narrow standardized tests, we might seek as well directly to assess motivation as well as creativity, practical skills, wisdom, and even ethics. If we did, we might find our society advancing to levels of economic productivity and, for that matter, well-being that we previously believed to be out of reach."

Reprinted with permission from Discover.
24 Comments Add a Comment
linkicon reporticon emailicon
amenhammer says:
Maybe if one isn't motivated on an IQ test it says something about their IQ?
reply
roblearns replies:
linkicon reporticon emailicon
yes, no kidding, why would someone who knows they will do poorly, be really excited about demonstrating it. Like these boys had absolutely no indication from any experience in life, how they would do on a test.

Silliness, and furthermore it doesn't even matter. Even if there is a link to motivation, they didn't offer any proof that this motivation isn't inherited - we'll see, conjure up motivation for a lifetime, and get back to me.
linkicon reporticon emailicon
amenhammer says:
Maybe if one isn't motivated on an IQ test it says something about their IQ?
reply
linkicon reporticon emailicon
janet_joplin says:
The title is misleading. They have not proven anything about IQ, only IQ Testing. The Results of IQ testing may not be indicative of IQ. A persons Actual IQ may well be and probably is set in stone. This article proves that IQ tests are not good indicators of Actual IQ and that the motivation of the test-taker will effect the results. I have never seen any evidence that IQ will change over time, given a properly motivated test-taker. The author ot this article must have a low IQ - to not realize that fact. Motivation can change daily since it is an emotional state of an individual.
reply
linkicon reporticon emailicon
nfission says:
I knew people with very high IQs who found regular jobs and stayed with them, no college. In the grand scheme of things they've done just as well. I went to college got my bachelors, then went on to obtain hours in a Master's, felt like I wasted some time there. Meanwhile I lost several years of working. I think some of the people with high IQs are smart enough not to enter the "rat race."
reply
John_Rational replies:
linkicon reporticon emailicon
I have a friend who is obviously very intelligent but not very motivated to succeed. I asked him one day why he didn't use his high intelligence to succeed. He replied that he had done that and was very pleased with his success. I said he was too intelligent to actually believe he was a true success. He answered,"If I'm as intelligent as you think I am, perhaps you simply don't understand what I'm up to."
linkicon reporticon emailicon
erasmus111 says:
"Regardless of the answer, studies have repeatedly shown that people who achieve higher scores in IQ tests are more likely to do well in school...."


Not so. I know a child that wasn't doing so well in school, and then for some reason a teacher clued into something and ended up having her tested. Turns out she's actually "gifted".
reply
linkicon reporticon emailicon
berlinfoto-2009 says:
If you have a child that is particular brilliant, my suggestion to you and this is based upon fact and experience. Never let the government find this fact out, do anything to conceal this brilliance, home school your child, keep him out of public schools. Never let him take a IQ test, not at school not in a psychological examination or medical examination never. Keep them away from government employees and former employees, even ex-military. Brilliant Children are reported, and the government will never leave them alone.
reply
linkicon reporticon emailicon
leroy235ahc says:
That's what got me in here, hiring u to defend me. I think the turning point in my case was when u woke up in the courtroom and told the judge "It wasn't my client, it was the one arm man." By the way how is my ex doing? Hope she took u to the cleaners the same way you did me.
reply
linkicon reporticon emailicon
incog-nito says:
Nothing new here. My IQ drops drastically after several drinks, then downs to zero after several more, until next morning.
reply
linkicon reporticon emailicon
PourpaixPourpaix says:
Fascinating discovery! Who would have thought that people who don't feel like taking some stupid test turn out not to do well on the test? Anyone know where I can get a plush job studying the obvious? Maybe get a Nobel prize for showing a correlation between people who live in blue houses and people who buy blue paint?
reply
linkicon reporticon emailicon
leroy235ahc says:
I am fortunate to have a genius iq and have always been highly movitated which has enabled me to have the highest paying job in the institution. I'm the head porter in the visiting room @ Jackson prison so I agree with this new finding.
reply
See all 24 Comments