Aug. 15, 2007

To Tell The Truth To Pollsters

CBS' Kathy Frankovic: Voters Rarely Lie In Polls, But Sometimes Have Faulty Memories

  •  (CBS/AP)

  • Podcast Poll Positions

    Listen to CBS News director of surveys Kathy Frankovic dissect the data to see what's driving public opinion.

  • Section CBS News Polls

    Read the latest polls done by CBS News polling unit.

(CBS)  By Kathy Frankovic, CBS News director of surveys



Do people lie to pollsters?

After the wrong prediction in 1948 election, the editors of The New Yorker magazine thought people did — and that they should. "The total collapse of the public opinion polls," they wrote, "shows that the country is in good health .... (A)lthough you can take a nation's pulse, you can't be sure that the nation hasn't just run up a flight of stairs … (W)e are proud of America for clouding up the crystal ball, for telling one thing to a poll-taker, another thing to a voting machine. This is an excellent land."

There have been campaigns to lie to pollsters. In the early 1980s, Chicago newspaper columnist Mike Royko told people to do it before the Illinois primary. But when CBS News conducted a short poll in the Chicago area to see whether readers would take his advice, many people said they read the column, and enjoyed what Royko had to say, but also that they wouldn't take his advice seriously. And in fact, that year's primary election poll was quite accurate.

Lying takes more mental effort than telling the truth. Telling one lie usually means you need to tell more lies. It's much easier not to say anything, or just hang up the phone — which might help explain why response rates to polls have dropped over the years. If people take the time to answer a pollster's questions, they usually try to tell the truth!

However, some answers to poll questions may not be lies, but they also may not quite be the truth. They may be the product of faulty recall, or of misremembered memories. Respondents answer the questions they are asked, but if a question requires too much effort, they may do just enough thinking to come up with a reasonable answer. Survey psychologists call this "satisficing." (a combination of "satisfying" and "sufficing").

Some survey questions do require a detailed recall of events. For surveys involving expenditures, researchers will ask respondents to look at their financial records, and NOT to rely only on their memories. People who study victimization or consumer behavior know that reports of events (such as a crime, or a major purchase) can be put in the wrong time period. People may "telescope" their memory of an event, thinking that what happened a long time ago happened more recently. And different people do conceptualize time differently. As a political scientist and pollster, for example, I often think in terms of four-year presidential election cycles, so sometimes I say "last year" when I mean 2004.

It's also true that people sometimes base their responses to questions on what they think the interviewer wants to hear. In the 1980s, some respondents, asked about their support for feminist issues, told different things to male and female interviewers. And sometimes black and white interviewers have gotten different answers when they have asked about some African-American candidates and about racial attitudes.

Then there are times when people give a false answer to a question because they think that telling the truth could leave the wrong impression. For example, people who attend church most Sundays might very well tell an interviewer that they went to church "last Sunday," even if they didn't, reasoning that, if the interviewer had asked that question last week, it would have been true.

Just as people think of themselves as "church-goers," they also think of themselves as "voters," especially when asked about politics and elections. It's not that they lie about voting — rather, they like to think of themselves as people who vote. And some of those who misreport voting in one election have voted in the past, though not necessarily in the election the pollster has asked about.

Finally, questions about past elections may become assessments of current feelings, not reports of actual past votes. One spectacular change in vote reporting took place between 1960 and 1964. Right after the close election of 1960, the Survey Research Center at the University of Michigan found an evenly divided electorate, much like the actual nationwide results. Two years later, however, 56 percent of voters said they had voted for John F. Kennedy and just 43 percent said they voted for Richard Nixon. In 1964, after JFK's 1963 assassination, his narrow victory of 1960 had turned into a 28-point landslide in voters' memories: 64 percent of those interviewed said they had voted for JFK, while only 36 percent admitted voting for Nixon.

Voters have had a roller coaster ride with their memories when it comes to the current president, too! Immediately after the 2000 election, voters reported their 2000 vote accurately in a CBS News Poll. It was a close election and a close poll result. In the latest CBS News Poll, self-reports of the 2004 vote give President Bush a 6-point lead over John Kerry, only slightly inflated from the actual outcome.

But as George W. Bush's approval rating soared to 90 percent following the terrorist attacks of Sept. 11, 2001, Bush also gained votes. Al Gore's narrow victory in the national tabulated vote turned into an apparent 16-point Bush landslide in the January 2002 CBS News Poll. That caused one producer to say to me: "Why couldn't this have been the result? We wouldn't have had to spend 35 days after the election figuring out who won!"

By Kathy Frankovic
© MMVII, CBS Interactive Inc. All Rights Reserved.
Share:
  • Share
  • Yahoo! Buzz
  • Mixx
Add a Comment
by clestes-2009 August 16, 2007 3:36 PM EDT
No, I do not believe that reps are embracing dem beliefs. Or maybe the more moderates are. What is happening is the reps are turning away from the policies of the reps in power now. AND the rep candidates are all offering the same policies as the reps in power now.

That is not going to fly next year. No matter what the dems are pushing, the failed war in Iraq and the desire to get our soldiers out is the MOST PRESSING ISSUE on American minds.

Healthcare, abortion, stem cells, education, immigration ARE ALL LESS IMPORTANT.

reps that push to keep the same BS going on and on and support leaving 100,000 troops ARE ALL GOING TO LOSE.

Iraq is the one issue that is uniting Americans who have been divided for 6 years
Reply to this comment
by xzavierbrown August 15, 2007 7:15 PM EDT
I would question the motive of WHO IS TAKING THE POLLS.
Reply to this comment
by cbs_oliver August 15, 2007 4:35 PM EDT
Good article.

The standout example of wishful recall/thinking to my mind is what most people say when asked if they believe in God and/or the Ten Commandments.

Reply to this comment
by jimmyc1955 August 15, 2007 4:29 PM EDT
Clestes - you have made an assumption that Republicans loosing the majority is an approval of Democratic policies - you couldn't be further from the truth.

If you look at the "pools" you will find the Democratic led Congress is liked as little as Bush. The last election was not a mandate but a statement of disgust for status quo and politicians who ignore their duty to lead and choose to line their pockets - and both parties are looking pretty ugly right now.

What I think both parties are missing is a fundimental shift to conservative economics, mildly liberal social policies and active foriegn policies but without military intervention.

Hard left liberals are pushing for programs that most of America won't support - nationalized health care being the biggest. Frankly shifting my costs from a private insurer to a Government taxing agency only means that costs will rise and healthcare will suffer.

Bill Clinton won the White House twice as a moderate. The hard left of the Dems party won't allow a moderate "3rd way" candidate now - thats a mistake.

Republicans have got to quit spending money like drunken sailors.

Reply to this comment
by oakishpines August 15, 2007 3:31 PM EDT


where can i find a county trail group that still invests dollars in non charity and votes in taxation?


and is there really a real county with closed borders and folk dancing real nonpornographic get sick tax world songs at each trail crossing?

if so, is there a chance that there will be more in the future?


i'm so tired of folk dancing get well feed world songs around all the sick beds drifting the spore bloom weed dragon trail fickle first aid lunch farm cottage studio trails


' a naked girl once spanked a man for wearing clothes, then: a hundred girls retaliated against her throwing a war ... 10,000 boys got spanked and 1 million women and 100 million men ... war is terrible ... and that's why you don't go around spanking folk that don't want to get spanked '

Reply to this comment
by clestes-2009 August 15, 2007 2:58 PM EDT
I still do not understand why results of polls and the loss in 2006 is hard to understand.

The American people REALLY ARE unhappy with Bush, the road he is taking and what he has done in Iraq. There is barely over 25% of America that thinks this is good.

The rest of America is turning away. And the stupid rep candidates are all going to continue the same policies that Bush has. Don't they have a clue of what is happening???????

Next year, the majority of rep will either vote Democratic or not at all.

It is going to be a watershed election for democratics. And afterwards, these same neo-con candidates will analyze and and try to explain the results as a fluke. Idiots!!!

The Nov 2006 elections were not a fluke and the Nov 2008 elections won't be either.
Reply to this comment
  • MOST POPULAR
Discussed
  1. Tempers Flare In Climate Change Flap

    (622 recent comments)

Latest News
News in Pictures
Scroll Left Scroll Right
Connect with CBS News

Stay connected with the CBS News using your favorite social networks and online news applications: