July 18, 2007

The Faces Behind The Polls

CBS' Kathy Frankovic: Finding People To Conduct Opinion Surveys Is An Art In Itself

  •  (CBS/AP)

  • Section CBS News Polls

    Read the latest polls done by CBS News polling unit.

  • Podcast Poll Positions

    Listen to CBS News director of surveys Kathy Frankovic dissect the data to see what's driving public opinion.

(CBS)  Have you ever talked to a pollster?

The people whose names are famous as pollsters — like Gallup, Harris, and Roper — can't and don't do the actual interviewing. For that job, they rely on hundreds of other less famous individuals who have a variety of backgrounds, qualifications and training.

Interviewers are the core of the survey process; they call you, talk with you and record your answers. Bad interviewers distort the way questions are asked, mispronounce the names of candidates, and inject their own opinions into the results. Good interviewers know what they are asking, are uniformly polite and stick to the interviewing script, so every person is interviewed the same way.

When modern polling began in the 1930s, interviewers went door to door in selected locations: interestingly, most were women. In a 1946 study, interviewers themselves were interviewed and asked what they looked for in a job. They wanted flexible hours, a job they could fit in to their daily lives, the freedom to accept or reject assignments — and extra income. In short, what they wanted was a part-time job, which is exactly what interviewing then provided.

Telephone interviewing supplanted door-to-door interviewing in the 1970s. At that point, more than 90 percent of all households could be reached by phone — and, coincidentally, rising crime rates and insecurity made door-to-door interviewing in urban areas almost impossible. Telephone interviewing also cost less and came with better quality control. Having interviewers in one central location means they all receive the same training. Phone calls are monitored to be sure that everyone is asked the same questions the same way. It's true that a recorded voice — or a Web-based questionnaire — would ask the same question the same way, but neither of those techniques sense when a respondent is having a difficult time with a question and can report that back to the poll manager.

That's where live interviewers really make a difference. They decide who should be interviewed, they have direct contact with the people interviewed, and they know when a poll question simply doesn't work — when respondents don't understand it. Interviewing today can be a full-time job, and the proportion of male interviewers has increased: among the active interviewers who now work on CBS News Polls, slightly more than half are men.

There has been a wealth of research on how to ask questions, and on the impact individual interviewers can have on the process. Public Opinion Quarterly, the official journal of the American Association for Public Opinion Research, has published more than 50 articles about interviewers, how to train them, and their impact on respondents. There have been studies of interviewers' voices, their verbal idiosyncrasies, their attitudes and their demographic characteristics. Do women interviewers get different answers on questions about women's rights than male interviewers do? What kinds of respondents — men or women — give different answers to male and female interviewers? In this election, with a woman, Hillary Clinton, currently the front-running Democratic candidate for president, analysis of questions like these should become routine.

Interviewers for the CBS News/New York Times Poll work at our own interviewing facility in New York. They make their calls from a room in the CBS News Broadcast Center that has been equipped with more than 50 phone lines and computers, just a few floors away from the poll's offices. This ensures frequent communication and feedback between interviewers and analysts; it also provides the flexibility to react quickly to news events.

Our interviewers are among the most experienced in the business. They reflect the racial and ethnic composition of the New York area. Some are retired from other jobs, some work as interviewers full-time, both for us and for other interviewing facilities, and some are actors who use interviewing as a way of financing the down times in their careers. Nearly half of our current active interviewers have worked for CBS News and the Times for more than eight years. Our interviewers are a dedicated and talented group.

I’m thinking a lot about interviewers this week, because on Sunday I attended the funeral of one of CBS News' long-time interviewers and supervisors: Michael Bennett, who passed away this month. He worked with us for about 20 years, a time that encompassed the change from writing answers and circulating random phone numbers on paper to using computer-assisted techniques. He interviewed respondents. He took verbatim answers and comments that respondents gave and classified them by topic. For more than 15 years, he was our main supervisor during daytime interviewing hours. It was he who handled calls from respondents who needed reassurance that we really were who we said we were.

Michael Bennett may not be a famous name in polling. But he was one of the unsung people who really matter in our profession, and we will miss him.



By Kathy Frankovic
© MMVII, CBS Interactive Inc. All Rights Reserved.
Add a Comment
by bealte July 19, 2007 4:21 PM EDT
sjc_1;
Why do you resort to namecalling and attacks when someone points out an improper display of the American flag? Why do you condone it? Shouldn't it be corrected if it is seen as offensive to many Americans? If it is an example of free speech, do you think that it is represntative of the opinions of CBS? If it isn't, shouldn't they be alerted to the fauxpas?
Reply to this comment
by starleo146 July 19, 2007 3:01 PM EDT
Why is the low percentage of the congress 1. Republican Senate who constantly hold government hostage and refuse to vote as they speak ie: I agree we should have a drawdown of troops, when they vote against it, just so the democrats cannot get there allowable count of 60. I feel this is a irresponsible act to this country. They have decided to show the American people the democrats will accomplish nothing when in fact it makes me furious, determined NOT to vote republican. 2. the same situation in the House. It is not just the war it is everything and Bush had a meeting with all of them a I believe this strategy was drawn then and if they only could plan a war as good as show up the democrats
Reply to this comment
by bealte July 19, 2007 12:57 PM EDT
I just linked to the cbsnews update from your daily email sent and noticed the graphic for the article "The Faces Behind the Polls." The graphic shows a symbol of the US Flag hanging upside down. Whether intentional or unintentional, it is very offensive to me and shoould be offfensive to all Americans!
A subversive image is not something any "news agency" should strive for. Take it down NOW!
Reply to this comment
by hungry1968 July 19, 2007 11:19 AM EDT
"From Rasussen Reports:"
Posted by perception5 at 08:14 PM : Jul 18, 2007

Stop right there. Ramussen Reports was created and owned by Bill Frist until he sold it off. That's like a pollster outfit being created by Bill Clinton or Jimmy Carter. I don't want to hear anything the "unofficial pollster of the Christian right" has to say.

By the way, you keep saying "corrupt liberal MSM wolfpack". How can you think that EVERY news organization in the country, except Fox News and the Weekly Standard, are "corrupt and liberal" biased? Is it because they all are reporting the negativity of Bush's illegal invasion and you don't like it? Don't forget that your two favorites are both run by dedicated Bush men. Talk about biased reporting!!
Reply to this comment
by sjc_1 July 19, 2007 12:38 AM EDT
I am SO glad CBS and others do the polling. It costs a lot, but brings us some indication of what the people are thinking. Politicians favor the polls when they favor the politicians and dismiss them when the do not. But few smart politicians completely ignore them, they would not last long if they did.
Reply to this comment
by perception5 July 18, 2007 11:14 PM EDT
***** The tide is turning ******* watch out Dems. With our DO-NOTHING DEMOCRAT CONGRESS AT 14% approval (lowest ever recorded by Gallup in 35 years). Looks like our President is starting to get a little mojo going.

From Rasussen Reports:

Bush Job Approval Steady at 39%
President Bush%u2019s firm position on Iraq has firmed up his Job Approval numbers. For the fifth straight day, 39% of Americans say they approve of the way the President his performing his job.

Our corrupt liberal MSM wolfpack needs to come ASAP to help their leaderless, and classless Democrat pals in Congress with some heavy doses of propaganda. CBS (Corrupt Broadcasting Station) get with the NYTimes (two liberal news outlets.......da )and run a poll and when the results come in manipulate the numbers until you get the results you wanted.

I grew up in Washington DC ever since Lady Bird started her planting of flowers around the city, but I've never seen a more corrupt liberal press nor a more combative bunch of liberal Democrat Congressman............ EVER and it's really sad.
Reply to this comment
by opfor311 July 18, 2007 9:27 PM EDT
cjgermany,
'I guess it would be too much information to go into the science of statistical sampling...'

a good site for that kind of information is:

http://www.pollster.com/
Reply to this comment
by cjgermany July 18, 2007 8:08 PM EDT
I guess it would be too much information to go into the science of statistical sampling...
Reply to this comment

Exclusive Webshow

Best-selling author Mitch Albom on his first nonfiction work since "Tuesdays with Morrie." Watch Now

Latest News
News in Pictures
Scroll Left Scroll Right
Connect with CBS News

Stay connected with the CBS News using your favorite social networks and online news applications: