Showing posts with label don't know. Show all posts
Showing posts with label don't know. Show all posts

Friday, June 17, 2011

Don't Know means, apparently, Don't Know

In the latest Journal of Politics, Robert Luskin and John Bullock examine whether "don't know" as an available response to questions about political knowledge can affect the results.  The study itself is here (assuming you have the same access as I do).

In survey research, we often talk about DK (don't know) and how to present this option, and whether presenting it in a certain way encourages people to take the easy road and simply say they don't know versus coming up, with a little more mental effort, an answer.  This matters, at least to those of us who study the knowledge of the American electorate.  Encouraging "don't know" as a response can lead to a more disappointing portrait of the public's knowledge.  Or, to flip it, discouraging this response would paint a better picture.

The authors used to national survey experiments to explore whether discouraging DKs will matter.  As they write:
Discouraging DKs does paint a more comforting picture of the public’s knowledge of politics—but, as the foregoing shows, only slightly so in the openended case and spuriously so in the closed-ended one. Anyone searching for large caches of hidden knowledge, it appears, should look elsewhere.
Given most of the time we rely on close-ended questions to tap into the public's political knowledge, the results basically tell us that fiddling with "don't know" as a response, usually by discouraging it or not offering it as an easily available response alternative in a survey scenario, won't really improve the results.  Indeed, the authors argue that DKs should not be discouraged.  The only question, they argue, is whether to encourage them.

Yes, this gets all manner of methodologically geeky, but for those who study what people know, and who craft surveys or other instruments designed to measure it, these results are important.

Full journal cite: The Journal of Politics, Vol. 73, No. 2, April 2011, Pp. 547–557.

Tuesday, December 4, 2007

Unsure and Don't Know

In my neverending fascination with the presidential nomination process, the "Don't Know/Unsure" numbers always get my attention.

For the Dems, the "unsure" is down to 5 percent. For the GOP candidates, it is 11 percent.

Why the difference?

Both are consistent. The Republican voters have stuck to about 10 percent (plus or minus a couple of percentage points). The Democratic voters are steady as well, sticking in the single digits and never getting any higher than 8 percent.

Okay, fine. But why? Explain the numbers, oh journalism/quantoid guru...

Er, in another post I will do just that. As soon as I come up with a reasonable, working hypothesis ... or at least something that sounds good enough to get away with. I will note that in various runoff possibilities in the general election, the "unsure" gets down to a couple of percentage points. A working hypothesis? We've become so polarized, so partisan. There is volatility among candidate choices, but we are damn sure to at least say we have a favorite.

Tie it to what people know? Basically, thanks to tons of coverage, we think we know a lot about these people (even though only one-third of Americans in one poll could identify Barack Obama).