Hostname: page-component-586b7cd67f-gb8f7 Total loading time: 0 Render date: 2024-12-02T19:35:21.420Z Has data issue: false hasContentIssue false
  • English
  • Français

Do Surveys Provide Representative or Whimsical Assessments of the Economy?

Published online by Cambridge University Press:  04 January 2017

Harvey D. Palmer  and
Raymond M. Duch
Harvey D. Palmer
Affiliation:
Department of Political Science, University of Mississippi, University, MS 38677-1848 [email protected]
Raymond M. Duch
Affiliation:
Department of Political Science, University of Houston, Houston, Texas 77204-3474 [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

We argue that survey responses to economic evaluation questions exhibit instability and can be affected by fairly trivial changes in questionnaire wording. Our analyses make three empirical contributions to this area of survey research. First, we demonstrate that within the course of the interview there is considerable instability in economic evaluations. Second, one source of this instability is cues regarding economic performance, such as those provided by the media. We find that respondents can be persuaded to change their economic evaluations if they receive contradictory cues. Finally, we demonstrate that question placement can affect economic evaluations. More specifically, we demonstrate that proximity to political questions can contaminate economic evaluations. If economic evaluations closely follow political preference questions, respondents have a tendency to give economic responses that are “consistent” with their political responses. Our empirical analysis is based on economic evaluations of respondents to the Hungarian Markets and Democracy Survey administered during December 1997.

Type
Research Article
Information
Political Analysis , Volume 9 , Issue 1 , 2001 , pp. 58 - 77
Copyright
Copyright © 2001 by the Society for Political Methodology 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abramson, Paul R., and Ostrom, Charles W. Jr. 1994. “Question Wording and Partisanship: Change and Continuity in Party Loyalties During the 1992 Election Campaign.” Public Opinion Quarterly 58: 21–48.Google Scholar
Alvarez, R. Michael, and Brehm, John. 1995. “American Ambivalence Towards Abortion Policy: Development of a Heteroskedastic Probit Model of Competing Values.” American Journal of Political Science 39: 1055–1082.Google Scholar
Alvarez, R. Michael, and Brehm, John. 1998. “Speaking in Two Voices: American Equivocation About the Internal Revenue Service.” American Journal of Political Science 42: 418–452.Google Scholar
Duch, Raymond. 1999. “Information Pre-requisites to Economic Voting in Consolidating Democracies.” Paper presented at the Workshop on “Political Institutions: Intermediaries Between Economics and Politics,” European Consortium of Political Research 1999 Meetings, Mannheim, Germany.Google Scholar
Duch, Raymond M., Palmer, Harvey D., and Anderson, Christopher J. 2000. “Heterogeneity in Perceptions of National Economic Conditions.” American Journal of Political Science 44: 635–652.Google Scholar
Greene, William H. 1997. Econometric Analysis, 3rd ed. Upper Saddle River, NJ: Prentice Hall.Google Scholar
Haller, Brandon H., and Norpoth, Helmut. 1994. “Let the Good Times Roll: The Economic Expectations of U.S. Voters.” American Journal of Political Science 38: 625–650.CrossRefGoogle Scholar
Herron, Michael C. 2000. Post-Estimation Uncertainty in Limited Dependent Variable Models.” Political Analysis 8: 83–98.Google Scholar
Hetherington, Marc J. 1996. “The Media's Role in Forming Voters’ Retrospective Economic Evaluations in 1992.” American Journal of Political Science 40: 372–395.Google Scholar
Johnston, Richard. 1992. “Party Identification Measures in the Anglo-American Democracies: A National Survey Experiment.” American Journal of Political Science 36: 542–559.CrossRefGoogle Scholar
King, Gary, Tomz, Michael, and Wittenberg, Jason. 2000. “Making the Most of Statistical Analyses: Improving Interpretation and Presentation.” American Journal of Political Science 44(2): 341–355.CrossRefGoogle Scholar
Krosnick, J. A., and Fabrigar, L. R. 2000. Designing Questionnaires to Measure Attitudes: Insights from Cognitive and Social Psychology. New York: Oxford University Press (in press).Google Scholar
Krosnick, Jon A., and Berent, Matthew K. 1993. “Comparisons of Party Identification and Policy Preferences: The Impact of Survey Question Format.” American Journal of Political Science 37: 941–964.Google Scholar
Lau, Richard R., Sears, David O., and Jessor, Tom. 1990. “Fact or Artifact Revisited: Survey Instrument Effects and Pocketbook Politics.” Political Behavior 12: 217–242.Google Scholar
Lewis-Beck, Michael S. 1985. “Pocketbook Voting in U.S. National Election Studies: Fact or Artifact?” American Journal of Political Science 29: 348–356.CrossRefGoogle Scholar
Lodge, Milton, Steenbergen, Marco R. and Brau, Shawn. 1995. “The Responsive Voter: Campaign Information and the Dynamics of Candidate Evaluation.” American Political Science Review 89: 309–326.Google Scholar
Lupia, Arthur, and McCubbins, Mathew D. 1998. The Democratic Dilemma: Can Citizens Learn What They Need to Know? Cambridge: Cambridge University Press.Google Scholar
MacKuen, Michael B., Erikson, Robert S., and Stimson, James A. 1992. “Peasants or Bankers? The American Electorate and the U.S. Economy.” American Political Science Review 86: 597–611.Google Scholar
Markus, Gregory B. 1988. “The Impact of Personal and National Economic Conditions on the Presidential Vote: A Pooled Cross-Sectional Analysis.” American Journal of Political Science 32: 137–154.Google Scholar
Mutz, Diana C. 1992. “Mass Media and the Depoliticization of Personal Experience.” American Journal of Political Science 36: 483–508.Google Scholar
Mutz, Diana C. 1994. “Contextualizing Personal Experience: The Role of Mass Media.” Journal of Politics 56: 689–714.Google Scholar
Powell, G. Bingham, and Whitten, Guy D. 1993. “A Cross-National Analysis of Economic Voting: Taking Account of the Political Context.” American Journal of Political Science 37: 391–414.Google Scholar
Schuman, Howard, and Presser, Stanley. 1981. Questions and Answers in Attitude Surveys. New York: Academic Press.Google Scholar
Schwartz, Norbert, and Hippler, Hans-J. 1995. “Subsequent Questions May Influence Answers to Preceding Questions in Mail Surveys.” Public Opinion Quarterly 59: 93–97.Google Scholar
Schwartz, Norbert, and Sudman, Seymour, eds. 1992. Context Effects in Social and Psychological Research. New York: Springer-Verlag.Google Scholar
Sears, David O., and Lau, Richard R. 1983. “Inducing Apparently Self-Interested Political Preferences.” American Journal of Political Science 27: 222–252.CrossRefGoogle Scholar
Sigelman, Lee. 1981. “Question-Order Effects on Presidential Popularity.” Public Opinion Quarterly 45: 199–207.Google Scholar
Sniderman, Paul M., Fletcher, Joseph F., Russell, Peter H., and Tetlock, Philip E. 1996. The Class of Rights: Liberty, Equality, and Legitimacy. New Haven, CT: Yale University Press.Google Scholar
Sudman, S., and Bradburn, Norman. 1974. Response Effects in Surveys. Chicago: Aldine.Google Scholar
Sudman, S., Bradburn, N., and Schwarz, N. 1996. Thinking About Answers: The Application of Cognitive Processes to Survey Methodology. San Francisco: Jossey-Bass.Google Scholar
Taylor, Shelley E., and Fiske, Susan T. 1978. “Salience, Attention, and Attribution: Top of the Head Phenomena.” Advances in Experimental Social Psychology 2: 249–289.Google Scholar
Tourangeau, Roger, Rasinski, Kenneth A., Bradburn, Norman, and D’Andrade, Roy. 1989. “Carryover Effects in Attitude Surveys.” Public Opinion Quarterly 53: 495–524.Google Scholar
Verba, Sidney. 1996. “The Citizen as Respondent: Sample Surveys and American Democracy.” American Political Science Review 90: 1–7.Google Scholar
Verba, Sidney, Schlozman, Kay Lehman, and Brady, Henry E. 1995. Voice and Equality: Civic Voluntarism in American Democracy. Cambridge, MA: Harvard University Press.Google Scholar
Weisberg, H. Krosnick, J.A., and Bowen, B. 1996. Introduction to Survey Research, Polling, and Data Analysis. Thousand Oaks, CA: Sage.Google Scholar
Wilcox, Nathaniel, and Wlezien, Christopher. 1996. “The Contamination of Responses to Survey Items: Economic Perceptions and Political Judgements.” Political Analysis 5: 181–213.Google Scholar
Zaller, John R. 1992. The Nature and Origins of Mass Opinion. New York: Cambridge University Press.CrossRefGoogle Scholar
Zaller, John R., and Feldman, Stanley. 1992. “A Simple Theory of the Survey Response: Answering Questions versus Revealing Preferences.” American Journal of Political Science 36: 579–616.CrossRefGoogle Scholar