Hostname: page-component-cd9895bd7-p9bg8 Total loading time: 0 Render date: 2024-12-29T04:30:30.840Z Has data issue: false hasContentIssue false
  • English
  • Français

Partisan Imbalance in Regression Discontinuity Studies Based on Electoral Thresholds

Published online by Cambridge University Press:  09 December 2014

James M. Snyder Jr. ,
Olle Folke  and
Shigeo Hirano
Get access Rights & Permissions [Opens in a new window]

Abstract

Many articles use regression discontinuity designs (RDDs) that exploit the discontinuity in “close” election outcomes to identify various political and economic outcomes of interest. One of the most important types of diagnostic tests in an RDD is checking for balance in observable variables within the window on either side of the threshold. Finding an imbalance raises concerns that an unobservable variable may exist that affects whether a case ends up above or below the threshold and also directly affects the dependent variable of interest. This article shows that imbalance in RDDs exploiting close elections are likely to arise even in the absence of any type of strategic sorting. Imbalance may arise simply due to variation in the underlying distribution of partisanship in the electorate across constituencies. Using both simulated and actual election data, the study demonstrates that the imbalances driven by partisanship can be large in practice. It then shows that although this causes a bias for the most naive RDDs, the problem can be corrected with commonly used RDDs such as the inclusion of a local linear control function.

Type
Original Articles
Information
Political Science Research and Methods , Volume 3 , Issue 2 , May 2015 , pp. 169 - 186
Copyright
Copyright © The European Political Science Association 2014 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

James M. Snyder, Jr. is Leroy B. Williams Professor of History and Political Science, Harvard University, 1737 Cambridge St., Cambridge, MA 02138 and Research Associate, NBER (email: [email protected]). Olle Folke is Assistant Professor of International and Public Affairs at SIPA Columbia University, 420 W.118th Street, Room 821 IAB New York, NY 10027 and affiliated researcher at IFN, Stockholm (email: [email protected]). Shigeo Hirano is Associate Professor of Political Science, Columbia University, 420 West 118th Street, Room 420, New York, NY 10027 (email: [email protected]). We thank Andrew Gelman, Gary King, David Lee, Adam Glynn, Arthur Spirling, Justin Grimmer and Jas Sekhon for their helpful comments.

References

Albouy, David. 2009. ‘Partisan Representation in Congress and the Geographic Distribution of Federal Funds’. NBER Working paper no. 15224.Google Scholar
Ansolabehere, Stephen, and Snyder, James M. Jr. 2002. ‘Incumbency Advantages in the States: An Analysis of State and Federal Offices, 1942–2000’. Election Law Journal 1:315–338.Google Scholar
Boas, Taylor, and Hidalgo, Daniel. 2011. ‘Controlling the Airwaves: Incumbency Advantage and Community Radio in Brazil’. American Journal of Political Science 55(4):869–885.Google Scholar
Broockman, David E. 2009. ‘Do Congressional Candidates Have Reverse Coattails? Evidence from a Regression Discontinuity Design’. Political Analysis 17:418–434.Google Scholar
Butler, Daniel Mark. 2009. ‘A Regression Discontinuity Design Analysis of the Incumbency Advantage and Tenure in the U.S. House’. Electoral Studies 28:123–128.Google Scholar
Butler, David, and Stokes, Donald E.. 1969. Political Change in Britain. London: Macmillan.Google Scholar
Campbell, Angus, Converse, Philip E., Miller, Warren E., and Stokes, Donald E.. 1960. The American Voter. New York: John Wiley & Sons.Google Scholar
Caughey, Devin M., and Sekhon, Jasjeet S.. 2011. ‘Regression-Discontinuity Designs and Popular Elections: Implications of Pro-Incumbent Bias is Close U.S. House Races’. Political Analysis 19:385–408.Google Scholar
Cellini, Stephanie Riegg, Ferreira, Fernando, and Rothstein, Jesse. 2010. ‘The Value of School Facility Investments: Evidence from a Dynamic Regression Discontinuity Design’. Quarterly Journal of Economics 125:215–261.Google Scholar
Converse, Philip E. 1966. ‘The Concept of a Normal Vote’. In Elections and the Political Order, edited by Angus Campbell, Philip Converse, Warren Miller and Donald Stokes, 9–39. New York: John Wiley and Sons.Google Scholar
Dal Bo, Ernesto, Dal Bo, Pedro, and Snyder, Jason. 2009. ‘Political Dynasties’. Review of Economic Studies 76:115–142.Google Scholar
DiNardo, John, and Lee, David S.. 2004. ‘Economic Impacts of New Unionization on Private Sector Employers: 1984–2001’. Quarterly Journal of Economics 119:1383–1441.Google Scholar
Eggers, Andrew C., Fowler, Anthony, Hainmueller, Jens, Hall, Andrew B., and Snyder, James M. Jr. 2014. ‘On the Validity of the Regression Discontinuity Design for Estimating Electoral Effects: New Evidence from Over 40,000 Close Races’. American Journal of Political Science. DOI: 10.1111/ajps.12127.Google Scholar
Eggers, Andrew C., and Hainmueller, Jens. 2009. ‘MPs for Sale? Returns to Office in Postwar British Politics’. American Political Science Review 103:513–533.Google Scholar
Ferreira, Fernando, and Gyourko, Joseph. 2009. ‘Do Political Parties Matter? Evidence from U.S. Cities’. Quarterly Journal of Economics 124:399–422.Google Scholar
Folke, Olle, and Snyder, James. 2012. ‘Gubernatorial Midterm Slumps’. American Journal of Political Science 56(4):931–948.Google Scholar
Gagliarducci, Stefano, and Paserman, Daniele, M.. 2012. ‘Gender Interactions within Hierarchies: Evidence from the Political Arena’. Review of Economic Studies 79(3):1021–1052.Google Scholar
Gelman, Andrew, and King, Gary. 1990. ‘Estimating Incumbency Advantage without Bias’. American Journal of Political Science 34:1142–1164.Google Scholar
Gelman, Andrew, and King, Gary. 1994a. ‘A Unifed Method of Evaluating Electoral Systems and Redistricting Plans’. American Journal of Political Science 38:514–554.Google Scholar
Gelman, Andrew, and King, Gary. 1994b. ‘Enhancing Democracy Through Legislative Redistricting’. American Political Science Review 88:541–559.Google Scholar
Gerber, Elisabeth R., and Hopkins, Daniel J.. 2011. ‘When Mayors Matter: Estimating the Impact of Mayoral Partisanship on City Policy’. American Journal of Political Science 55:326–339.Google Scholar
Grimmer, Justin, Hersh, Eitan, Feinstein, Brian, and Carpenter, Daniel. 2011. ‘Are Close Elections Random?’ Unpublished manuscript, Stanford University.Google Scholar
Hainmueller, Jens, and Kern, Holger Lutz. 2008. ‘Incumbency as a Source of Spillover Effects in Mixed Electoral Systems: Evidence from a Regression-Discontinuity Design’. Electoral Studies 27:213–227.Google Scholar
Imbens, Guido, and Kalyanaraman, Karthik. 2012. ‘Optimal Bandwidth Choice for the Regression Discontinuity’. Review of Economic Studies 79(3):933–959.Google Scholar
Imbens, Guido, and Lemieux, Thomas. 2008. ‘Regression Discontinuity Designs: A Guide to Practice’. Journal of Econometrics 142(2):615–635.Google Scholar
Jacobson, Gary. 1980. Money in Congressional Elections. New Haven, CT: Yale University Press.Google Scholar
Lee, David S. 2008. ‘Randomized Experiments from Non-Random Selection in U.S. House Elections’. Journal of Econometrics 142:675–697.Google Scholar
Lee, David S., Moretti, Enrico, and Butler, Matthew J.. 2004. ‘Do Voters Affect or Elect Policies? Evidence from the U.S. House’. Quarterly Journal of Economics 119:807–859.Google Scholar
Leigh, Andrew. 2008. ‘Estimating the Impact of Gubernatorial Partisanship on Policy Settings and Economic Outcomes: A Regression Discontinuity Approach’. European Journal of Political Economy 24:256–268.Google Scholar
Levitt, Steven D., and Wolfram, Catherine D.. 1997. ‘Decomposing the Sources of Incumbency Advantage in the U.S. House’. Legislative Studies Quarterly 22:45–60.Google Scholar
Meyersson, Erik. 2012. ‘Islamic Rule and the Empowerment of the Poor and Pious’. Econometrica 82(1):229–269.Google Scholar
Pettersson-Lidbom, Per. 2008. ‘Do Parties Matter for Economic Outcomes? A Regression-Discontinuity Approach’. Journal of the European Economic Association 6:1037–1056.Google Scholar
Querubin, Pablo. 2010. ‘Family and Politics: Dynastic Persistence in the Philippines’. Unpublished manuscript, MIT.Google Scholar
Rehavi, Marit. 2007. ‘Sex and Politics: Do Female Legislators Affect State Spending?’ Unpublished manuscript, University of California, Berkeley.Google Scholar
Snyder, Jason. 2005. ‘Detecting Manipulation in U.S. House Elections.’ Unpublished manuscript, University of California, Berkeley.Google Scholar
Stokes, Donald E., Campbell, Angus, and Miller, Warren E.. 1958. ‘Components of Electoral Decision’. American Political Science Review 52:367–387.Google Scholar
Trounstine, Jessica. 2011. ‘Evidence of a Local Incumbency Advantage’. Legislative Studies Quarterly 36:255–280.Google Scholar
Tufte, Edward. 1973. ‘The Relationship between Seats and Votes in Two-Party Systems’. American Political Science Review 67:540–554.Google Scholar
Uppal, Yogesh. 2009. ‘The Disadvantaged Incumbents: Estimating Incumbency Effects in Indian State Legislatures’. Public Choice 138:9–27.Google Scholar
Uppal, Yogesh. 2010. ‘Estimating Incumbency Effects in U.S. State Legislatures: A Quasi-Experimental Study’. Economics and Politics 22:180–199.Google Scholar
Van Der Klaauw, Wilbert. 2008. ‘Regression Discontinuity Analysis: A Survey of Recent Developments in Economics’. Labour: Review of Labour Economics and Industrial Relations 22:219–245.Google Scholar