Hostname: page-component-586b7cd67f-tf8b9 Total loading time: 0 Render date: 2024-11-28T00:12:19.787Z Has data issue: false hasContentIssue false
  • English
  • Français

Do Name-Based Treatments Violate Information Equivalence? Evidence from a Correspondence Audit Experiment

Published online by Cambridge University Press:  09 March 2021

Michelangelo Landgrave Open the ORCID record for Michelangelo Landgrave [Opens in a new window]  and
Nicholas Weller Open the ORCID record for Nicholas Weller [Opens in a new window]
Michelangelo Landgrave
Affiliation:
Doctoral Candidate, Department of Political Science, University of California, Riverside, CA, USA. Email: [email protected]
Nicholas Weller*
Affiliation:
Associate Professor, Department of Political Science, University of California, Riverside, CA, USA. Email: [email protected]
*
Corresponding author Nicholas Weller
Get access Rights & Permissions [Opens in a new window]

Abstract

Name-based treatments have been used in observational studies and experiments to study the differential effect of identity—commonly race or ethnic minority status. These treatments are typically assumed to signal only a single characteristic. If names unintentionally signal other characteristics, then the treatment can violate information equivalence, and estimated treatment effects cannot be attributed to the desired characteristic alone. Using results from a name perception study paired with an original correspondence audit experiment of U.S. state legislators, we show that names manipulate perceptions of minority status, socioeconomic status (SES), and migrant status. Our audit study shows that low SES status is related to reply rates both across and within each racial category. These results provide evidence that discrimination cannot be easily attributed singularly to the intended treatment of minority status but rather reflect a more multifaceted form of discrimination. More generally, our results provide an example of how name-based treatments manipulate more than the intended characteristic, which means that estimated treatment effects cannot be interpreted as being manipulated solely by the desired characteristic. Future studies with name-based or other informational treatments should account for the potential violation of information equivalence in their research design and interpretation of results.

Keywords

audit studyinformation equivalenceexperimental designdiscrimination
Type
Letter
Information
Political Analysis , Volume 30 , Issue 1 , January 2022 , pp. 142 - 148
Copyright
© The Author(s) 2021. Published by Cambridge University Press on behalf of the Society for Political Methodology

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Edited by Sunshine Hillygus

References

Abramitzky, R., Boustan, L., and Eriksson, K.. 2019. “Do Immigrants Assimilate More Slowly Today than in the Past?” American Economic Review Insights 2:125–141.CrossRefGoogle Scholar
Barlow, M. R., and Lahey, J. N.. 2018. “What Race Is Lacey? Intersecting Perceptions of Racial Minority Status and Social Class.” Social Science Quarterly 99(5):1680–1698.CrossRefGoogle Scholar
Barth, S. K., Mittag, N., and Park, K. H.. 2019. “Voter Response to Hispanic Sounding Names: Evidence from Down-Ballot Statewide Elections.” Quarterly Journal of Political Science 14(4):401–437.CrossRefGoogle Scholar
Broockman, D. E., and Soltas, E. J.. 2020. “A Natural Experiment on Discrimination in Elections.” Journal of Public Economics 188:104201.CrossRefGoogle Scholar
Butler, D. M., and Broockman, D. E.. 2011. “Do Politicians Racially Discriminate against Constituents? A Field Experiment on State Legislators.” American Journal of Political Science 55(3):463–477.CrossRefGoogle Scholar
Butler, D. M., and Homola, J.. 2017. “An Empirical Justification for the Use of Racially Distinctive Names to Signal Race in Experiments.” Political Analysis 25(1):122–130.CrossRefGoogle Scholar
Charlesworth, T. ES, and Banaji, M. R.. 2019. “Patterns of Implicit and Explicit Attitudes: I. Long-Term Change and Stability from 2007 to 2016.” Psychological Science 30(2):174–192.CrossRefGoogle ScholarPubMed
Cook, L. D., Logan, T. D., and Parman, J. M.. 2014. “Distinctively Black Names in the American Past.” Explorations in Economic History 53:64–82.CrossRefGoogle Scholar
Costa, M. 2017. “How Responsive Are Political Elites? A Meta-Analysis of Experiments on Public Officials.” Journal of Experimental Political Science, 4:241–254.CrossRefGoogle Scholar
Dafoe, A., Zhang, B., and Caughey, D.. 2018. “Information Equivalence in Survey Experiments.” Political Analysis 26(4):399–416.CrossRefGoogle Scholar
Doherty, D., Dowling, C. M., and Miller, M. G.. 2019. “Do Local Party Chairs Think Women and Minority Candidates Can Win? Evidence from a Conjoint Experiment.” The Journal of Politics 81(4):1282–1297.CrossRefGoogle Scholar
Fryer, R. G., and Levitt, S. D.. 2004. “The Causes and Consequences of Distinctively Black Names.” The Quarterly Journal of Economics 119(3):767–805.CrossRefGoogle Scholar
Gaddis, S. M. 2017. “How Black Are Lakisha and Jamal? Racial Perceptions from Names Used in Correspondence Audit Studies.” Sociological Science 4:469–489.CrossRefGoogle Scholar
Gell-Redman, M., Visalvanich, N., Crabtree, C., and Fariss, C. J.. 2018. “It’s All about Race: How State Legislators Respond to Immigrant Constituents.” Political Research Quarterly 71:517–531.CrossRefGoogle Scholar
Landgrave, M., and Weller, N.. 2020a. “Do More Professionalized Legislatures Discriminate Less? The Role of Staffers in Constituency Service.” American Politics Research 48:571–578.CrossRefGoogle Scholar
Landgrave, M., and Wellers, N.. 2020b. “Replication Data for: Do Name-Based Treatments Violate Information Equivalence? Evidence from a Correspondence Audit Experiment.” https://doi.org/10.7910/DVN/4LO1XE, Harvard Dataverse, V1, UNF:6:+S3TpZ1vLXOnCwh0Fkvq7w== [fileUNF].Google Scholar
McDermott, M. L. 1998. “Race and Gender Cues in Low-Information Elections.” Political Research Quarterly 51(4):895–918.CrossRefGoogle Scholar
Sen, M., and Wasow, O.. 2016. “Race as a Bundle of Sticks: Designs That Estimate Effects of Seemingly Immutable Characteristics.” Annual Review of Political Science 19:499–522.CrossRefGoogle Scholar
Supplementary material: Link

Landgrave and Weller Dataset

Dataset

https://doi.org/10.7910/DVN/4LO1XE
Link
Supplementary material: PDF

Landgrave and Weller supplementary material

Landgrave and Weller supplementary material

Download Landgrave and Weller supplementary material(PDF)
PDF 636.6 KB