Hostname: page-component-6bf8c574d5-8gtf8 Total loading time: 0 Render date: 2025-02-18T23:37:47.315Z Has data issue: false hasContentIssue false
  • English
  • Français

The Origins and Implications of Language Effects in Multilingual Surveys: A MIMIC Approach with Application to Latino Political Attitudes

Published online by Cambridge University Press:  04 January 2017

Efrén O. Pérez
Efrén O. Pérez*
Affiliation:
Department of Political Science, Vanderbilt University, PMB 505, 230 Appleton Place, Nashville, TN 37203 e-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

The study of Latino public opinion has renewed interest in the relationship between language and survey response. However, extant research generally relies on statistical methods that cannot distinguish between two related yet distinct types of language effects in Latino surveys: (1) differences in attitude and (2) differences in measures of attitude. The former reflects varied levels of a latent attitude between English and Spanish interviewees. The latter—formally known as Differential Item Functioning (DIF)—refers to linguistic differences in the interpretation of survey items, which lead Latino respondents to misreport their level of attitude. This paper proposes Multiple Indicators Multiple Causes models to decouple these two types of language effects. Using this modeling framework, I examine language differences in measures of subjective and factual political attitudes from the Latino National Survey (2006). I find that the language of interview systematically colors Latinos' interpretation of survey items, even after controlling for measurement error and individual differences in the latent variable being assessed. I then show through an applied analysis how ignoring language DIF can yield misleading inferences about hypothesized relationships between variables. Together, these findings highlight a need for greater theoretical work on the psychological origins of language effects in multilingual political surveys.

Type
Articles
Information
Political Analysis , Volume 19 , Issue 4 , Autumn 2011 , pp. 434 - 454
Copyright
Copyright © The Author 2011. Published by Oxford University Press on behalf of the Society for Political Methodology 

References

Abrajano, Marisa A. 2010. Campaigning to the new American electorate. Palo Alto, CA: Stanford University Press.Google Scholar
Abrajano, Marisa A., and Michael Alvarez, R. 2010. New faces, new voices: The Hispanic electorate in America. Princeton, NJ: Princeton University Press.Google Scholar
Alvarez, R. Michael, and Bedolla, Lisa Garcia. 2003. The foundations of Latino voter partisanship: Evidence from the 2000 elections. The Journal of Politics 65: 31–49.Google Scholar
Barreto, Matt A., Gonzalez, Ben, and Sanchez, Gabriel. 2010. Rainbow coalition in the golden state? Exposing myths, uncovering new realities in Latino attitudes toward Blacks. In Black and brown Los Angeles: A contemporary reader, eds. Pulido, L. and Kun, J., 1–36. Berkeley, CA: University of California Press.Google Scholar
Barreto, Matt A., Sanchez, Gabriel, and Morin, Jason. Forthcoming. Perceptions of competition between Latinos and Blacks: The development of a relative measure of inter-group competition. In Just neighbors? Research on African American and Latino Relations in the U. S., eds. Telles, E., Rivera-Salgado, G., and Zamora, S. New York: Russell Sage Foundation.Google Scholar
Benet-Martinez, Veronica, and John, Oliver P. 1998. Los Cinco Grandes across cultures and ethnic groups: Multitrait multimethod analyses of the Big Five in Spanish and English. Journal of Personality and Social Psychology 75: 729–50.Google Scholar
Bollen, Kenneth A. 1989. Structural equations with latent variables. New York: Wiley.Google Scholar
Branton, Regina. 2007. Latino attitudes toward various areas of public policy: The importance of acculturation. Political Research Quarterly 60: 293–303.Google Scholar
Brown, Timothy A. 2007. Confirmatory factor analysis for applied research. New York: Guilford Press.Google Scholar
Browne, Michael W., and Cudeck, Robert. 1993. Alternative ways of assessing model fit. In Testing structural equation models, eds. Bollen, Kenneth A. and Scott Long, J., 136–62. Newbury Park, CA: Sage Publications.Google Scholar
Byrne, Barbara M., and Watkins, David. 2003. The Issue of Measurement Invariance Revisited. Journal of Cross-Cultural Psychology 34(2): 155–175.Google Scholar
Byrne, Barbara M., Shavelson, Richard J., and Muthén, Bengt. 1989. Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin 105: 456–466.Google Scholar
Citrin, Jack, Lerman, Amy, Murakami, Michael, and Pearson, Kathryn. 2007. Testing Huntington: Is Hispanic immigration a threat to American identity? Perspectives on Politics 5: 31–48.Google Scholar
Davidov, Eldad. 2009. Measurement equivalence of nationalism and constructive patriotism in the ISSP: 34 countries in a comparative perspective. Political Analysis 17: 64–82.Google Scholar
de la Garza, Rodolfo O., Falcon, Angelo, and Chris Garcia, F. 1996. Will the Real Americans Please Stand Up: Anglo and Mexican-American Support of Core American Political Values. American Journal of Political Science 40(2): 335–351.Google Scholar
de la Garza, Rodolfo O., DeSipio, Louis, Chris Garcia, F., Garcia, John, and Falcon, Angelo. 1992. Latino voices: Mexican, Puerto Rican, and Cuban perspectives on American politics. Boulder, CO: Westview Press.Google Scholar
Delli Carpini, Michael X., and Keeter, Scott. 1996. What Americans know about politics and why it matters. New Haven, CT: Yale University Press.Google Scholar
Diaz-Morales, Juan Francisco, Ferrari, Joseph R., Diaz, Karem, and Argumedo, Doris. 2006. Factorial structure of three procrastination scales with a Spanish adult population. European Journal of Psychological Assessment 22: 132–37.Google Scholar
Eliot, Lise. 2009. Pink brain, blue brain: How small differences grow into troublesome gaps—and what we can do about them. Boston, MA: Houghton Mifflin Harcourt.Google Scholar
Elkins, Zachary, and Sides, John. 2010. The vodka is potent, but the meat is rotten: Evaluating measurement equivalence across contexts. Unpublished manuscript.Google Scholar
Finney, Sara J., and DiStefano, Christine. 2006. Non-normal and categorical data in structural equation modeling. In Structural equation modeling: A second course, eds. Hancock, G. R. and Mueller, R. O., 269–314. Madison, WI: Information Age Publishing.Google Scholar
Fraga, Luis R., Garcia, John A., Hero, Rodney, Jones-Correa, Michael, Martinez-Ebers, Valerie, and Segura, Gary M. 2006. Latino National Survey (LNS). Ann Arbor, MI: Inter-University Consortium for Social and Political Research.Google Scholar
Fraga, Luis Ricardo, Garcia, John A., Hero, Rodney E., Jones-Correa, Michael, Martinez-Ebers, Valerie, and Segura, Gary M. 2010. Latino lives in America: Making it home. Philadelphia, PA: Temple University Press.Google Scholar
Gallo, Joseph J., Anthony, James C., and Muthén, Bengt O. 1994. Age Differences in the Symptoms of Depression: A Latent Trait Analysis. Journal of Gerontology: Psychological Sciences 49: P251–P264.Google Scholar
Garcia, John A. 2003. Latino politics in America: Community, culture, and interests. Lanham, MD: Rowman & Littlefield Publishers, Inc.Google Scholar
Garcia, John A. 2010. Language of interview: Exploring the effects of changing languages during the LNS interview. Unpublished manuscript.Google Scholar
Garcia Bedolla, Lisa 2003. The identity paradox: Latino language, politics, and selective dissociation. Latino Studies 1: 264–83.Google Scholar
Garcia Bedolla, Lisa. 2005. Fluid borders: Latino power, identity, and politics in Los Angeles. Berkeley, CA: University of California Press.Google Scholar
Garcia Bedolla, Lisa. 2009. Latino politics. Malden, MA: Polity Press.Google Scholar
Hajnal, Zoltan, and Lee, Taeku. 2006. Out of line: Immigration and party identification among Latinos and Asian Americans. In Transforming politics, transforming America: The political and civic incorporation of immigrants in the United States, eds. Lee, T., Ramakrishnan, S. K., and Ramírez, R., 129–50. Charlottesville, VA: University of Virginia Press.Google Scholar
Hajnal, Zoltan L., and Lee, Taeku. 2011. Why Americans don't join the party: Race, immigration, and the failure (of political parties) to engage the electorate . Princeton, NJ: Princeton University Press.Google Scholar
Hambleton, Ronald K., Swaminathan, H., and Jane Rogers, H. 1991. Fundamentals of item response theory. Newbury Park, CA: Sage Publications.Google Scholar
Higham, John. 1981. Strangers in the land: Patterns of American nativism, 1860-1925. New York: Atheneum.Google Scholar
Hochschild, Jennifer L. 1981. What's fair: American beliefs about distributive justice. Cambridge: Harvard University Press.Google Scholar
Huddy, Leonie, and Khatib, Nadia. 2007. American patriotism, national identity, and political involvement. American Journal of Political Science 51: 63–77.CrossRefGoogle Scholar
Jackson, Linda A., Sullivan, Linda A., Harnish, Richard, and Hodge, Carole N. 1996. Achieving positive social identity: Social mobility, social creativity, and permeability of group boundaries. Journal of Personality and Social Psychology 70: 241–254.Google Scholar
Jiménez, Tomás. 2009. Replenished ethnicity: Mexican Americans, immigration, and identity. Berkeley, CA: University of California Press.Google Scholar
Jones-Correa, Michael. 1998. Between two nations: The political predicament of Latinos in New York City. Ithaca, NY: Cornell University Press.Google Scholar
Jöreskog, Karl G., and Goldberger, Arthur S. 1975. Estimation of a model with multiple indicators and multiple causes of a single latent variable. Journal of the American Statistical Association 70: 631–39.Google Scholar
King, Desmond. 2000. Making Americans: Immigration, race, and the origins of the diverse democracy. Cambridge: Harvard University Press.Google Scholar
Kirkman-Liff, Bradford, and Mondragón, Delfi. 1991. Language of interview: Relevance for research of southwest Hispanics. American Journal of Public Health 81: 1399–404.Google Scholar
Krosnick, Jon A. 2002. The causes of no-opinion responses to attitude measures in surveys: They are rarely what they appear to be. In Survey nonresponse, eds. Groves, R. M., Dillman, D. A., Eltinge, J. L., and Little, R. J. A., 88–100. New York: Wiley.Google Scholar
Lalonde, Richard N., and Silverman, Randy A. 1994. Behavioral preferences in response to social injustice: The effects of group permeability and social identity salience. Journal of Personality and Social Psychology 66: 78–85.Google Scholar
Lee, Sunghee, Nguyen, Hoang Anh, Jawad, May, and Kurata, John. 2008. Linguistic minorities in a Health Survey. Public Opinion Quarterly 72: 470–86.Google Scholar
Lee, Taeku. 2001. Language of interview effects and Latino mass opinion. Paper presented at the Annual Meeting of the Midwest Political Science Association, Chicago, IL.Google Scholar
Marín, Gerardo, and Marín, Barbara VanOss. 1991. Research with Hispanic populations. Newbury Park, CA: Sage Publications.Google Scholar
Mast, Benjamin T., and Lichtenberg, Peter A. 2000. Assessment of functional abilities among geriatric patients: A MIMIC model of the functional independence measure. Rehabilitation Psychology 45: 49–64.Google Scholar
McClain, Paula D., Carter, Niambi M., De Francesco Soto, Victoria M., Lyle, Monique L., Grynaviski, Jeffrey D., Nunnally, Shayla C., Scotto, Thomas J., Alan Kendrick, J., Lackey, Gerald F., and Cotton, Kendra Davenport. 2006. Racial distancing in a Southern City: Latino immigrants views' of Black Americans. The Journal of Politics 68: 571–84.Google Scholar
McClain, Paula D., Lackey, Gerald F., Pérez, Efrén O., Carter, Niambi M., Carew, Jessica Johnson, Walton, Eugene Jr., Watts, Candis S., Lyle, Monique L., and Nunnally, Shayla C. 2011. Intergroup relations in three southern cities: Black and White Americans' and Latino immigrants' attitudes. In Just neighbors? Research on African Americans and Latino relations in the United States, eds. Telles, E., Rivera-Salgado, G., and Zamora, S. New York: Russell Sage Foundation.Google Scholar
Muthén, Bengt. 1989. Latent variable modeling in heterogeneous populations. Psychometrika 54: 557–85.Google Scholar
Pérez, Efrén O. 2009. Lost in translation? Item validity in bilingual political surveys. The Journal of Politics 71: 1530–548.Google Scholar
Pérez, Efrén O. 2011. Speaking in tongues: Language, identity, and the nature of Latino politics. Unpublished manuscript, Vanderbilt University Typescript.Google Scholar
Perreira, Krista M., Deeb-Sossa, Natalia, Mullan Harris, Kathleen, and Bollen, Kenneth. 2005. What are we measuring? An evaluation of the CES-D across race/ethnicity and immigrant generation. Social Forces 83: 1567–602.Google Scholar
Poplack, Shana. 1982. Sometimes I'll start a sentence in Spanish y termino en español: Toward a typology of code-switching. In Spanish in the United States: Sociolinguistic aspects, eds. Amastae, Jon and Elías-Olivares, Luciacutea. New York, NY: Cambridge University Press.Google Scholar
Proitsi, P., Hamilton, G., Tsolaki, M., Lupton, M., Daniilidou, M., Hollingworth, P., Archer, N., Foy, C., Styilios, F., McGuinness, B., Todd, S., Lawor, B., Gill, M. M., Brayne, C., Rubinsztein, D. C., Owen, M., Williams, J., Craig, D., Passmore, P., Lovestone, S., and Powell, J. F. 2011. A Multiple Indicators Multiple Causes (MIMIC) model of Behavioural and Psychological Symptoms in Dementia (BPSD). Neurobiology of Aging 32: 434–42.Google Scholar
Reise, Steven P., Widaman, Keith F., and Pugh, Robin H. 1993. Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin 114: 552–66.Google Scholar
Tajfel, Henri. 1981. Human groups and social categories. Cambridge: Cambridge University Press.Google Scholar
Tourangeau, Robert, Rips, Lance J., and Rasinski, Kenneth. 2000. The psychology of survey response. Cambridge: Cambridge University Press.Google Scholar
Turner, John C., Hogg, Michael A., Oakes, Penelope J., Reicher, Stephen D., and Wetherell, Margaret S. 1987. Re-discovering the social group: A self-categorization theory. Oxford: Basil Blackwell.Google Scholar
Uhlaner, Carole J., and Chris Garcia, F. 2002. Latino public opinion. In Understanding public opinion, eds. Norrander, B. and Wilcox, C., 77–102. Washington, DC: CQ Press.Google Scholar
Waters, Marcy C. 1999. Black identities: West Indian immigrant dreams and American realities. Cambridge, MA: Harvard University Press.Google Scholar
Welch, Susan, Comer, John, and Steinman, Michael. 1973. Interviewing in a Mexican-American community: An investigation of some potential sources of response bias. Public Opinion Quarterly 37: 115–26.Google Scholar