Hostname: page-component-78c5997874-dh8gc Total loading time: 0 Render date: 2024-11-02T20:39:04.292Z Has data issue: false hasContentIssue false

Effects of Chinese word structure on object perception in Chinese–English bilinguals: Evidence from an ERP visual oddball paradigm

Published online by Cambridge University Press:  03 March 2020

Xuan Pan
Affiliation:
University of Western Ontario
Debra Jared*
Affiliation:
University of Western Ontario
*
Address for correspondence: Debra Jared, E-mail: [email protected]

Abstract

Lupyan's (2012) label-feedback hypothesis proposes that linguistic labels affect our conceptual and perceptual representations through top-down feedback. We investigated whether such representations in bilinguals are influenced by labels from both of their languages by examining the effect of Chinese word structure on picture perception in Chinese–English bilinguals. A visual-oddball task with ERP was used. Pictures of four birds were used as standards and deviants. The robin-ostrich pair shared a category cue in their Chinese names (like blackbird in English), and the pigeon-penguin pair did not. In Chinese–English bilinguals who were new to Canada, the visual mismatch negativity (vMMN) elicited by deviant stimuli was significantly larger for pairs without category cues than pairs with cues, but, in long-stay bilinguals and English monolinguals, the vMMN was similar for the two pairs. These results demonstrate that object perception is influenced by the labels in both of a bilingual's languages.

Type
Research Article
Copyright
Copyright © Cambridge University Press 2020

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Akaike, H (1973) Information theory and an extension of the maximum likelihood principle. In Petrov, BN and Caski, F (eds), Proceedings of the Second International Symposium on Information Theory. Budapest: Akademiai Kiado, pp. 267281.Google Scholar
Akaike, H (1974) A new look at the statistical model identification. IEEE Transactions on Automatic Control 19, 716723.CrossRefGoogle Scholar
Ameel, E, Malt, BC, Storms, G and Van Assche, F (2009) Semantic convergence in the bilingual lexicon. Journal of Memory and Language 60, 270290.CrossRefGoogle Scholar
Ameel, E, Storms, G, Malt, BC and Sloman, SA (2005) How bilinguals solve the naming problem. Journal of Memory and Language 53, 6080.CrossRefGoogle Scholar
Athanasopoulos, P (2009) Cognitive representation of colour in bilinguals: The case of Greek blues. Bilingualism: Language and Cognition 12, 8395.CrossRefGoogle Scholar
Athanasopoulos, P, Dering, B, Wiggett, A, Kuipers, JR and Thierry, G (2010) Perceptual shift in bilingualism: Brain potentials reveal plasticity in pre-attentive colour perception. Cognition 116, 437443.CrossRefGoogle ScholarPubMed
Bates, D, Mächler, M, Bolker, B and Walker, S (2015) Fitting linear mixed-effects models using lme4. Journal of Statistical Software 67, 148.CrossRefGoogle Scholar
Boroditsky, L (2001) Does language shape thought? Mandarin and English speakers’ conceptions of time. Cognitive Psychology 43, 122.CrossRefGoogle ScholarPubMed
Boroditsky, L, Fuhrman, O and McCormick, K (2011) Do English and Mandarin speakers think about time differently? Cognition 118, 123129.CrossRefGoogle ScholarPubMed
Boutonnet, B, Athanasopoulos, P and Thierry, G (2012) Unconscious effects of grammatical gender during object categorisation. Brain Research 1479, 7279.CrossRefGoogle ScholarPubMed
Boutonnet, B, Dering, B, Viñas-Guasch, N and Thierry, G (2013) Seeing objects through the language glass. Journal of Cognitive Neuroscience 25, 17021710.CrossRefGoogle ScholarPubMed
Boutonnet, B and Lupyan, G (2015) Words jump-start vision: A label advantage in object recognition. Journal of Neuroscience 35, 93299335.CrossRefGoogle ScholarPubMed
Burnham, KP and Anderson, DR (1998) Model selection and multimodel inference. New York: Springer.CrossRefGoogle Scholar
Burnham, KP and Anderson, DR (2004) Multimodel inference: Understanding AIC and BIC in model selection. Sociological Methods & Research 33, 261304.CrossRefGoogle Scholar
Casasanto, D and Boroditsky, L (2008) Time in the mind: Using space to think about time. Cognition 106, 579593.CrossRefGoogle ScholarPubMed
Casasola, M (2005) Can language do the driving? The effect of linguistic input on infants’ categorization of support spatial relations. Developmental Psychology 41, 183192.CrossRefGoogle ScholarPubMed
Choi, S and Hattrup, K (2012) Relative contribution of perception/cognition and language on spatial categorization. Cognitive Science 36, 102129.CrossRefGoogle ScholarPubMed
Costa, A, Strijkers, K, Martin, C and Thierry, G (2009) The time course of word retrieval revealed by event-related brain potentials during overt speech. Proceedings of the National Academy of Sciences 106, 2144221446.CrossRefGoogle ScholarPubMed
Czigler, I (2007) Visual mismatch negativity: Violation of nonattended environmental regularities. Journal of Psychophysiology 21, 224230.CrossRefGoogle Scholar
Czigler, I (2014) Visual mismatch negativity and categorization. Brain Topography 27, 590598.CrossRefGoogle ScholarPubMed
Dolscheid, S, Shayan, S, Majid, A and Casasanto, D (2013) The thickness of musical pitch: Psychophysical evidence for linguistic relativity. Psychological Science 24, 613621.CrossRefGoogle ScholarPubMed
Edmiston, P and Lupyan, G (2015) What makes words special? Words as unmotivated cues. Cognition 143, 93100.CrossRefGoogle ScholarPubMed
Fang, SY, Zinszer, BD, Malt, BC and Li, P (2016) Bilingual object naming: A connectionist model. Frontiers in Psychology 7, 644.CrossRefGoogle ScholarPubMed
Forder, L and Lupyan, G (2017) Hearing words changes color perception: Facilitation of color discrimination by verbal and visual cues. PsyArXiv Preprints. Retrieved from https://psyarxiv.com/f83au/Google Scholar
Fox, J, and Weisberg, S (2011) An R companion to applied regression, second Edition. Thousand Oaks CA: Sage. Retrieved from: https://socialsciences.mcmaster.ca/jfox/Books/Companion-2E/index.htmlGoogle Scholar
Friedman, WJ (2004) Time in autobiographical memory. Social Cognition 22, 591605.CrossRefGoogle Scholar
Fuhrman, O, McCormick, K, Chen, E, Jiang, H, Shu, D, Mao, S and Boroditsky, L (2011) How linguistic and cultural forces shape conceptions of time: English and Mandarin time in 3D. Cognitive Science 35, 13051328.CrossRefGoogle Scholar
Fulkerson, AL and Waxman, SR (2007) Words (but not tones) facilitate object categorization: Evidence from 6- and 12-month-olds. Cognition 105, 218228.CrossRefGoogle ScholarPubMed
Gervits, F, Johanson, M and Papafragou, A (2016) Intentionality and the role of labels in categorization. Retrieved from https://mindmodeling.org/cogsci2016/papers/0206/paper0206.pdfGoogle Scholar
Grosjean, F and Li, P (2013) The psycholinguistics of bilingualism. Chichester, UK: Wiley-Blackwell.Google Scholar
Hannah, R (2009) Time in antiquity. London/New York: Routledge.Google Scholar
Holmes, A, Franklin, A, Clifford, A and Davies, I (2009) Neurophysiological evidence for categorical perception of color. Brain and Cognition 69, 426434.CrossRefGoogle Scholar
Hu, Z, Hanley, JR, Zhang, R, Liu, Q and Roberson, D (2014) A conflict-based model of color categorical perception: Evidence from a priming study. Psychonomic Bulletin & Review 21, 12141223.CrossRefGoogle ScholarPubMed
Indefrey, P and Levelt, WJM (2004) The spatial and temporal signatures of word production components. Cognition 92, 101144.CrossRefGoogle ScholarPubMed
Jouravlev, O, Taikh, A and Jared, D (2018) Effects of lexical ambiguity on perception: A test of the label feedback hypothesis using a visual oddball paradigm. Journal of Experimental Psychology: Human Perception and Performance 44, 18421855.Google ScholarPubMed
Lai, VT and Boroditsky, L (2013) The immediate and chronic influence of spatio-temporal metaphors on the mental representations of time in English, Mandarin, and Mandarin-English speakers. Frontiers in Psychology 4, 142Google ScholarPubMed
Li, P, Abarbanell, L, Gleitman, L and Papafragou, A (2011) Spatial reasoning in Tenejapan Mayans. Cognition 120, 3353.CrossRefGoogle ScholarPubMed
Li, P and Gleitman, L (2002) Turning the tables: Language and spatial reasoning. Cognition 83, 265294.CrossRefGoogle ScholarPubMed
Li, Y, Jones, M and Thierry, G (2018) Timeline blurring in fluent Chinese-English bilinguals. Brain Research 1701, 93102.CrossRefGoogle ScholarPubMed
Liu, C, Tardif, T, Mai, X, Gehring, WJ, Simms, N and Luo, YJ (2010) What's in a name? Brain activity reveals categorization processes differ across languages. Human Brain Mapping 31, 17861801.Google Scholar
Lopez-Calderon, J and Luck, SJ (2014) ERPLAB: an open-source toolbox for the analysis of event-related potentials. Frontiers in Human Neuroscience 8(213).CrossRefGoogle ScholarPubMed
Lupyan, G (2008) From chair to “chair”: A representational shift account of object labeling effects on memory. Journal of Experimental Psychology: General 137, 348369.CrossRefGoogle ScholarPubMed
Lupyan, G (2012) What do words do? Toward a theory of language-augmented thought. In Ross, BH (ed), The psychology of learning and motivation. Waltham, MA: Academic Press, Vol. 57, pp. 255297.CrossRefGoogle Scholar
Lupyan, G and Casasanto, D (2015) Meaningless words promote meaningful categorization. Language and Cognition 7, 167193.CrossRefGoogle Scholar
Lupyan, G, Rakison, DH and McClelland, JL (2007) Language is not just for talking: Redundant labels facilitate learning of novel categories. Psychological Science 18, 10771083.CrossRefGoogle Scholar
Lupyan, G and Thompson-Schill, SL (2012) The evocative power of words: Activation of concepts by verbal and nonverbal means. Journal of Experimental Psychology: General 141, 170186.CrossRefGoogle ScholarPubMed
MacLaury, RE (1997) Color and cognition in Mesoamerica: Constructing categories as vantages. Austin: University of Texas Press.Google Scholar
Malt, BC, Li, P, Pavlenko, A, Zhu, H and Ameel, E (2015) Bidirectional lexical interaction in late immersed Mandarin-English bilinguals. Journal of Memory and Language 82, 86104.CrossRefGoogle Scholar
Malt, BC and Sloman, SA (2003) Linguistic diversity and object naming by non-native speakers of English. Bilingualism: Language and Cognition 6, 4767.CrossRefGoogle Scholar
Masuda, T, Ishii, K, Miwa, K, Rashid, M, Lee, H and Mahdi, R (2017) One label or two? Linguistic influences on the similarity judgment of objects between English and Japanese speakers. Frontiers in Psychology 8, 1637.CrossRefGoogle ScholarPubMed
McClelland, JL and Rumelhart, DE (1981) An interactive activation model of context effects in letter perception: I. An account of basic findings. Psychological Review 88, 375407.Google Scholar
Mo, L, Xu, G, Kay, P and Tan, L.-H (2011) Electrophysiological evidence for the left-lateralized effect of language on preattentive categorical perception of color. Proceedings of the National Academy of Sciences 108, 1402614030.CrossRefGoogle Scholar
Paramei, GV (2007) Russian “blues”: Controversies of basicness. In MacLaury, RE, Paramei, GV and Dedrick, D (eds), Anthropology of color: Interdisciplinary multilevel modeling. Amsterdam/Philadelphia: John Benjamins Publishing Company, pp. 75106.CrossRefGoogle Scholar
Pavlenko, A (2014) The bilingual mind: And what it tells us about language and thought. Cambridge/New York: Cambridge University Press.Google Scholar
Pavlenko, A and Malt, BC (2011) Kitchen Russian: Cross-linguistic differences and first-language object naming by Russian–English bilinguals. Bilingualism: Language and Cognition 14, 1945.CrossRefGoogle Scholar
Pazo-Alvarez, P, Cadaveira, F and Amenedo, E (2003) MMN in the visual modality: A review. Biological Psychology 63, 199236.CrossRefGoogle ScholarPubMed
R Core Team (2017) R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL: https://www.R-project.org/.Google Scholar
Roberson, D (2012) Culture, categories and color: Do we see the world through t(a)ined lenses? In Gelfand, MJ, Chiu, CI and Hong, YY (eds), Advances in culture and psychology. Oxford/New York: Oxford University Press, Vol. 2, pp. 352.CrossRefGoogle Scholar
Roberson, D and Davidoff, J (2000) The categorical perception of colors and facial expressions: The effect of verbal interference. Memory & Cognition 28, 977986.CrossRefGoogle ScholarPubMed
Robinson, CW, Best, CA, Deng, WS and Sloutsky, V (2012) The role of words in cognitive tasks: What, when, and how? Frontiers in Psychology 3.CrossRefGoogle Scholar
Seidenberg, MS and McClelland, JL (1989) A distributed, developmental model of word recognition and naming. Psychological Review 96, 523568.CrossRefGoogle ScholarPubMed
Strijkers, K, Costa, A and Thierry, G (2010) Tracking lexical access in speech production: Electrophysiological correlates of word frequency and cognate effects. Cerebral Cortex 20, 912928.CrossRefGoogle ScholarPubMed
Strijkers, K, Holcomb, PJ and Costa, A (2011) Conscious intention to speak proactively facilitates lexical access during overt object naming. Journal of Memory and Language 65, 345362.CrossRefGoogle Scholar
Thierry, G (2016) Neurolinguistic relativity: How language flexes human perception and cognition. Language Learning 66, 690713.CrossRefGoogle ScholarPubMed
Thierry, G, Athanasopoulos, P, Wiggett, A, Dering, B and Kuipers, JR (2009) Unconscious effects of language-specific terminology on preattentive color perception. Proceedings of the National Academy of Sciences 106, 45674570.CrossRefGoogle ScholarPubMed
Whorf, BL (1940) Science and linguistics. Technology Review 42, 247248.Google Scholar
Whorf, BL (1956) Language, thought, and reality: Selected writings of Benjamin Lee Whorf. Edited by Carroll, J, Levinson, S, and Lee, P. Cambridge, MA: MIT Press.Google Scholar
Winawer, J, Witthoft, N, Frank, MC, Wu, L, Wade, AR and Boroditsky, L (2007) Russian blues reveal effects of language on color discrimination. Proceedings of the National Academy of Sciences 104, 77807785.CrossRefGoogle ScholarPubMed
Winkler, I, Czigler, I, Sussman, E, Horváth, J and Balázs, L (2005) Preattentive binding of auditory and visual stimulus features. Journal of Cognitive Neuroscience 17, 320339.CrossRefGoogle ScholarPubMed
Xia, T, Xu, G and Mo, L (2019) Bi-lateralized Whorfian effect in color perception: Evidence from Chinese Sign Language. Journal of Neurolinguistics 49, 189201.CrossRefGoogle Scholar
Supplementary material: PDF

Pan and Jared Supplementary Materials

Pan and Jared Supplementary Materials

Download Pan and Jared Supplementary Materials(PDF)
PDF 941.3 KB