In this study, we propose an operationalization of the concept of emergence which plays a crucial role in usage-based theories of language. The abstractions linguists operate with are assumed to emerge through a process of generalization over the data language users are exposed to. Here, we use two types of computational learning algorithms that differ in how they formalize and execute generalization and, consequently, abstraction, to probe whether a type of language knowledge that resembles linguistic abstractions could emerge from exposure to raw data only. More specifically, we investigated whether a phone, undisputedly the simplest of all linguistic abstractions, could emerge from exposure to speech sounds using two computational learning processes: memory-based learning and error-correction learning (ECL). Both models were presented with a significant amount of pre-processed speech produced by one speaker. We assessed (1) the consistency or stability of what these simple models learn and (2) their ability to approximate abstract categories. Both types of models fare differently regarding these tests. We show that only ECL models can learn abstractions and that at least part of the phone inventory and its grouping into traditional types can be reliably identified from the input.

Government attention selectively distributed to various issues in policy-making processes is usually reflected in language, such as metaphors in political discourse. In addition, metaphor change may reveal how conceptualizations of major topics such as economy and ecology evolve over time. After self-building a corpus of China’s 45-year Government Work Reports, this study explores whether there is a difference in attention to topics of economy and ecology over time and investigates the diachronic change of metaphor use on them based on a modified framework for diachronic metaphor change analysis. Results show that attention to economy has been steadily decreasing while attention to ecology has been growing, and that there is an increasing tendency of using more economy and ecology metaphors. Metaphor change on the use of source domains is arranged on a continuum, ranging from constant use (war for economy and ecology, and journey and object for economy), incremental change (living organism and building for economy and ecology, and object for ecology) to fundamental change (building and living organism for ecology). This study may enrich the understanding of diachronic metaphor change by providing a Chinese perspective on the metaphor use in government discourse over time.

Vowels are associated with valence, so that words containing /i/ (as in English meet) compared with /o/ (as in French rose) are typically judged to match positively valenced persons and objects. As yet, valence sound symbolism has been mainly observed for Indo-European languages. The present research extends this to a comparison of Japanese-speaking and German-speaking participants. Participants invented pseudo-words as names for faces with different emotional expressions (happy vs. neutral vs. sad vs. angry). For both Japanese-speaking and German-speaking participants, vowel usage depended on emotional valence. The vowel I was used more for positive (vs. other) expressions, whereas O and U were used less for positive (vs. other) expressions. A was associated with positive emotional valence for Japanese-speaking but not German-speaking participants. In sum, emotional valence associations of I (vs. rounded vowels) were similar in German and Japanese, suggesting that sound symbolism for emotional valence is not language specific.

While anecdotal evidence suggests that music may facilitate verbal memory, empirical evidence for this is less clear. Here, we examined whether learners’ characteristics such as age, working memory (WM), and musical training may influence the effect of music on word learning. Young and older adults learned novel word-referent mappings presented in three music conditions (spoken in the presence of background music, sung in-key, and sung out-of-key) and a control condition (spoken in quiet) and their performance was assessed immediately after learning. We found that whereas age and, to an extent, musical training had a general effect on word learning, WM modulated the effect of music: performance was worse in the music conditions relative to the control condition for learners with lower WM whereas the opposite pattern was observed for those with higher WM. Our results thus highlight the importance of considering individual characteristics in determining the effect of music on verbal memory.

The neurocognition of multimodal interaction – the embedded, embodied, predictive processing of vocal and non-vocal communicative behaviour – has developed into an important subfield of cognitive science. It leaves a glaring lacuna, however, namely the dearth of a precise investigation of the meanings of the verbal and non-verbal communication signals that constitute multimodal interaction. Cognitively construable dialogue semantics provides a detailed and context-aware notion of meaning, and thereby contributes content-based identity conditions needed for distinguishing syntactically or form-based defined multimodal constituents. We exemplify this by means of two novel empirical examples: dissociated uses of negative polarity utterances and head shaking, and attentional clarification requests addressing speaker/hearer roles. On this view, interlocutors are described as co-active agents, thereby motivating a replacement of sequential turn organisation as a basic organising principle with notions of leading and accompanying voices. The Multimodal Serialisation Hypothesis is formulated: multimodal natural language processing is driven in part by a notion of vertical relevance – relevance of utterances occurring simultaneously – which we suggest supervenes on sequential (‘horizontal’) relevance – relevance of utterances succeeding each other temporally.

The present study investigated the age of acquisition (AoA) effect in processing second language (L2) words and how it is related to the AoA of the corresponding first language (L1) words. We adopted a lexical decision task in three experiments. The filler words were orthographically illegal in Experiment 1 to elicit more word form processing, while Experiment 2 used legal fillers to shift the bias toward semantic processing. In Experiment 3, we used a larger amount of stimuli containing more longer words with legal fillers. Our results showed that L2 AoA has a weak effect at the orthographical processing level and a stable effect at the semantic processing level. The L1 AoA modulates the L2 AoA effect at the semantic processing level, which is more likely to appear in long words. These results suggest that it is important to take bilingual representation and activation into consideration to explain the L2 AoA effect.

Perceptual information includes sensorimotor and emotional experience regarding the multimodality of the perceptual system. The current study provides an image-based visual analysis on the embodiment of color metaphors through the investigation of (i) the perceptual (dis)similarities between the literal and metaphorical meanings of the Chinese color terms hēi ‘black’ and bái ‘white’ and (ii) the influence of emotional valence on the degree of their perceptual (dis)similarities. Specifically, 24 concepts in three semantic domains were represented as eight-dimensional vectors based on the color information extracted from online images, including two color concepts of black and white, 20 abstract concepts referring to 8 metaphorical meanings of hēi and 12 metaphorical meanings of bái, and two abstract concepts referring to positive and negative affective polarity. Statistical analyses show that (i) the literal and metaphorical meanings of hēi and bái are perceptually distinguishable given their significant perceptual (dis)similarities and (ii) the observed perceptual distinguishability cannot be solely attributed to the (in)consistency of emotional valence associated with the senses. The present study provides nonlinguistic evidence for the embodiment of color metaphors in the Chinese context with an empirical approach that can simultaneously capture the metaphorical mappings and affective associations among cross-domain concepts with sensory data.

This study investigates whether child second language (L2) learners can use syntactic information during the processing of sentences involving unbounded dependencies and how their processing patterns compare to those of child monolinguals and adult L2 learners. Through a self-paced reading experiment involving the numeral quantifier (NQ) construction in Korean, we tested participants’ sensitivity to agreement violations between a noun phrase (NP) and an NQ in local and nonlocal conditions. The results showed that a subset of child L2 learners who demonstrated target-like knowledge of NP-NQ agreement in an offline task spent a longer processing time in the NP-NQ mismatch than in the NP-NQ match condition, in both local and nonlocal contexts. These child L2 learners’ processing patterns were comparable to those observed in child monolinguals and adult L2 learners. These findings suggest that child and adult L2 learners rely on the same system of syntactic representations and processing mechanisms that guide first language processing.

An open question in research on multimodal figuration is how to mitigate the analyst’s bias in identifying and interpreting metaphor and metonymy; an issue that determines the generalizability of the findings. Little is known about the causes that motivate different annotations. Inter-rater reliability tests are useful to investigate the sources of variation in annotations by independent researchers that can help inform and refine protocols.

Inspired by existing procedures for verbal, visual, and filmic metaphor identification, we formulated instructions to identify multimodal metaphor and metonymy and tested it against a corpus of 21 generic advertisements and 21 genre-specific advertisements (mobile phones). Two independent researchers annotated the advertisements in six rounds. A joint discussion followed each round to consider conflicting annotations and refine the protocol for the ensuing round.

By examining the evolution of inter-rater reliability results, we found that (1) we reached similar levels of agreement for the identification of metaphor and metonymy, although converging on the interpretation of metonymy was more difficult; (2) some genre specificities made it easier to agree on the annotations for mobile advertisements than for the general advertisements; and (3) there was a consistent increase in the kappa scores reaching substantial agreement by the sixth round.

This study analyzes 30 cartoons depicting the Deal of the Century as envisaged by two Jordanian cartoonists. Conceptual Blending Theory (Fauconnier and Turner [2008, Cambridge handbook of metaphor and thought, Cambridge University Press, 53–66]) and Multimodal Metaphor Theory (Forceville, 2008) are adopted as theoretical frameworks. The results reveal that the target domain the Deal of the Century was conceptualized mainly through layered metaphors that have metonymic basis and event metaphors/allegories. Five groups were identified: object or a situation involving objects, situations involving humans/hybrids of humans and objects, an animal or situation involving animal, hybrids of weapons and humans, and event metaphors used to build a story/allegory. The results demonstrate that the most widely used configuration to construe the metaphors was cross-modal of the type pictorial source–verbal target in line with Lan and Zuo (2016, Metaphor and the Social World 6, 20–51). This was probably due to the greater conceptual density and concreteness of visual representation as the target is better captured verbally because of its abstractness. In contrast, the source domains were mainly concrete and thus perceivable pictorially rather than verbally. The study mainly demonstrates the effect that metaphor and metonymy found in political cartoons can have on the perception of the target domain by the audience and by extension their attitude toward it.

Speech-accompanying gestures have been shown to reduce cognitive load on a secondary task compared to speaking without gestures. In the current study, we investigate whether this benefit of speech-accompanying gestures is shared by speech-accompanying actions (i.e., movements that leave a lasting trace in the physical world). In two experiments, participants attempted to retain verbal and spatial information from a grid while describing a pattern while gesturing, while making the pattern, or while keeping hands still. Producing gestures reduced verbal load compared to keeping hands still when the pattern being described was visually present (Experiment 1), and this benefit was not shared by making the pattern. However, when the pattern being described was not visually present (Experiment 2), making the pattern benefited verbal load compared to keeping hands still. Neither experiment revealed a significant difference between gesture and action. Taken together, the findings suggest that moving the hands in meaningful ways can benefit verbal load.

This paper investigates the cognitive mechanisms underlying eating and drinking metaphors in Mongolian and discusses complex linguistic features of some culturally unique idioms relating to id- ‘eat’ and uu- ‘drink’, which are interpreted from a sociocultural perspective, along with the help of world knowledge. Metaphorical extensions of id- and uu- fall into three subcategories: (1) agent-oriented extensions, highlighting the consumer’s role in the source domain of eating and drinking; (2) patient-oriented extensions, focusing on destructive effects on the patient in the source domain; (3) extensions involving both agent and patient orientations, describing the agent’s sensation and “destruction” of the patient at the same time. Based on the Mongolian Web Corpus (mnWac16) and an extensive online dictionary (mongoltoli.mn), it is found that patient-oriented extensions tend to be more connected with EAT verbs in Mongolian, denoting a range of extensions like overcoming of the patient, spending material wealth, psychological torment or destruction, corrosion caused by external factors, etc., while agent-oriented extensions are more likely to involve DRINK verbs, denoting ‘smoking’, receiving material wealth (e.g., earning money) and absorption of such liquids as ink or oil. Overall, id- has a broader extension than uu-, and there are some overlaps involving both agent and patient orientations in terms of living on material wealth and physical exploitation. Some common usages pertaining to metaphorical extensions of consumption verbs are found cross-linguistically.

Adopting a cross-language long-term repetition-priming paradigm, the current study systematically investigated number representation in Tibetan–Mandarin bilinguals. The study focused on three types of numerals: Arabic digits, Tibetan numerals, and Mandarin numerals. Experiment 1 examined lexical representation; participants performed a lexical decision task in the cross-language repetition-priming paradigm. Experiment 2 used a parity judgment task to examine conceptual representation. In both experiments, if the presentation of the numerals during the learning phase facilitated responses to their translation equivalents in the testing phase, it would indicate that they activate each other (i.e., a shared representation). Results showed that the presentation of Tibetan or Mandarin numerals did not facilitate subsequent responses to the Arabic digit equivalent. No cross-language repetition-priming effect between Tibetan and Mandarin numerals was found in the lexical decision task, indicating that Arabic digits, Tibetan number words, and Mandarin number words are stored separately at the lexical level. At the conceptual level, the results were quite the opposite, suggesting that these three types of numerals share a common representation. To sum up, the results imply that bilinguals’ number representation is similar to bilinguals’ language representation, providing a better understanding of number representation in bilinguals from a linguistic perspective.

This research probed how classifiers marking an object’s membership in the grammar of classifier languages like Mandarin Chinese and Korean may influence their speakers to categorize objects differently compared to speakers of non-classifier languages like English. Surveys in multiple-choice format were given to native speakers of the three languages. Analysis of the results demonstrated that significant proportions of Mandarin Chinese and Korean speakers behaved differently from English speakers due to the classifier-based strategy influencing classifier language speakers’ categorization. Adopting the Competition Model, we suggest that among the various categorizing strategies available to language users, the one with the greatest strength at the moment of performing the task wins the categorization competition. Classifiers that are grammaticalized in classifier languages may be providing their speakers with a powerful cognitive tool to notice diverse characteristics shared between objects, which is usually unavailable to non-classifier languages. Therefore, the strength of classifier-based strategy in the minds of classifier language speakers is strong enough to win some of the categorization competitions, which guides them to make different categorizing decisions from non-classifier language users.

This article compares risk tolerance of native Arabic speakers under two language contexts: their first language (L1 Arabic) and their foreign language (L2 English). We aim to evaluate whether thinking in a foreign language actually reduces the negative effects of cognitive biases, such as loss aversion and mental accounting, on financial decision-making. Toward this aim, we conducted two experiments in which the risk tolerance levels of 144 participants were evaluated across four different types of decision-making problems: the Asian disease problem, the financial crisis problem, the discount problem, and the ticket/money lost problem. In study 1, we adopted Keysar et al.’s (2012, Psychological Science, 23, 661–668) experiment to test the effect of L2 on framing effects associated with loss aversion, and in Study 2, we adopted Costa et al.’s (2014, Cognition, 130, 236–254) experiment to test the effect of L2 on framing effects associated with mental accounting biases. We found that individuals were risk-averse for gains and risk-seeking for losses when presented with choices in their L1, but were almost unaffected by framing manipulation under the L2 condition. When it came to mental accounting, however, framing effects were nearly absent in both L1 and L2 conditions. In our investigation, we examined various potential factors that could explain the foreign language effect on decision-making. The primary factor that appears to account for this linguistic phenomenon is the heightened cognitive and emotional distance experienced when using an L2.

How much information do language users need to differentiate potentially absolute synonyms into near-synonyms? How consistent must the information be? We present two simple experiments designed to investigate this. After exposure to two novel verbs, participants generalized them to positive or negative contexts. In Experiment 1, there was a tendency across conditions for the verbs to become differentiated by context, even following inconsistent, random, or neutral information about context during exposure. While a subset of participants matched input probabilities, a high proportion did not. As a consequence, the overall pattern was of growth in differentiation that did not closely track input distributions. Rather, there were two main patterns: When each verb had been presented consistently in a positive or negative context, participants overwhelmingly specialized both verbs in their output. When this was not the case, the verbs tended to become partially differentiated, with one becoming specialized and the other remaining less specialized. Experiment 2 replicated and expanded on Experiment 1 with the addition of a pragmatic judgment task and neutral contexts at test. Its results were consistent with Experiment 1 in supporting the conclusion that quality of input may be more important than quantity in the differentiation of synonyms.

Research has shown sound-symbolic associations between speech sounds and conceptual and/or perceptual properties of a referent. This study used the choice response time method to investigate hypothesized associations between a high/low vowel and spatial concepts of up/down and above/below. The participants were presented with a stimulus that moved either upward or downward (Experiments 1 and 2), or that was located above or below the reference stimulus (Experiment 3), and they had to pronounce a vowel ([i] or [æ]) based on the spatial location of the stimulus. The study showed that the high vowel [i] was produced faster in relation to the up-directed and the above-positioned stimulus, while the low vowel [æ] was produced faster in relation to the down-directed and the below-positioned stimulus. In addition, the study replicated the pitch-elevation effect showing a raising of the vocalization pitch when vocalizations were produced to the up-directed stimulus. The article discusses these effects in terms of the involvement of sensorimotor processes in representing spatial concepts.