How people communicate about motion events and how this is shaped by language typology are mostly studied with a focus on linguistic encoding in speech. Yet, human communication typically involves an interactional exchange of multimodal signals, such as hand gestures that have different affordances for representing event components. Here, we review recent empirical evidence on multimodal encoding of motion in speech and gesture to gain a deeper understanding of whether and how language typology shapes linguistic expressions in different modalities, and how this changes across different sensory modalities of input and interacts with other aspects of cognition. Empirical evidence strongly suggests that Talmy’s typology of event integration predicts multimodal event descriptions in speech and gesture and visual attention to event components prior to producing these descriptions. Furthermore, variability within the event itself, such as type and modality of stimuli, may override the influence of language typology, especially for expression of manner.

The present study investigates cross-linguistic differences in the description of motion events using Holistic Spatial Semantics (HSS) as a theoretical framework. In this study, six short video stimuli featuring various motion situations were used to elicit narratives from 35 speakers of French and 29 speakers of Swedish. The proportions of semantic category Path linguistically expressed did not vary significantly between the groups. However, the French narratives had significantly less Manner and Direction expression. Furthermore, they included significantly more unbounded non-translocative events compared to the Swedish narratives. Partly, this was due to the tendency within the Swedish group to construe situations as bounded events that were clearly shown as unbounded in the stimuli. There was also a tendency within the French group to distribute the information about the same situation over two clauses. These findings lend further support to the relevance of distinguishing between the Path and Direction categories, as well as other key features of the HSS framework, such as the distinction between non-verbal motion situations and their linguistic construals.

This paper examines the influence of cultural display rules on how high-status individuals, such as political leaders, publicly express anger. Specifically, it focuses on Recep Tayyip Erdoğan, who has been the Turkish leader since 2003. The study aims to understand the extent to which Erdoğan’s expression of anger is influenced by cultural display rules, the religious context stemming from his conservative electoral support, and his position as a long-term populist political leader. Using extended conceptual metaphor theory (ECMT) supported by corpus-assisted discourse analysis, the paper seeks to identify the contextual factors that shape anger expressions (both direct and metaphorical) in the political discourse of a populist leader in a collectivist culture. By comparing the conceptualization of ascribed anger and inscribed anger expressions, the analysis reveals that Erdoğan’s discourse presents two distinct scenarios for expressing anger toward ‘us’ and ‘others’. Additionally, it demonstrates how anger is strategically employed in culture-specific ways to navigate the challenges posed by conflicting contextual factors.

Abstraction processes involve two variables that are often confused with one another: concreteness (banana versus belief) and specificity (chair versus furniture or Buddhism versus religion). Researchers are investigating the relationship between them, but many questions remain open, such as: What type of semantics characterizes words with varying degrees of concreteness and specificity? We tackle this topic through an in-depth semantic analysis of 1049 Italian words for which human-generated concreteness and specificity ratings are available. Our findings show that (as expected) the semantics of concrete and abstract concepts differs, but most interestingly when specificity is considered, the variance in concreteness ratings explained by semantic types increases substantially, suggesting the need to carefully control word specificity in future research. For instance, mathematical concepts (phase) are on average abstract and generic, while behavioral qualities (arrogant) are on average abstract but specific. Moreover, through cluster analyses based on concreteness and specificity ratings, we observe the bottom-up emergence of four subgroups of semantically coherent words. Overall, this study provides empirical evidence and theoretical insight into the interplay of concreteness and specificity in shaping semantic categorization.

While studies have shown the importance of listener feedback in dialogue, we still know little about the factors that impact its quality. Feedback can indicate either that the addressee is aligning with the speaker (i.e. ‘positive’ feedback) or that there is some communicative trouble (i.e. ‘negative’ feedback). This study provides an in-depth account of listener feedback in task-oriented dialogue (a director–matcher game), where positive and negative feedback is produced, thus expressing both alignment and misalignment. By manipulating the listener’s cognitive load through a secondary mental task, we measure the effect of divided attention on the quantity and quality of feedback. Our quantitative analysis shows that performance and feedback quantity remain stable across cognitive load conditions, but that the timing and novelty of feedback vary: turns are produced after longer pauses when attention is divided between two speech-focused tasks, and they are more economical (i.e. include more other-repetitions) when unrelated words need to be retained in memory. These findings confirm that cognitive load impacts the quality of listener feedback. Finally, we found that positive feedback is more often generic and shorter than negative feedback and that its proportion increases over time.

According to Talmy, in verb-framed languages (e.g., French), the core schema of an event (Path) is lexicalized, leaving the co-event (Manner) in the periphery of the sentence or optional; in satellite-framed languages (e.g., English), the core schema is jointly expressed with the co-event in construals that lexicalize Manner and express Path peripherally. Some studies suggest that such differences are only surface differences that cannot influence the cognitive processing of events, while others support that they can constrain both verbal and non-verbal processing. This study investigates whether such typological differences, together with other factors, influence visual processing and decision-making. English and French participants were tested in three eye-tracking tasks involving varied Manner–Path configurations and language to different degrees. Participants had to process a target motion event and choose the variant that looked most like the target (non-verbal categorization), then describe the events (production), and perform a similarity judgment after hearing a target sentence (verbal categorization). The results show massive cross-linguistic differences in production and additional partial language effects in visualization and similarity judgment patterns – highly dependent on the salience and nature of events and the degree of language involvement. The findings support a non-modular approach to language–thought relations and a fine-grained vision of the classic lexicalization/conflation theory.

Conceptual metaphor theory (CMT) holds that most conceptual metaphors are processed unconsciously. However, whether multiple words can be integrated into a holistic metaphoric sentence without consciousness remains controversial in cognitive science and psychology. This study aims to investigate the role of consciousness in processing Chinese nominal metaphoric sentences ‘A是B’ (A is[like] B) with a psychophysical experimental paradigm referred to as breaking continuous flash suppression (b-CFS). We manipulated sentence types (metaphoric, literal and anomalous) and word forms (upright, inverted) in a two-staged experiment (CFS and non-CFS). No difference was found in the breakthrough times among all three types of sentences in the CFS stage, while literal sentences were detected more slowly than either metaphoric or anomalous sentences in the non-CFS stage. The results suggest that the integration of multiple words may not succeed without the participation of consciousness, let alone metaphoric processing. These findings may redefine ‘unconscious’ in CMT as ‘preconscious’ and support the indirect access view regarding how the metaphoric meaning is processed in the brain.

The present study assessed the comprehension of Spanish object relative (OR) clauses by 6- and 7-year-old children before and after a brief training session targeting the structural differences between ORs and subject relatives. In addition, we investigated the potential relationships between OR comprehension on the one hand and vocabulary size and non-verbal intelligence quotient (IQ) on the other. Comprehension of ORs was very poor at the pre-test but improved considerably after training. Further improvement was observed between the immediate post-test and a delayed post-test, suggesting that the knowledge acquired during training had been integrated into the children’s developing linguistic systems. Non-verbal IQ and vocabulary were not found to predict comprehension accuracy. We take these results to suggest that children’s difficulties with ORs are better explained by their experience with this construction than by maturational factors and that explicit contrast and feedback can bolster grammatical development in L1 acquisition.

Languages vary in the mapping of relational terms onto events. For instance, English motion descriptions favor manner (how something moves) verbs over path (where something move) verbs, whereas those of other languages, like Spanish, show the opposite pattern. While these lexicalization biases are malleable, adopting a novel lexicalization pattern can be slow for second language learners. One potential mechanism for learning non-native verb mappings is cross-situational statistical learning (CSSL). However, the application of CSSL to verbs is limited and does not explicitly examine how lexicalization biases may complicate adults’ ability to resolve the referential uncertainty of multiple referents. We ask English-speaking monolingual adults to learn the mappings of ten verbs via CSSL. Verbs mapped onto either manner or path of motion, with the other event component held constant. Adults in both conditions demonstrated successful learning of novel verbs, with adults learning the manner verbs showing more consistent performance across accepting correct referents and rejecting incorrect ones. Our results are the first to demonstrate adults’ use of CSSL to acquire verb meanings that both align with and cut against native lexicalization biases and suggest a limited influence of lexicalization biases on adults’ learning in idealized CSSL conditions.

When speaking or writing, people tend to re-use the syntactic structures they recently encountered (structural priming). Individuals differ in the extent to which they are primed (primeability). Previous research has suggested that perspective-taking, that is, the ability to imagine the feelings, thoughts and perceptions of others, predicts the magnitude of priming in adults. The present study investigates if this also holds for monolingual and bilingual children. We primed the possessive structure in monolingual Dutch children and bilingual children with varying L2s. There was individual variation in children’s primeability in both groups. For both monolinguals and bilinguals, we found that the better children were at perspective-taking, the more likely they were to be primed. Dutch language proficiency also influenced children’s primeability: higher language proficiency resulted in more priming in both groups. The findings suggest that structural priming serves a social function which is mediated by perspective-taking abilities.

Verb semantics has been widely approached as a dichotomy of manner and result. However, from a cognitive perspective, manner and result are often linked by intention, as captured by the ‘fulfilment type’ property formulated in the Realisation event domain in Talmy’s event integration theory. The four ‘fulfilment types’ (intrinsic-, moot-, implied-, and attained-fulfilment) indicate different degrees of result certainty in verbs. This study investigates whether manner/result complementarity is cognitively less dichotomous and more nuanced, as the four fulfilment types in verbs could indicate more than two mental representations of verbs. Through two psycholinguistic experiments, we examine whether fulfilment types influence the cognitive salience of manner and result in novel verb meaning interpretation (Experiment 1) and the semantic relatedness between English verbs with different fulfilment types (Experiment 2). Our results demonstrate that manner and result in the mental lexicon act less like a dichotomy but more like a cline. This blur between manner and result verb statuses has consequences for a language’s typological stance in the Realisation domain and implications for how Talmyan event research should be extended beyond well-studied Motion.

Words with complex semantic types such as book are characterised by a multiplicity of interpretations that are not mutually exclusive (e.g., as a physical object and/or informational content). Their status with respect to lexical ambiguity is notoriously unclear, and it is debatable whether complex types are a particular form of polysemy (closely related to metonymy) or whether they belong to monosemy. In this study, we investigate the nature of complex types by conducting two experiments on ambiguous nouns in French. The first experiment collects speakers’ judgements about the sameness of meaning between different uses of complex-type, metonymic and monosemous words. The second experiment uses a priming paradigm and a sensicality task to investigate the online processing of complex-type words, as opposed to metonymic and monosemous words. Overall results indicate that, on a continuum of lexical ambiguity, complex types are closer to monosemy than to metonymy. The different interpretations of complex-type words are highly connected and fall under the same meaning, arguably in relation to a unique reference. These results suggest that complex types are associated with single underspecified entries in the mental lexicon. Moreover, they highlight the need for a model of lexical representations of ambiguous words that can account for the difference between complex types and metonymy.

The expression of manner has been extensively studied in the case of motion event descriptions, unveiling significant typological differences between satellite-framed and verb-framed languages and cognitive differences between speakers of these languages. However, far from being restricted to this semantic domain, the expression of manner extends to other types of event descriptions and across virtually all verb classes. In this paper, by considering all the means of expressing manner and grounding our research in a domain-independent definition of this component, we investigate the expression and the transfer of manner under high cognitive pressure as evidenced by corpus data from French–English (FE) and English–French (EF) simultaneous interpreting. Unexpectedly, both French and English displayed an overall cross-domain preference for the verbal-lexical coding of manner in event descriptions, while still differing in the degree to which it was favored. In addition, although our study does not allow a direct measure of cognitive load, the FE interpreters transfer more manner from the source to the target speeches than the EF interpreters do, despite high pressure on cognitive resources, supporting the claim that manner can be cognitively more salient and accessible for English than for French speakers, not only in the domain of motion but also at a more general level, potentially in any semantic domain.

Music and language are unique communication tools in human society, where stress plays a crucial role. Many studies have examined the recognition of lexical stress in Indo-European languages using beat/rhythm priming, but few studies have examined the cross-domain relationship between musical and linguistic stress in tonal languages. The current study investigates how musical stress and lexical stress influence lexical stress recognition in Mandarin. In the auditory priming experiment, disyllabic Mandarin words with initial or final stress were primed by disyllabic words or beats with either congruent or incongruent stress patterns. Results showed that the incongruent condition elicited larger P2 and the late positive component (LPC) amplitudes than the congruent condition. Moreover, the Strong-Weak primes elicited larger N400 amplitudes than the Weak-Strong primes, and the Weak-Strong primes yielded larger LPC amplitudes than the Strong-Weak primes. The findings reveal the neural correlates of the cross-domain influence between music and language during lexical stress recognition in Mandarin.

In spoken conversations, speakers and their addressees constantly seek and provide different forms of audiovisual feedback, also known as backchannels, which include nodding, vocalizations and facial expressions. It has previously been shown that addressees backchannel at specific points during an interaction, namely after a speaker provided a cue to elicit feedback from the addressee. However, addressees may differ in the frequency and type of feedback that they provide, and likewise, speakers may vary the type of cues they generate to signal the backchannel opportunity points (BOPs). Research on the extent to which backchanneling is idiosyncratic is scant. In this article, we quantify and analyze the variability in feedback behavior of 14 addressees who all interacted with the same speaker stimulus. We conducted this research by means of a previously developed experimental paradigm that generates spontaneous interactions in a controlled manner. Our results show that (1) backchanneling behavior varies between listeners (some addressees are more active than others) and (2) backchanneling behavior varies between BOPs (some points trigger more responses than others). We discuss the relevance of these results for models of human–human and human–machine interactions.

To what extent can statistical language knowledge account for the effects of world knowledge in language comprehension? We address this question by focusing on a core aspect of language understanding: pronoun resolution. While existing studies suggest that comprehenders use world knowledge to resolve pronouns, the distributional hypothesis and its operationalization in large language models (LLMs) provide an alternative account of how purely linguistic information could drive apparent world knowledge effects. We addressed these confounds in two experiments. In Experiment 1, we found a strong effect of world knowledge plausibility (measured using a norming study) on responses to comprehension questions that probed pronoun interpretation. In experiment 2, participants were slower to read continuations that contradicted world knowledge-consistent interpretations of a pronoun, implying that comprehenders deploy world knowledge spontaneously. Both effects persisted when controlling for the predictions of GPT-3, an LLM, suggesting that pronoun interpretation is at least partly driven by knowledge about the world and not the word. We propose two potential mechanisms by which knowledge-driven pronoun resolution occurs, based on validation- and expectation-driven discourse processes. The results suggest that while distributional information may capture some aspects of world knowledge, human comprehenders likely draw on other sources unavailable to LLMs.

In everyday life, visual information often precedes the auditory one, hence influencing its evaluation (e.g., seeing somebody’s angry face makes us expect them to speak to us angrily). By using the cross-modal affective paradigm, we investigated the influence of facial gestures when the subsequent acoustic signal is emotionally unclear (neutral or produced with a limited repertoire of cues to anger). Auditory stimuli spoken with angry or neutral prosody were presented in isolation or preceded by pictures showing emotionally related or unrelated facial gestures (angry or neutral faces). In two experiments, participants rated the valence and emotional intensity of the auditory stimuli only. These stimuli were created from acted speech from movies and delexicalized via speech synthesis, then manipulated by partially preserving or degrading their global spectral characteristics. All participants relied on facial cues when the auditory stimuli were acoustically impoverished; however, only a subgroup of participants used angry faces to interpret subsequent neutral prosody. Thus, listeners are sensitive to facial cues for evaluating what they are about to hear, especially when the auditory input is less reliable. These results extend findings on face perception to the auditory domain and confirm inter-individual variability in considering different sources of emotional information.

Prosodic realization of focus has been a widely investigated topic across languages and modalities. Simultaneous focus strategies are intriguing to see how they interact regarding their functional and temporal alignment. We explored the multichannel (manual and nonmanual) realization of focus in Turkish Sign Language. We elicited data with focus type, syntactic roles and movement type variables from 20 signers. The results revealed the focus is encoded via increased duration in manual signs, and nonmanuals do not necessarily accompany focused signs. With a multichanneled structure, sign languages use two available channels or opt for one to express focushood.

While iconicity has sometimes been defined as meaning transparency, it is better defined as a subjective phenomenon bound to an individual’s perception and influenced by their previous language experience. In this article, I investigate the subjective nature of iconicity through an experiment in which 72 deaf, hard-of-hearing and hearing (signing and non-signing) participants rate the iconicity of individual letters of the American Sign Language (ASL) and Swedish Sign Language (STS) manual alphabets. It is shown that L1 signers of ASL and STS rate their own (L1) manual alphabet as more iconic than the foreign one. Hearing L2 signers of ASL and STS exhibit the same pattern as L1 signers, showing an iconic preference for their own (L2) manual alphabet. In comparison, hearing non-signers show no general iconic preference for either manual alphabet. Across all groups, some letters are consistently rated as more iconic in one sign language than the other, illustrating general iconic preferences. Overall, the results align with earlier findings from sign language linguistics that point to language experience affecting iconicity ratings and that one’s own signs are rated as more iconic than foreign signs with the same meaning, even if similar iconic mappings are used.