Skip to main content Accessibility help
×
Hostname: page-component-78c5997874-xbtfd Total loading time: 0 Render date: 2024-11-16T09:23:23.025Z Has data issue: false hasContentIssue false

22 - Gesturing for the Addressee

from Part V - Gestures in Relation to Interaction

Published online by Cambridge University Press:  01 May 2024

Alan Cienki
Affiliation:
Vrije Universiteit, Amsterdam
Get access

Summary

Face-to-face dialogue and the cospeech gestures that occur within it are social as well as cognitive. Cospeech gestures are microsocial. Some of these gestures provide information that directly advances the topic of a dialogue. Others inform addressee about the state of the dialogue at that moment. Efron distinguished between objective and logical-discursive gestures. McNeill distinguished between propositional gestures and beats. Bavelas et al. distinguished between topical and interactive functions of gestures. Gerwing documented changes in form that marked gestures that were part of common ground. Seyfeddinipur identified discursive and meta-discursive gestures. Kendon described a variety of social, pragmatic gestures. Holler and Wilkin showed that mimicking a gesture conveyed understanding of that gesture. Galati and Brennan noted metanarrative functions of gestures. Kok et al. separated semantic and metacommunicative gestures. We focus on Clark’s distinction between track 1 and track 2 functions in dialogue. Track 1 conveys the basic communicative acts (i.e. topical content) whereas track 2 conveys the metacommunicative acts that ensure successful communication.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2024

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Alibali, M. W., Heath, D. C., & Myers, H. J. (2001). Effects of visibility between speaker and listener on gesture production: Some gestures are meant to be seen. Journal of Memory and Language, 44(2), 169188. https://doi.org/10.1006/jmla.2000.2752CrossRefGoogle Scholar
Allport, G. W. (1954). The historical background of modern social psychology. In Lindzey, G. (Ed.), Handbook of Social Psychology (Vol. I, pp. 356). Cambridge, MA: Addison-Wesley.Google Scholar
Aronson, E., & Carlsmith, J. M. (1968). Experimentation in social psychology. In Lindzey, G. & Aronson, E. (Eds.), The handbook of social psychology (2nd ed., Vol. 2, pp. 179). Reading, MA: Addison-Wesley.Google Scholar
Bangerter, A., & Chevally, E. (2007). Pointing and describing in referential communication: When are pointing gestures used to communicate? In van der Sluis, I., Theune, M., Reiter, E., & Krahmer, E. (Eds.), CTIT Proceedings of the Workshop on Multimodal Output Generation (pp. 1728). Enschede, the Netherlands: Centre for Telematics and Information Technology.Google Scholar
Bateson, G. (1951). Information and codification: A philosophical approach. In Ruesch, J. & Bateson, G. (Eds.), Communication. The social matrix of psychiatry (pp. 168227). New York, NY: W. W. Norton & Company.Google Scholar
Bavelas, J. B. (2005). The two solitudes: Reconciling social psychology and language and social interaction. In Fitch, K. & Sanders, R. (Eds.), Handbook of language and social interaction (pp. 179200). Mahwah, NJ: Erlbaum.Google Scholar
Bavelas, J. B. (2007). Face-to-face dialogue as a micro-social context. The example of motor mimicry. In Duncan, S., Levy, E., & Cassell, J. (Eds.), Gesture and the dynamic dimension of language (pp. 127146). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Bavelas, J. B. (2022). Face-to-face dialogue. Theory, research, and applications. Oxford, UK: Oxford University Press.CrossRefGoogle Scholar
Bavelas, J. B., Chovil, N., Coates, L., & Roe, L. (1995). Gestures specialized for dialogue. Personality and Social Psychology Bulletin, 21(4), 394405. https://doi.org/10.1177/0146167295214010CrossRefGoogle Scholar
Bavelas, J. B., Chovil, N., Lawrie, D. A., & Wade, A. (1992). Interactive gestures. Discourse Processes, 15(4), 469489. https://doi.org/10.1080/01638539209544823CrossRefGoogle Scholar
Bavelas, J. B., Coates, L., & Johnson, T. (2000). Listeners as co-narrators. Journal of Personality and Social Psychology, 79(6), 941952. https://doi.org/10.1037/0022-3514.79.6.941CrossRefGoogle ScholarPubMed
Bavelas, J., Gerwing, J., Allison, M., & Sutton, C. (2011). Dyadic evidence for grounding with abstract deictic gestures. In Stam, G. & Ishino, M. (Eds.), Integrating gestures: The interdisciplinary nature of gesture (pp. 4960). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Bavelas, J. B., Gerwing, J., Sutton, C., & Prevost, D. (2008). Gesturing on the telephone: Independent effects of dialogue and visibility. Journal of Memory and Language, 58(2), 495520. https://doi.org/10.1016/j.jml.2007.02.004CrossRefGoogle Scholar
Bavelas, J. B., & Healing, S. (2013). Reconciling the effects of mutual visibility on gesturing. A review. Gesture, 13(1), 6392. https://doi.org/10.1075/gest.13.1.03bavCrossRefGoogle Scholar
Chafe, W. (1994). Discourse, consciousness, and time. Chicago, IL: University of Chicago Press.Google Scholar
Clark, H. H. (1996). Using language. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Clark, H. H., & Krych, M. A. (2004). Speaking while monitoring addressees for understanding. Journal of Memory and Language, 50(1), 6281. https://doi.org/10.1016/j.jml.2003.08.004CrossRefGoogle Scholar
Clark, H. H., & Schaefer, E. F. (1987). Collaborating on contributions to conversations. Language and Cognitive Processes, 2(1), 1941. https://doi.org/10.1080/01690968708406350CrossRefGoogle Scholar
Clark, H. H., & Wilkes-Gibbs, D. (1986). Referring as a collaborative process. Cognition, 22, l–39. https://doi.org/10.1016/0010-0277(86)90010-7CrossRefGoogle ScholarPubMed
Cohen, A. A. (1977). The communicative functions of hand illustrators. Journal of Communication, 27(4), 5463.CrossRefGoogle Scholar
Cohen, A. A., & Harrison, R. P. (1973). Intentionality in the use of hand illustrators in face-to-face communication situations. Journal of Personality and Social Psychology, 28(2), 276279.CrossRefGoogle Scholar
Danziger, K. (1990). Constructing the subject: Historical origins of psychological research. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
De Fornel, M. (1992). The return gesture: Some remarks on context, inference, and iconic gesture. In Auer, P. & di Luzio, A. (Eds.), The contextualization of language (pp. 159176). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
De Ruiter, J. P., Bangerter, A., & Dings, P. (2012). The interplay between gesture and speech in the production of referring expressions: Investigating the tradeoff hypothesis. Topics in Cognitive Science, 4(2), 232248. https://doi.org/10.1111/j.1756-8765.2012.01183.xCrossRefGoogle ScholarPubMed
Duncan, S., Jr. (1969). Nonverbal communication. Psychological Bulletin, 72(2), 118137.CrossRefGoogle Scholar
Efron, D. (1941). Gesture, race and culture. The Hague, the Netherlands: Mouton.Google Scholar
Efron, D. (1972). Gesture, race, and culture: A tentative study of some of the spatio-temporaland “linguistic” aspects of gestural behavior of Eastern Jews and Southern Italians in New York City, living under similar as well as different environmental conditions. The Hague, the Netherlands: Mouton.Google Scholar
Ekman, P., & Friesen, W. V. (1969). The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica, 1(1), 4998. https://doi.org/10.1515/semi.1969.1.1.49CrossRefGoogle Scholar
Emmorey, K., & Casey, S. (2001). Gesture, thought and spatial language. Gesture, 1(1), 3550. https://doi.org/10.1075/gest.1.1.04emmCrossRefGoogle Scholar
Fowler, C. A. (1988). Differential shortening of repeated content words produced in various communicative contexts. Language and Speech, 31(4), 307319.CrossRefGoogle ScholarPubMed
Galati, A., & Brennan, S. E. (2013). Speakers adapt gestures to addressees’ knowledge: Implications for models of co-speech gesture. Language and Cognitive Processes, 29(4), 435451. https://doi.org/10.1080/01690965.2013.796397Google Scholar
Gerwing, J. (2003). The effect of immediate communicative function on the physical form of conversational hand gestures. (Unpublished Master’s thesis). University of Victoria, Victoria, B.C., Canada.Google Scholar
Gerwing, J., & Allison, M. (2011). The flexible semantic integration of gestures and words: Comparing face-to-face and telephone dialogues. Gesture, 11(3), 308329. https://doi.org/10.1075/gest.11.3.03gerCrossRefGoogle Scholar
Gerwing, J., & Bavelas, J.B. (2004). Linguistic influences on gesture’s form. Gesture, 4(2), 157195. https://doi.org/10.1075/gest.4.2.04gerCrossRefGoogle Scholar
Grice, H. P. (1975). Logic and conversation. In Cole, P. and Morgan, J. L. (Eds.), Syntax and semantics 3: speech acts (pp. 4158). New York, NY: Academic Press.Google Scholar
Healing, S., & Gerwing, J. (2012, July). Spatial cohesiveness in gesture sequences: Effects of mutual visibility. Paper presented at the fifth conference of the International Society for Gesture Studies, Lund, Sweden. Abstract retrieved from https://www.gesturestudies.com/s/ISGS5_BOA_120718.pdfGoogle Scholar
Hilliard, C., & Cook, S. W. (2015). Bridging gaps in common ground: Speakers design their gestures for their listeners. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42(1), 91103. https://doi.org/10.1037/xlm0000154Google Scholar
Holler, J., & Bavelas, J. B. (2017). On the multi-modal communication of common ground – A review and examination of social functions. In Church, R. B., Alibali, M. W., & Kelly, S. (Eds.), Why gesture? How the hands function in speaking, thinking, and communicating (pp. 213240). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Holler, J., Bavelas, J., Woods, J., Geiger, M., & Simons, L. (2022). Given-new effects on the duration of gestures and of words in face-to-face dialogue. Discourse Processes, 59(8), 619645. https://doi.org/10.1080/0163853X.2022.2107859CrossRefGoogle Scholar
Holler, J., & Beattie, G. (2007). Gesture use in social interaction: How speakers’ gestures can reflect listeners’ thinking. Paper presented at the third conference of the International Society for Gesture Studies, Chicago, IL.Google Scholar
Holler, J., & Levinson, S. C. (2019). Multimodal language processing in human communication. Trends in Cognitive Science, 23(8), 639652. https://doi.org/10.1016/j.tics.2019.05.006CrossRefGoogle ScholarPubMed
Holler, J., & Stevens, R. (2007). The effect of common ground on how speakers use gesture and speech to represent size information. Journal of Language and Social Psychology, 26(1), 427. https://doi.org/10.1177/0261927X06296428CrossRefGoogle Scholar
Holler, J., Turner, K., & Varcianna, T. (2013). It’s on the tip of my fingers: Co-speech gestures during lexical retrieval in different social contexts. Language and Cognitive Processes, 28(10), 15091518. https://doi.org/10.1080/01690965.2012.698289CrossRefGoogle Scholar
Holler, J., Tutton, M., & Wilkin, K. (2011). Co-speech gestures in the process of meaning coordination. In Proceedings of the 2nd GESPIN- Gesture and Speech in Interaction Conference, Bielefeld, 57 September 2011.Google Scholar
Holler, J., & Wilkin, K. (2011). Co-speech gesture mimicry in the process of collaborative referring during face-to-face dialogue. Journal of Nonverbal Behavior, 35(2), 133153. https://doi.org/10.1007/s10919-011-0105-6CrossRefGoogle Scholar
Hostetter, A. B. (2011). When do gestures communicate? A meta-analysis. Psychological Bulletin, 137(2), 297315. https://doi.org/10.1037/a0022128CrossRefGoogle ScholarPubMed
Kendon, A. (1994). Do gestures communicate? A review. Research on Language and Social Interaction, 27(3), 175200. https://doi.org/10.1207/s15327973rlsi2703_2CrossRefGoogle Scholar
Kendon, A. (1995). Gestures as illocutionary and discourse structure markers in Southern Italian conversation. Journal of Pragmatics, 23, 247279. https://doi.org/10.1016/0378-2166(94)00037-FCrossRefGoogle Scholar
Kendon, A. (2004). Gesture. Visible action as utterance. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Kendon, A. (2017). Pragmatic functions of gestures. Some observations on the history of their study and their nature. Gesture. 16(2), 157175. https://doi.org/10.1075/gest.16.2.01kenCrossRefGoogle Scholar
Kok, K., Bergmann, K., Cienki, A., & Kopp, S. (2016). Mapping out the multifunctionality of speakers’ gestures. Gesture, 15(1), 3759. https://doi.org/10.1075/gest.15.1.02kokCrossRefGoogle Scholar
Krauss, R. M., Dushay, R. A., Chen, Y., & Rauscher, F. (1995). The communicative value of conversational hand gestures. Journal of Experimental Social Psychology, 31(6), 533552. https://doi.org/10.1006/jesp.1995.1024CrossRefGoogle Scholar
Krauss, R. M., Morrel-Samuels, P., & Colasante, C. (1991). Do conversational hand gestures communicate? Journal of Personality and Social Psychology, 61(5), 743754. https://doi.org/10.1037/0022-3514.61.5.743CrossRefGoogle ScholarPubMed
Kuhlen, A. K., & Brennan, S. E. (2013). Language in dialogue: When confederates might be hazardous to your data. Psychonomic Bulletin and Review, 20, 5472. https://doi.org/10.3758/s13423-012-0341-8CrossRefGoogle ScholarPubMed
McNeill, D. (1985). So you think gestures are nonverbal? Psychological Review, 92(3), 350371. https://doi.org/10.1037/0033-295X.92.3.350CrossRefGoogle Scholar
McNeill, D. (2005). Gesture and thought. Chicago, IL: University of Chicago Press.CrossRefGoogle Scholar
McNeill, D., & Levy, E. T. (1982). Cohesion and gesture. Discourse Processes, 16(4), 363386. https://doi.org/10.1080/01638539309544845CrossRefGoogle Scholar
Mol, L., Krahmer, E., Maes, A., & Swerts, M. (2009a). Communicative gestures and memory load. In Proceedings of the 31st Annual Conference of the Cognitive Science Society, Amsterdam, the Netherlands, 15691574.Google Scholar
Mol, L., Krahmer, E., Maes, A., & Swerts, M. (2009b). The communicative import of gestures. Evidence from a comparative analysis of human–human and human–machine interactions. Gesture, 9(1), 97126. https://doi.org/10.1075/gest.9.1.04molCrossRefGoogle Scholar
Özyurek, A. (2000). The influence of addressee location on spatial language and representational gestures of direction. In McNeill, D. (Ed.), Language and gesture (pp. 6483). Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Özyurek, A. (2002). Do speakers design their cospeech gestures for their addressees? The effects of addressee location on representational gestures. Journal of Memory and Language, 46, 688704. https://doi.org/10.1006/jmla.2001.2826CrossRefGoogle Scholar
Pine, K. J., Burney, D. J., & Fletcher, B. (2010). The semantic specificity hypothesis: When gestures do not depend upon the presence of a listener. Journal of Nonverbal Behavior, 34(3), 169178. https://doi.org/10.1007/s10919-010-0089-7CrossRefGoogle Scholar
Rimé, B. (1982). The elimination of visible behavior from social interactions: Effects on verbal, nonverbal and interpersonal variables. European Journal of Social Psychology, 12(2), 113129. https://doi.org/10.1002/ejsp.2420120201CrossRefGoogle Scholar
Seyfeddinipur, M. (2004). Meta-discursive gestures from Iran: Some uses of the “Pistol Hand.” In Müller, C. & Posner, R. (Eds.), The semantics and pragmatics of everyday gestures. Proceedings of the Berlin Conference 1998. Berlin, Germany: Weidler Buchverlag.Google Scholar
Streeck, J. (2009). Gesturecraft. The manu-facture of meaning. Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Streeck, J., Goodwin, C., & LeBaron, C. (Eds.). (2011). Embodied interaction: Language and body in the material world. Cambridge, UK: Cambridge University Press.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×