The research focused on the relationship between gesticulation (Kendon, 1980; McNeill, 2005) and speech prosody through the comparison between spontaneous and acted speech. The study relies on the adoption of theoretical frameworks which are suitable for data comparison, i.e., the Language into Act Theory - L-AcT (Cresti, 2000; Moneglia & Raso, 2014), in which prosodic cues are considered for their correlation with information structure; and Kita, van Gijn & van der Hulst (1998) for gesticulation. The study aims to define better the linguistic correlation between speech and gesture structures and highlight cognitive implications emerging from differences between the two varieties and the two modalities. Along with the qualitative results, we present a perception-based system of annotation, whose layout is mainly based on LASG (Bressem, Ladewig & Müller, 2013), where the gestural level and the prosodic level are analyzed as two continuous overlapping streamings parsed into perceptible relevant units. Both gesture annotation and linguistic annotation have been validated. As a general result, we have evidence of several reductions of both linguistic and gestural patterning strategies in acted speech instead of spontaneous speech. Utterances show poor informational organization in acted speech while, for the gesture, Gesture units and Gesture phrases tend to coincide. Both reductions call for a link between the ideational process, the Information structure, and the gesture during the spontaneous performance that falls into acted speech.

Reduction of gesticulation and information patterning strategies in acted speech / Giorgina Cantalini; Massimo Moneglia. - STAMPA. - (2022), pp. 346-362. [10.4324/9781003106401]

Reduction of gesticulation and information patterning strategies in acted speech

Giorgina Cantalini;Massimo Moneglia
2022

Abstract

The research focused on the relationship between gesticulation (Kendon, 1980; McNeill, 2005) and speech prosody through the comparison between spontaneous and acted speech. The study relies on the adoption of theoretical frameworks which are suitable for data comparison, i.e., the Language into Act Theory - L-AcT (Cresti, 2000; Moneglia & Raso, 2014), in which prosodic cues are considered for their correlation with information structure; and Kita, van Gijn & van der Hulst (1998) for gesticulation. The study aims to define better the linguistic correlation between speech and gesture structures and highlight cognitive implications emerging from differences between the two varieties and the two modalities. Along with the qualitative results, we present a perception-based system of annotation, whose layout is mainly based on LASG (Bressem, Ladewig & Müller, 2013), where the gestural level and the prosodic level are analyzed as two continuous overlapping streamings parsed into perceptible relevant units. Both gesture annotation and linguistic annotation have been validated. As a general result, we have evidence of several reductions of both linguistic and gestural patterning strategies in acted speech instead of spontaneous speech. Utterances show poor informational organization in acted speech while, for the gesture, Gesture units and Gesture phrases tend to coincide. Both reductions call for a link between the ideational process, the Information structure, and the gesture during the spontaneous performance that falls into acted speech.
2022
978-0-367-61745-5
978-0-367-62116-2
978-1-003-10640-1
Dance-Data-Cognition-and-Multimodal-Communication
346
362
Giorgina Cantalini; Massimo Moneglia
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificatore per citare o creare un link a questa risorsa: https://hdl.handle.net/2158/1294279
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact