Repetitions in Gesture


Book Description

Repetitive sequences play a major role as a pattern-building device and are a basic syntagmatic linguistic means on all language levels in spoken and signed languages. Little attention has been paid to investigating them in multimodal language use. Do gestures exhibit different types of repetitive sequences? Do they build complex units based on these types and if so, how is the pattern building to be described? How is the interrelation of gestural and spoken units in such complex units? Is it possible to identify repetitive patterns that are comparable to spoken and signed languages and/or patterns specific to the gestural modality? Based on a corpus-analysis of multimodal usage-events, 7 chapters explore gestural repetitions with regard to their structure, semantic and syntactic relevance for multimodal utterances, and cognitive saliency. Fine-grained cognitive-linguistic analyses of multimodal usage events reveal that gestural repetitions are not only a basic principle of building patterns in spoken and signed languages, but also in gestures. By addressing questions of mediality and multimodality of language-in-use, the book contributes to the investigation of repetition as a fundamental means of sign and meaning construction (crosscutting modalities) and enhances the understanding of the multimodal character of language in use.




Recurrent Gestures of Hausa Speakers


Book Description

This book presents a repertoire of conventionalized co-speech gestures used by Hausa speakers from northern Nigeria.







The Impulse to Gesture


Book Description

Establishing the inseparability of grammar and gesture, this book explains what determines when, how, and why we gesture.




Coverbal Synchrony in Human-Machine Interaction


Book Description

Embodied conversational agents (ECA) and speech-based human–machine interfaces can together represent more advanced and more natural human–machine interaction. Fusion of both topics is a challenging agenda in research and production spheres. The important goal of human–machine interfaces is to provide content or functionality in the form of a dialog resembling face-to-face conversations. All natural interfaces strive to exploit and use different communication strategies that provide additional meaning to the content, whether they are human–machine interfaces for controlling an application or different ECA-based human–machine interfaces directly simulating face-to-face conversation. Coverbal Synchrony in Human-Machine Interaction presents state-of-the-art concepts of advanced environment-independent multimodal human–machine interfaces that can be used in different contexts, ranging from simple multimodal web-browsers (for example, multimodal content reader) to more complex multimodal human–machine interfaces for ambient intelligent environments (such as supportive environments for elderly and agent-guided household environments). They can also be used in different computing environments—from pervasive computing to desktop environments. Within these concepts, the contributors discuss several communication strategies, used to provide different aspects of human–machine interaction.




Applied Informatics


Book Description

This book constitutes the thoroughly refereed papers of the 4th International Conference on Applied Informatics, ICAI 2021, held in Buenos Aires, Argentina, in October, 2021.The 35 full papers were carefully reviewed and selected from 89 submissions. The papers are organized in topical sections on artificial intelligence; data analysis; decision systems; health care information systems; image processing; security services; simulation and emulation; smart cities; software and systems modeling; software design engineering.




Elements of Meaning in Gesture


Book Description

Summarizing her pioneering work on the semiotic analysis of gestures in conversational settings, Geneviève Calbris offers a comprehensive account of her unique perspective on the relationship between gesture, speech, and thought. She highlights the various functions of gesture and especially shows how various gestural signs can be created in the same gesture by analogical links between physical and semantic elements. Originating in our world experience via mimetic and metonymic processes, these analogical links are activated by contexts of use and thus lead to a diverse range of semantic constructions rather as, from the components of a Meccano kit, many different objects can be assembled. By (re)presenting perceptual schemata that mediate between the concrete and the abstract, gesture may frequently anticipate verbal formulation. Arguing for gesture as a symbolic system in its own right that interfaces with thought and speech production, Calbris' book brings a challenging new perspective to gesture studies and will be seminal for generations of gesture researchers.




Homer and the Poetics of Gesture


Book Description

This book draws on studies of movement, gesture, and early film to offer a series of readings on repetition through the body in Homer. Each chapter presents an argument based on a specific posture, action or gesture (falling, running, leaping, standing, and crouching), through which to rethink epic practices of embodiment and formularity.




Milestones


Book Description




Integrating Gestures


Book Description

Gestures are now viewed as an integral part of spoken language. But little attention has been paid to the recipients’ cognitive processes of integrating both gesture and speech. How do people understand a speaker’s gestures when inserted into gaps in the flow of speech? What cognitive-semiotic mechanisms allow this integration to occur? And what linguistic and gestural properties do people draw on when construing multimodal meaning? This book offers answers by investigating multimodal utterances in which speech is replaced by gestures. Through fine-grained cognitive-linguistic and cognitive-semiotic analyses of multimodal utterances combined with naturalistic perception experiments, six chapters explore gestures’ potential to realize grammatical notions of nouns and verbs and to integrate with speech by merging into multimodal syntactic constructions. Analyses of speech-replacing gestures and a range of related phenomena compel us to consider gestures as well as spoken and signed language as manifestations of the same conceptual system. An overarching framework is proposed for studying these different modalities together – a multimodal cognitive grammar.