Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction


Book Description

This book is dedicated to the dreamers, their dreams, and their perseverance in research work. This volume brings together the selected and peer–reviewed contributions of the p- ticipants at the COST 2102 International Conference on Verbal and Nonverbal F- tures of Human–Human and Human–Machine Interaction, held in Patras, Greece, October 29–31, 2007, hosted by the 19th IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2008). The conference was sponsored by COST (European Cooperation in the Field of Scientific and Technical Research, www.cost.esf.org ) in the domain of Information and Communication Technologies (ICT) for disseminating the advances of the - search activity developed within COST Action 2102: “Cross-Modal Analysis of V- bal and Nonverbal Communication”(www.cost2102.eu). COST Action 2102 is a network of about 60 European and 6 overseas laboratories whose aim is to develop “an advanced acoustical, perceptual and psychological analysis of verbal and non-verbal communication signals originating in spontaneous face-to-face interaction, in order to identify algorithms and automatic procedures capable of identifying the human emotional states. Particular care is devoted to the recognition of emotional states, gestures, speech and facial expressions, in antici- tion of the implementation of intelligent avatars and interactive dialogue systems that could be exploited to improve user access to future telecommunication services”(see COST 2102 Memorandum of Understanding (MoU) www.cost2102.eu).




Coverbal Synchrony in Human-Machine Interaction


Book Description

Embodied conversational agents (ECA) and speech-based human-machine interfaces can together represent more advanced and more natural human-machine interaction. Fusion of both topics is a challenging agenda in research and production spheres. The important goal of human-machine interfaces is to provide content or functionality in the form of a dialo




Analysis of Verbal and Nonverbal Communication and Enactment.The Processing Issues


Book Description

This volume brings together the advanced research results obtained by the European COST Action 2102 "Cross Modal Analysis of Verbal and Nonverbal Communication", primarily discussed at the PINK SSPnet-COST2102 International Conference on Analysis of Verbal and Nonverbal Communication and Enactment: The Processing Issues, held in Budapest, Hungary, in September 2010. The 40 papers presented were carefully reviewed and selected for inclusion in the book. The volume is arranged into two scientific sections. The first section, Multimodal Signals: Analysis, Processing and Computational Issues, deals with conjectural and processing issues of defining models, algorithms, and heuristic strategies for data analysis, coordination of the data flow and optimal encoding of multi-channel verbal and nonverbal features. The second section, Verbal and Nonverbal Social Signals, presents original studies that provide theoretical and practical solutions to the modelling of timing synchronization between linguistic and paralinguistic expressions, actions, body movements, activities in human interaction and on their assistance for an effective human-machine interactions.




Quantifying and Processing Biomedical and Behavioral Signals


Book Description

The book is based on interdisciplinary research on various aspects and dynamics of human multimodal signal exchanges. It discusses realistic application scenarios where human interaction is the focus, in order to identify new methods for data processing and data flow coordination through synchronization, and optimization of new encoding features combining contextually enacted communicative signals, and develop shared digital data repositories and annotation standards for benchmarking the algorithmic feasibility and successive implementation of believable human–computer interaction (HCI) systems. This book is a valuable resource for a. the research community, PhD students, early stage researchers c. schools, hospitals, and rehabilitation and assisted-living centers e. the ICT market, and representatives from multimedia industries




The Handbook on Socially Interactive Agents


Book Description

The Handbook on Socially Interactive Agents provides a comprehensive overview of the research fields of Embodied Conversational Agents;Intelligent Virtual Agents;and Social Robotics. Socially Interactive Agents (SIAs);whether virtually or physically embodied;are autonomous agents that are able to perceive an environment including people or other agents;reason;decide how to interact;and express attitudes such as emotions;engagement;or empathy. They are capable of interacting with people and one another in a socially intelligent manner using multimodal communicative behaviors;with the goal to support humans in various domains. Written by international experts in their respective fields;the book summarizes research in the many important research communities pertinent for SIAs;while discussing current challenges and future directions. The handbook provides easy access to modeling and studying SIAs for researchers and students;and aims at further bridging the gap between the research communities involved. In two volumes;the book clearly structures the vast body of research. The first volume starts by introducing what is involved in SIAs research;in particular research methodologies and ethical implications of developing SIAs. It further examines research on appearance and behavior;focusing on multimodality. Finally;social cognition for SIAs is investigated using different theoretical models and phenomena such as theory of mind or pro-sociality. The second volume starts with perspectives on interaction;examined from different angles such as interaction in social space;group interaction;or long-term interaction. It also includes an extensive overview summarizing research and systems of human–agent platforms and of some of the major application areas of SIAs such as education;aging support;autism;and games.




Human-Computer Interaction


Book Description

The four-volume set LNCS 14011, 14012, 14013, and 14014 constitutes the refereed proceedings of the Human Computer Interaction thematic area of the 25th International Conference on Human-Computer Interaction, HCII 2023, which took place in Copenhagen, Denmark, in July 2023. A total of 1578 papers and 396 posters have been accepted for publication in the HCII 2023 proceedings from a total of 7472 submissions. The papers included in the HCI 2023 volume set were organized in topical sections as follows: Part I: Design and evaluation methods, techniques and tools; interaction methods and techniques; Part II: Children computer interaction; emotions in HCI; and understanding the user experience; Part III: Human robot interaction; chatbots and voice-based interaction; interacting in the metaverse; Part IV: Supporting health, quality of life and everyday activities; HCI for learning, culture, creativity and societal impact.




Recent Advances in Nonlinear Speech Processing


Book Description

This book presents recent advances in nonlinear speech processing beyond nonlinear techniques. It shows that it exploits heuristic and psychological models of human interaction in order to succeed in the implementations of socially believable VUIs and applications for human health and psychological support. The book takes into account the multifunctional role of speech and what is “outside of the box” (see Björn Schuller’s foreword). To this aim, the book is organized in 6 sections, each collecting a small number of short chapters reporting advances “inside” and “outside” themes related to nonlinear speech research. The themes emphasize theoretical and practical issues for modelling socially believable speech interfaces, ranging from efforts to capture the nature of sound changes in linguistic contexts and the timing nature of speech; labors to identify and detect speech features that help in the diagnosis of psychological and neuronal disease, attempts to improve the effectiveness and performance of Voice User Interfaces, new front-end algorithms for the coding/decoding of effective and computationally efficient acoustic and linguistic speech representations, as well as investigations capturing the social nature of speech in signaling personality traits, emotions and improving human machine interactions.




Body - Language - Communication. Volume 1


Book Description

Volume I of the handbook presents contemporary, multidisciplinary, historical, theoretical, and methodological aspects of how body movements relate to language. It documents how leading scholars from differenct disciplinary backgrounds conceptualize and analyze this complex relationship. Five chapters and a total of 72 articles, present current and past approaches, including multidisciplinary methods of analysis. The chapters cover: I. How the body relates to language and communication: Outlining the subject matter, II. Perspectives from different disciplines, III. Historical dimensions, IV. Contemporary approaches, V. Methods. Authors include: Michael Arbib, Janet Bavelas, Marino Bonaiuto, Paul Bouissac, Judee Burgoon, Martha Davis, Susan Duncan, Konrad Ehlich, Nick Enfield, Pierre Feyereisen, Raymond W. Gibbs, Susan Goldin-Meadow, Uri Hadar, Adam Kendon, Antja Kennedy, David McNeill, Lorenza Mondada, Fernando Poyatos, Klaus Scherer, Margret Selting, Jürgen Streeck, Sherman Wilcox, Jeffrey Wollock, Jordan Zlatev.




Gesture-Based Communication in Human-Computer Interaction


Book Description

Research on the multifaceted aspects of modeling, analysis, and synthesis of - man gesture is receiving growing interest from both the academic and industrial communities. On one hand, recent scienti?c developments on cognition, on - fect/emotion, on multimodal interfaces, and on multimedia have opened new perspectives on the integration of more sophisticated models of gesture in c- putersystems.Ontheotherhand,theconsolidationofnewtechnologiesenabling “disappearing” computers and (multimodal) interfaces to be integrated into the natural environments of users are making it realistic to consider tackling the complex meaning and subtleties of human gesture in multimedia systems, - abling a deeper, user-centered, enhanced physical participation and experience in the human-machine interaction process. The research programs supported by the European Commission and s- eral national institutions and governments individuated in recent years strategic ?elds strictly concerned with gesture research. For example, the DG Infor- tion Society of the European Commission (www.cordis.lu/ist) supports several initiatives, such as the “Disappearing Computer” and “Presence” EU-IST FET (Future and Emerging Technologies), the IST program “Interfaces & Enhanced Audio-Visual Services” (see for example the project MEGA, Multisensory - pressive Gesture Applications, www.megaproject.org), and the IST strategic - jective “Multimodal Interfaces.” Several EC projects and other funded research are represented in the chapters of this book. Awiderangeofapplicationscanbene?tfromadvancesinresearchongesture, from consolidated areas such as surveillance to new or emerging ?elds such as therapy and rehabilitation, home consumer goods, entertainment, and aud- visual, cultural and artistic applications, just to mention only a few of them.




Multimedia Interaction and Intelligent User Interfaces


Book Description

Consumer electronics (CE) devices, providing multimedia entertainment and enabling communication, have become ubiquitous in daily life. However, consumer interaction with such equipment currently requires the use of devices such as remote controls and keyboards, which are often inconvenient, ambiguous and non-interactive. An important challenge for the modern CE industry is the design of user interfaces for CE products that enable interactions which are natural, intuitive and fun. As many CE products are supplied with microphones and cameras, the exploitation of both audio and visual information for interactive multimedia is a growing field of research. Collecting together contributions from an international selection of experts, including leading researchers in industry, this unique text presents the latest advances in applications of multimedia interaction and user interfaces for consumer electronics. Covering issues of both multimedia content analysis and human-machine interaction, the book examines a wide range of techniques from computer vision, machine learning, audio and speech processing, communications, artificial intelligence and media technology. Topics and features: introduces novel computationally efficient algorithms to extract semantically meaningful audio-visual events; investigates modality allocation in intelligent multimodal presentation systems, taking into account the cognitive impacts of modality on human information processing; provides an overview on gesture control technologies for CE; presents systems for natural human-computer interaction, virtual content insertion, and human action retrieval; examines techniques for 3D face pose estimation, physical activity recognition, and video summary quality evaluation; discusses the features that characterize the new generation of CE and examines how web services can be integrated with CE products for improved user experience. This book is an essential resource for researchers and practitioners from both academia and industry working in areas of multimedia analysis, human-computer interaction and interactive user interfaces. Graduate students studying computer vision, pattern recognition and multimedia will also find this a useful reference.