Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction


Book Description

This book constitutes the thoroughly refereed post-workshop proceedings of the Second Workshop on Multimodal Analyses Enabling Artificial Agents in Human Interaction, MA3HMI 2014, held in Conjunction with INTERSPEECH 2014, in Singapore, Singapore, on September 14th, 2014. The 9 revised papers presented together with a keynote talk were carefully reviewed and selected from numerous submissions. They are organized in two sections: human-machine interaction and dialogs and speech recognition.




Conceptual Motorics - Generation and Evaluation of Communicative Robot Gesture


Book Description

How do humans perceive communicative gesture behavior in robots? Although gesture is a crucial feature of social interaction, this research question is still largely unexplored in the field of social robotics. The present work thus sets out to investigate how robot gesture can be used to design and realize more natural and human-like communication capabilities for social robots. The adopted approach is twofold. Firstly, the technical challenges encountered when implementing a speech-gesture generation model on a robotic platform are addressed. The realized framework enables a humanoid robot to produce finely synchronized speech and co-verbal hand and arm gestures. In contrast to many existing systems, these gestures are not limited to a predefined repertoire of motor actions but are flexibly generated at run-time. Secondly, the achieved expressiveness is exploited in controlled experiments to gain a deeper understanding of how robot gesture might impact human experience and evaluation of human-robot interaction. The findings reveal that participants evaluate the robot more positively when non-verbal behaviors such as hand and arm gestures are displayed along with speech. Surprisingly, this effect was particularly pronounced when the robot's gesturing behavior was partly incongruent with speech. These findings contribute new insights into human perception of communicative robot gesture and ultimately support the presented approach of endowing social robots with such non-verbal behaviors.




Computational Human-Robot Interaction


Book Description

Computational Human-Robot Interaction provides the reader with a systematic overview of the field of Human-Robot Interaction over the past decade, with a focus on the computational frameworks, algorithms, techniques, and models currently used to enable robots to interact with humans.




Gesture and Sign Language in Human-Computer Interaction and Embodied Communication


Book Description

This book constitutes revised selected papers from the 9th International Gesture Workshop, GW 2011, held in Athens, Greece, in May 2011. The 24 papers presented were carefully reviewed and selected from 35 submissions. They are ordered in five sections named: human computer interaction; cognitive processes; notation systems and animation; gestures and signs: linguistic analysis and tools; and gestures and speech.




HCI International 2022 - Late Breaking Papers. Multimodality in Advanced Interaction Environments


Book Description

Volume LNCS 13519 is part of the refereed proceedings of the 24th International Conference on Human-Computer Interaction, HCII 2022, which was held virtually during June 26 to July 1, 2022. A total of 5583 individuals from academia, research institutes, industry, and governmental agencies from 88 countries submitted contributions, and 1276 papers and 275 posters were included in the proceedings that were published just before the start of the conference. Additionally, 296 papers and 181 posters are included in the volumes of the proceedings published after the conference, as “Late Breaking Work” (papers and posters). The contributions thoroughly cover the entire field of human-computer interaction, addressing major advances in knowledge and effective use of computers in a variety of application areas.




Multimodal Behavior Analysis in the Wild


Book Description

Multimodal Behavioral Analysis in the Wild: Advances and Challenges presents the state-of- the-art in behavioral signal processing using different data modalities, with a special focus on identifying the strengths and limitations of current technologies. The book focuses on audio and video modalities, while also emphasizing emerging modalities, such as accelerometer or proximity data. It covers tasks at different levels of complexity, from low level (speaker detection, sensorimotor links, source separation), through middle level (conversational group detection, addresser and addressee identification), and high level (personality and emotion recognition), providing insights on how to exploit inter-level and intra-level links. This is a valuable resource on the state-of-the- art and future research challenges of multi-modal behavioral analysis in the wild. It is suitable for researchers and graduate students in the fields of computer vision, audio processing, pattern recognition, machine learning and social signal processing. - Gives a comprehensive collection of information on the state-of-the-art, limitations, and challenges associated with extracting behavioral cues from real-world scenarios - Presents numerous applications on how different behavioral cues have been successfully extracted from different data sources - Provides a wide variety of methodologies used to extract behavioral cues from multi-modal data




Proactive Human-Robot Collaboration Toward Human-Centric Smart Manufacturing


Book Description

Proactive Human–Robot Collaboration Toward Human-Centric Smart Manufacturing is driven by an appreciation of manufacturing scenarios where human and robotic agents can understand each other's actions and conduct mutual-cognitive, predictable, and self-organizing teamwork. Modern factories' smart manufacturing transformation and the evolution of relationships between humans and robots in manufacturing tasks set the scene for a discussion on the technical fundamentals of state-of-the-art proactive human–robot collaboration; these are further elaborated into the three main steps (i.e., mutual-cognitive and empathic coworking; predictable spatio-temporal collaboration; self-organizing multiagent teamwork) to achieve an advanced form of symbiotic HRC with high-level, dynamic-reasoning teamwork skills. The authors then present a deployment roadmap and several case studies, providing step-by-step guidance for real-world application of these ground-breaking methods which crucially contribute to the maturing of human-centric, sustainable, and resilient production systems. The volume proves to be an invaluable resource that supports understanding and learning for users ranging from upper undergraduate/graduate students and academic researchers to engineering professionals in a variety of industry contexts. - Offers pioneering information on an industry 5.0 topic that has attracted much research interest in recent years - Takes advantage of a structured and comprehensive approach to seamlessly combine theory, latest technological developments, and their practical applications - Includes actionable methods, while conceptualizing future implications for smart manufacturing




The Wiley Handbook of Human Computer Interaction Set


Book Description

In der Vergangenheit war die Mensch-Computer-Interaktion (Human-Computer Interaction) das Privileg einiger weniger. Heute ist Computertechnologie weit verbreitet, allgegenwärtig und global. Arbeiten und Lernen erfolgen über den Computer. Private und kommerzielle Systeme arbeiten computergestützt. Das Gesundheitswesen wird neu erfunden. Navigation erfolgt interaktiv. Unterhaltung kommt aus dem Computer. Als Antwort auf immer leistungsfähigere Systeme sind im Bereich der Mensch-Computer-Interaktion immer ausgeklügeltere Theorien und Methodiken entstanden. The Wiley Handbook of Human-Computer Interaction bietet einen Überblick über all diese Entwicklungen und untersucht die vielen verschiedenen Aspekte der Mensch-Computer-Interaktion und hat den Wert menschlicher Erfahrungen, die über Technologie stehen, ganzheitlich im Blick.




Human-Computer Interaction. Multimodal and Natural Interaction


Book Description

The three-volume set LNCS 12181, 12182, and 12183 constitutes the refereed proceedings of the Human Computer Interaction thematic area of the 22nd International Conference on Human-Computer Interaction, HCII 2020, which took place in Copenhagen, Denmark, in July 2020.* A total of 1439 papers and 238 posters have been accepted for publication in the HCII 2020 proceedings from a total of 6326 submissions. The 145 papers included in these HCI 2020 proceedings were organized in topical sections as follows: Part I: design theory, methods and practice in HCI; understanding users; usability, user experience and quality; and images, visualization and aesthetics in HCI. Part II: gesture-based interaction; speech, voice, conversation and emotions; multimodal interaction; and human robot interaction. Part III: HCI for well-being and Eudaimonia; learning, culture and creativity; human values, ethics, transparency and trust; and HCI in complex environments. *The conference was held virtually due to the COVID-19 pandemic.




Human-robot Interaction


Book Description

This special issue is made up of five articles which cover the emerging area of human-robot interaction. The first paper offers a theoretical ecological framework for the design of personal service robots in homes of elderly people. Next, a field study of two robots that visited a children's elementary school in Japan for two weeks, with the purpos