Sonic Interaction Design


Book Description

An overview of emerging topics, theories, methods, and practices in sonic interactive design, with a focus on the multisensory aspects of sonic experience. Sound is an integral part of every user experience but a neglected medium in design disciplines. Design of an artifact's sonic qualities is often limited to the shaping of functional, representational, and signaling roles of sound. The interdisciplinary field of sonic interaction design (SID) challenges these prevalent approaches by considering sound as an active medium that can enable novel sensory and social experiences through interactive technologies. This book offers an overview of the emerging SID research, discussing theories, methods, and practices, with a focus on the multisensory aspects of sonic experience. Sonic Interaction Design gathers contributions from scholars, artists, and designers working at the intersections of fields ranging from electronic music to cognitive science. They offer both theoretical considerations of key themes and case studies of products and systems created for such contexts as mobile music, sensorimotor learning, rehabilitation, and gaming. The goal is not only to extend the existing research and pedagogical approaches to SID but also to foster domains of practice for sound designers, architects, interaction designers, media artists, product designers, and urban planners. Taken together, the chapters provide a foundation for a still-emerging field, affording a new generation of designers a fresh perspective on interactive sound as a situated and multisensory experience. Contributors Federico Avanzini, Gerold Baier, Stephen Barrass, Olivier Bau, Karin Bijsterveld, Roberto Bresin, Stephen Brewster, Jeremy Coopersotck, Amalia De Gotzen, Stefano Delle Monache, Cumhur Erkut, George Essl, Karmen Franinović, Bruno L. Giordano, Antti Jylhä, Thomas Hermann, Daniel Hug, Johan Kildal, Stefan Krebs, Anatole Lecuyer, Wendy Mackay, David Merrill, Roderick Murray-Smith, Sile O'Modhrain, Pietro Polotti, Hayes Raffle, Michal Rinott, Davide Rocchesso, Antonio Rodà, Christopher Salter, Zack Settel, Stefania Serafin, Simone Spagnol, Jean Sreng, Patrick Susini, Atau Tanaka, Yon Visell, Mike Wezniewski, John Williamson




Explorations in Sonic Interaction Design


Book Description

Nowadays, human-object and human-human interactions are often facilitated by computational means. Interaction designers aim at designing such interactions to make them more effective and pleasant. Sonic Interaction Design emphasizes the role of sound as a mediator of meaningful interactions. A COST Action on Sonic Interaction Design was run between 2007 and 2011, to pro-actively contribute to the creation and consolidation of new design theories, tools, and practices in this innovative and interdisciplinary domain. The Action stood on four legs: cognitive science, design, interactive art, and information display. This book reports on many research activities that have been conducted over a four-year period, organized as workshops, training schools, short-term scientific missions, and an exhibition.Davide Rocchesso is associate professor at the IUAV University of Venice, Italy.




Haptic and Audio Interaction Design


Book Description

In parallel to the printed book, each new volume is published electronically in LNCS Online.




Sonic Interactions in Virtual Environments


Book Description

This open access book tackles the design of 3D spatial interactions in an audio-centered and audio-first perspective, providing the fundamental notions related to the creation and evaluation of immersive sonic experiences. The key elements that enhance the sensation of place in a virtual environment (VE) are: Immersive audio: the computational aspects of the acoustical-space properties of Virutal Reality (VR) technologies Sonic interaction: the human-computer interplay through auditory feedback in VE VR systems: naturally support multimodal integration, impacting different application domains Sonic Interactions in Virtual Environments will feature state-of-the-art research on real-time auralization, sonic interaction design in VR, quality of the experience in multimodal scenarios, and applications. Contributors and editors include interdisciplinary experts from the fields of computer science, engineering, acoustics, psychology, design, humanities, and beyond. Their mission is to shape an emerging new field of study at the intersection of sonic interaction design and immersive media, embracing an archipelago of existing research spread in different audio communities and to increase among the VR communities, researchers, and practitioners, the awareness of the importance of sonic elements when designing immersive environments.




Body, Sound and Space in Music and Beyond: Multimodal Explorations


Book Description

Body and space refer to vital and interrelated dimensions in the experience of sounds and music. Sounds have an overwhelming impact on feelings of bodily presence and inform us about the space we experience. Even in situations where visual information is artificial or blurred, such as in virtual environments or certain genres of film and computer games, sounds may shape our perceptions and lead to surprising new experiences. This book discusses recent developments in a range of interdisciplinary fields, taking into account the rapidly changing ways of experiencing sounds and music, the consequences for how we engage with sonic events in daily life and the technological advancements that offer insights into state-of-the-art methods and future perspectives. Topics range from the pleasures of being locked into the beat of the music, perception–action coupling and bodily resonance, and affordances of musical instruments, to neural processing and cross-modal experiences of space and pitch. Applications of these findings are discussed for movement sonification, room acoustics, networked performance, and for the spatial coordination of movements in dance, computer gaming and interactive artistic installations.




The Sonification Handbook


Book Description

This book is a comprehensive introductory presentation of the key research areas in the interdisciplinary fields of sonification and auditory display. Chapters are written by leading experts, providing a wide-ranging coverage of the central issues, and can be read from start to finish, or dipped into as required. Sonification conveys information by using non-speech sounds. To listen to data as sound and noise can be a surprising new experience with diverse applications ranging from novel interfaces for visually impaired people to data analysis problems in many scientific fields. This book gives a solid introduction to the field of auditory display, the techniques for sonification, suitable technologies for developing sonification algorithms, and the most promising application areas. The book is accompanied by an online repository of sound examples.




Foundations in Sound Design for Embedded Media


Book Description

This volume provides a comprehensive introduction to foundational topics in sound design for embedded media, such as physical computing; interaction design; auditory displays and data sonification; speech synthesis; wearables; smart objects and instruments; user experience; toys and playful tangible objects; and the new sensibilities entailed in expanding the concept of sound design to encompass the totality of our surroundings. The reader will gain a broad understanding of the key concepts and practices that define sound design for its use in computational products and design. The chapters are written by international authors from diverse backgrounds who provide multidisciplinary perspectives on sound in its many embedded forms. The volume is designed as a textbook for students and teachers, as a handbook for researchers in sound, programming and design, and as a survey of key trends and ideas for practitioners interested in exploring the boundaries of their profession.




Perception, Representations, Image, Sound, Music


Book Description

This book constitutes the refereed proceedings of the 14th International Symposium on Perception, Representations, Image, Sound, Music, CMMR 2019, held in Marseille, France, in October 2019. The 46 full papers presented were selected from 105 submissions. The papers are grouped in 9 sections. The first three sections are related to music information retrieval, computational musicology and composition tools, followed by a section on notations and instruments distributed on mobile devices. The fifth section concerns auditory perception and cognition, while the three following sections are related to sound design and sonic and musical interactions. The last section contains contributions that relate to Jean-Claude Risset's research.




The Oxford Handbook of Interactive Audio


Book Description

What does it mean to interact with sound? How does interactivity alter our experience as creators and listeners? What does the future hold for interactive musical and sonic experiences? This book answers these questions with newly-commissioned chapters that explore the full range of interactive audio in games, performance, design, and practice.




Sonic Experience


Book Description

Never before has the everyday soundtrack of urban space been so cacophonous. Since the 1970s, sound researchers have attempted to classify noise, music, and everyday sounds using concepts such as Pierre Shafer's sound object and R. Murray Schafer's soundscape. Recently, the most significant team of soundscape researchers in the world has been concerned with the effects of sounds on listeners.