Multisensory Perception and Communication


Book Description

Infants learn to communicate through everyday social interaction with their caregivers in a multisensory world involving sight, hearing, touch and smell. The neural and behavioural underpinnings of caregiver-infant multisensory interaction and communication, however, have remained largely unexplored in research across disciplines. This book highlights this largely uncharted territory to better understand the developmental origins of human multisensory perception and communication. It emphasizes the range and complexity of multisensory infant-caregiver interaction in the real world, and its developmental and neurophysiological characteristics. Furthermore, recent theories of brain development suggest that brain, body and the environment interact with one another on an ongoing basis, influencing each other and are constantly being influenced by each other. This volume aims to elucidate the neurophysiological, behavioural and environmental factors to better understand the nature of multisensory communication as a whole. This book was originally published as a special issue of Developmental Neuropsychology.




The Neural Bases of Multisensory Processes


Book Description

It has become accepted in the neuroscience community that perception and performance are quintessentially multisensory by nature. Using the full palette of modern brain imaging and neuroscience methods, The Neural Bases of Multisensory Processes details current understanding in the neural bases for these phenomena as studied across species, stages of development, and clinical statuses. Organized thematically into nine sub-sections, the book is a collection of contributions by leading scientists in the field. Chapters build generally from basic to applied, allowing readers to ascertain how fundamental science informs the clinical and applied sciences. Topics discussed include: Anatomy, essential for understanding the neural substrates of multisensory processing Neurophysiological bases and how multisensory stimuli can dramatically change the encoding processes for sensory information Combinatorial principles and modeling, focusing on efforts to gain a better mechanistic handle on multisensory operations and their network dynamics Development and plasticity Clinical manifestations and how perception and action are affected by altered sensory experience Attention and spatial representations The last sections of the book focus on naturalistic multisensory processes in three separate contexts: motion signals, multisensory contributions to the perception and generation of communication signals, and how the perception of flavor is generated. The text provides a solid introduction for newcomers and a strong overview of the current state of the field for experts.




Philosophy for Multisensory Communication and Media


Book Description

Scholars interested in communication theory, media theory, and multimodality will discover new ideas within this text by current philosophers, while scholars of sensory studies will learn how their field can be extended to communication and media.




Multisensory Development


Book Description

We perceive and understand our environment using many sensory systems-vision, touch, hearing, taste, smell, and proprioception. These multiple sensory modalities give us complementary sources of information about the environment. This book explores how we develop the ability to integrate our senses.




Perception


Book Description

The way that we interact with the environment on a daily basis is inherently multisensory. Even a simple task such as judging the location of a light in a dark room depends not only on vision but also on proprioceptive cues about the position of our body in space. The way that we experience food can be influenced not just by taste and smell, but by visual and auditory cues. Perception: A multisensory perspective adopts a multisensory approach to understanding perception. Rather than discussing each sense separately, this book defines perception as intrinsically multisensory from the start and examines multisensory interactions as the key process behind how we perceive our own body, control its movements, and perceive and recognise objects, space, and time. But the book delves even deeper. It discusses multisensory processing in conditions such as synaesthesia. It addresses attention and the role of multisensory processing in learning. By focussing on these domains, the authors highlight and identify general principles in the field of perception study and introduce models, experimental methods and pathologies that will be of interest to all those studying within the field of perception. The authors also illustrate applications that will be of interest to professionals whose work takes multisensory processing into account. As an introduction to the topic of multisensory perception, Perception: A multisensory perspective will be essential reading for students, from advanced undergraduate level through to postgraduate level in psychology, philosophy, and neuroscience. Those studying physiotherapy and neurological rehabilitation, human-computer interface development, or the design of products or services will also find this book of interest.




The Handbook of Multisensory Processes


Book Description

Research is suggesting that rather than our senses being independent, perception is fundamentally a multisensory experience. This handbook reviews the evidence and explores the theory of broad underlying principles that govern sensory interactions, regardless of the specific senses involved.




Philosophy for Multisensory Communication and Media


Book Description

Scholars interested in communication theory, media theory, and multimodality will discover new ideas within this text by current philosophers, while scholars of sensory studies will learn how their field can be extended to communication and media.










Multisensory Processes


Book Description

Auditory behavior, perception, and cognition are all shaped by information from other sensory systems. This volume examines this multi-sensory view of auditory function at levels of analysis ranging from the single neuron to neuroimaging in human clinical populations. Visual Influence on Auditory Perception Adrian K.C. Lee and Mark T. Wallace Cue Combination within a Bayesian Framework David Alais and David Burr Toward a Model of Auditory-Visual Speech Intelligibility Ken W. Grant and Joshua G. W. Bernstein An Object-based Interpretation of Audiovisual Processing Adrian K.C. Lee, Ross K. Maddox, and Jennifer K. Bizley Hearing in a "Moving" Visual World: Coordinate Transformations Along the Auditory Pathway Shawn M. Willett, Jennifer M. Groh, Ross K. Maddox Multisensory Processing in the Auditory Cortex Andrew J. King, Amy Hammond-Kenny, Fernando R. Nodal Audiovisual Integration in the Primate Prefrontal Cortex Bethany Plakke and Lizabeth M. Romanski Using Multisensory Integration to Understand Human Auditory Cortex Michael S. Beauchamp Combining Voice and Face Content in the Primate Temporal Lobe Catherine Perrodin and Christopher I. Petkov Neural Network Dynamics and Audiovisual Integration Julian Keil and Daniel Senkowski Cross-Modal Learning in the Auditory System Patrick Bruns and Brigitte Röder Multisensory Processing Differences in Individuals with Autism Spectrum Disorder Sarah H. Baum Miller, Mark T. Wallace Adrian K.C. Lee is Associate Professor in the Department of Speech & Hearing Sciences and the Institute for Learning and Brain Sciences at the University of Washington, Seattle Mark T. Wallace is the Louise B McGavock Endowed Chair and Professor in the Departments of Hearing and Speech Sciences, Psychiatry, Psychology and Director of the Vanderbilt Brain Institute at Vanderbilt University, Nashville Allison B. Coffin is Associate Professor in the Department of Integrative Physiology and Neuroscience at Washington State University, Vancouver, WA Arthur N. Popper is Professor Emeritus and research professor in the Department of Biology at the University of Maryland, College Park Richard R. Fay is Distinguished Research Professor of Psychology at Loyola University, Chicago.