Advances of Multisensory Integration in the Brain


Book Description

This book presents the latest research on multisensory brain function. Namely, the mechanisms by which the brain processes and integrates information from multiple sensory modalities. Its contents cover a broad range of topics, including optimal integration, cross-modal interactions, calibration, and causal inference – with an emphasis on their neuronal underpinnings. By bringing together efforts from different laboratories around the world we aim to collaboratively shed light on these fundamental brain processes, that underlie perception, cognition, and behavior in a complex multisensory world, and to spur innovation of brain-inspired technologies




The Neural Bases of Multisensory Processes


Book Description

It has become accepted in the neuroscience community that perception and performance are quintessentially multisensory by nature. Using the full palette of modern brain imaging and neuroscience methods, The Neural Bases of Multisensory Processes details current understanding in the neural bases for these phenomena as studied across species, stages of development, and clinical statuses. Organized thematically into nine sub-sections, the book is a collection of contributions by leading scientists in the field. Chapters build generally from basic to applied, allowing readers to ascertain how fundamental science informs the clinical and applied sciences. Topics discussed include: Anatomy, essential for understanding the neural substrates of multisensory processing Neurophysiological bases and how multisensory stimuli can dramatically change the encoding processes for sensory information Combinatorial principles and modeling, focusing on efforts to gain a better mechanistic handle on multisensory operations and their network dynamics Development and plasticity Clinical manifestations and how perception and action are affected by altered sensory experience Attention and spatial representations The last sections of the book focus on naturalistic multisensory processes in three separate contexts: motion signals, multisensory contributions to the perception and generation of communication signals, and how the perception of flavor is generated. The text provides a solid introduction for newcomers and a strong overview of the current state of the field for experts.




Multisensory Development


Book Description

We perceive and understand our environment using many sensory systems-vision, touch, hearing, taste, smell, and proprioception. These multiple sensory modalities give us complementary sources of information about the environment. This book explores how we develop the ability to integrate our senses.




The Auditory System and Human Sound-Localization Behavior


Book Description

The Auditory System and Human Sound-Localization Behavior provides a comprehensive account of the full action-perception cycle underlying spatial hearing. It highlights the interesting properties of the auditory system, such as its organization in azimuth and elevation coordinates. Readers will appreciate that sound localization is inherently a neuro-computational process (it needs to process on implicit and independent acoustic cues). The localization problem of which sound location gave rise to a particular sensory acoustic input cannot be uniquely solved, and therefore requires some clever strategies to cope with everyday situations. The reader is guided through the full interdisciplinary repertoire of the natural sciences: not only neurobiology, but also physics and mathematics, and current theories on sensorimotor integration (e.g. Bayesian approaches to deal with uncertain information) and neural encoding. - Quantitative, model-driven approaches to the full action-perception cycle of sound-localization behavior and eye-head gaze control - Comprehensive introduction to acoustics, systems analysis, computational models, and neurophysiology of the auditory system - Full account of gaze-control paradigms that probe the acoustic action-perception cycle, including multisensory integration, auditory plasticity, and hearing impaired




Multisensory Perception


Book Description

Multisensory Perception: From Laboratory to Clinic surveys the current state of knowledge on multisensory processes, synthesizing information from diverse streams of research and defining hypotheses and questions to direct future work. Reflecting the nature of the field, the book is interdisciplinary, comprising the findings and views of writers with diverse backgrounds and varied methods, including psychophysical, neuroanatomical, neurophysiological and neuroimaging approaches. Sections cover basic principles, specific interactions between the senses, the topic of crossmodal correspondences between particular sensory attributes, the related topic of synesthesia, and the clinic. - Offers a comprehensive, up-to-date overview of the current state of knowledge on multisensory processes - Coverage includes basic principles, specific interactions between the senses, crossmodal correspondences and the clinical aspects of multisensory processes - Includes psychophysical, neuroanatomical, neurophysiological and neuroimaging approaches




Multisensory Development


Book Description

We perceive and understand our environment using many sensory systems-vision, touch, hearing, taste, smell, and proprioception. These multiple sensory modalities not only give us complementary sources of information about the environment but also an understanding that is richer and more complex than one modality alone could achieve. As adults, we integrate the multiple signals from these sense organs into unified functional representations. However, the ease with which we accomplish this feat belies its computational complexity. Not only do the senses convey information about the environment in different neural codes, but the relationship between the senses frequently changes when, for example, the body changes posture (e.g. when the eyes move in their sockets), or indeed shape, when the body grows across development. These computational problems prompt an important question which represents the key focus of this book: How do we develop the ability to integrate the senses? While there is a considerable literature on the development of single senses, such as vision or hearing, few books have considered the development of all our senses, and more importantly, how they develop the ability to work with each other. This book is unique in exploring this extraordinary feat of human nature - how we develop the ability to integrate our senses. It will be an important book for all those in the fields of cognitive and developmental neuroscience.




Multisensory Processes


Book Description

Auditory behavior, perception, and cognition are all shaped by information from other sensory systems. This volume examines this multi-sensory view of auditory function at levels of analysis ranging from the single neuron to neuroimaging in human clinical populations. Visual Influence on Auditory Perception Adrian K.C. Lee and Mark T. Wallace Cue Combination within a Bayesian Framework David Alais and David Burr Toward a Model of Auditory-Visual Speech Intelligibility Ken W. Grant and Joshua G. W. Bernstein An Object-based Interpretation of Audiovisual Processing Adrian K.C. Lee, Ross K. Maddox, and Jennifer K. Bizley Hearing in a "Moving" Visual World: Coordinate Transformations Along the Auditory Pathway Shawn M. Willett, Jennifer M. Groh, Ross K. Maddox Multisensory Processing in the Auditory Cortex Andrew J. King, Amy Hammond-Kenny, Fernando R. Nodal Audiovisual Integration in the Primate Prefrontal Cortex Bethany Plakke and Lizabeth M. Romanski Using Multisensory Integration to Understand Human Auditory Cortex Michael S. Beauchamp Combining Voice and Face Content in the Primate Temporal Lobe Catherine Perrodin and Christopher I. Petkov Neural Network Dynamics and Audiovisual Integration Julian Keil and Daniel Senkowski Cross-Modal Learning in the Auditory System Patrick Bruns and Brigitte Röder Multisensory Processing Differences in Individuals with Autism Spectrum Disorder Sarah H. Baum Miller, Mark T. Wallace Adrian K.C. Lee is Associate Professor in the Department of Speech & Hearing Sciences and the Institute for Learning and Brain Sciences at the University of Washington, Seattle Mark T. Wallace is the Louise B McGavock Endowed Chair and Professor in the Departments of Hearing and Speech Sciences, Psychiatry, Psychology and Director of the Vanderbilt Brain Institute at Vanderbilt University, Nashville Allison B. Coffin is Associate Professor in the Department of Integrative Physiology and Neuroscience at Washington State University, Vancouver, WA Arthur N. Popper is Professor Emeritus and research professor in the Department of Biology at the University of Maryland, College Park Richard R. Fay is Distinguished Research Professor of Psychology at Loyola University, Chicago.




Updates on multisensory perception: from neurons to cognition


Book Description

In recent years there has been a dramatic progress in understanding how stimuli from different sensory modalities are integrated among each other. Multisensory integration results in a unitary representation of the world that strongly characterizes perception and cognition in humans. Knowledge about multi sensory integration has research techniques and approaches, including neurophysiology, experimental psychology, neuropsychology, neuroimaging, and computational modelling. This special issue aims at presenting an up-to-date integrative overview of the physiological, psychological, developmental, and functional processes associated with multisensory integration. The proposed collection of papers is organized thematically into sections, each featuring a state-of-the-art review of key themes in multisensory research, from more approaches in the animal, to the study of multisensory perception and cognition in humans. Specifically, this special issue will consider: The physiological mechanisms of multisensory processing in cortical and subcortical brain structures of model animal species, (rat, cat, and monkey); current biologically inspired computational modelling of multisensory integration; evidence about the multisensory contributions to perception in humans, as highlighted by psychophysical and neuropsychological evidence; the neural basis of multisensory processing in the human brain uncovered by recent neuroimaging techniques, including EEG, PET, fMRI; the consequences of the breakdown of normal sensory integration as shown by studies with techniques of brain stimulation in humans; developmental processes of multisensory perception in humans and the constrains for the emergence of multisensory processes in relation to sensory experience; the issue of crossmodal neuroplasticity concerning behavioral and neural changes following sensory deprivation. The challenge of this Research Topic is to provide an interdisciplinary context allowing to understand the basic principles of multisensory integration in humans and the key issues that this fascinating field of study rises for future research.




Enhancing Performance for Action and Perception


Book Description

This volume of Progess in Brain Research follows on from the 32nd International Symposium of the Groupe de recherche sur le système nerveux central (GRSNC), May 2010, and aims to provide an overview of the various neural mechanisms that contribute to learning new motor and sensory skills, and to adapting to changed circumstances, including the use of devices and implants to substitute for lost sensory or motor abilities (brain machine interfaces). The focus is on recent developments covering five major themes: - Mechanisms to improve motor performance - Neuro-rehabilitation of motor function - Mechanisms to enhance sensory perception - Cross modal interationc for enhancing sensorimotor performance - Assistive technologies to enhance sensorimotor performance - Leading authors review the state-of-the-art in their field of investigation and provide their views and perspectives for future research - Chapters are extensively referenced to provide readers with a comprehensive list of resources on the topics covered - All chapters include comprehensive background information and are written in a clear form that is also accessible to the non-specialist




The Handbook of Multisensory Processes


Book Description

Research is suggesting that rather than our senses being independent, perception is fundamentally a multisensory experience. This handbook reviews the evidence and explores the theory of broad underlying principles that govern sensory interactions, regardless of the specific senses involved.