Predictive Models of Auditory Perception in Human Electrophysiology


Book Description

It has long been thought that sensory systems operate by representing information in a hierarchy of sensory features, and that these features build upon one another. From low-level information such as spectral content, to high-level information such as word content, the sensory system must rapidly extract all of these features from the world. However, the precise nature of these levels of representation, as well as how they interact with one another, is not well-understood. In audition, intermediate sensory representations are often studied in animals, using techniques that treat neurons as a linear filter for incoming sensory inputs. If those inputs are spectro-temporal features (e.g., a spectrogram), then the result is a Spectro Temporal Receptive Field (STRF). This describes how the neural unit in question (e.g., a neuron) will respond to patterns in spectro-temporal space. It has been a crucial tool in understanding sensory processing in low-level neural activity. Using this approach it is also possible to study how this neural representation changes under different experimental conditions. STRF plasticity has been shown in both reward- and context-modulated experiments in animals. In recent years, it has been suggested that similar techniques may work in modeling the activity of neural signals recorded from humans. As we cannot generally record from single unit activity in humans, this approach relies on proxies for neural activity - specifically in the high-frequency activity (HFA) of electrocorticography electrodes. This poses a unique opportunity for two reasons: First, human language is a natural stimulus set for studying hierarchical feature representations in the brain. There are many ways to decompose speech into both auditory and linguistic components, and each of these could serve as inputs to the modeling technique described above. Second, humans are especially skilled at using high-level context such as their experience and assumptions about the world in order to change their behavior. This poses a unique opportunity to study the plasticity of speech representations in the brain. This thesis reports several new approaches towards studying the sensory representation of speech in the human brain, as well as how these representations may change due to experience. It aims to bridge the literature in rodents and songbirds with ideas in human electrophysiology in order to pursue new approaches to studying perception in humans.




Electrophysiology of Inhibition and Auditory Prediction Mechanisms in Human Cortex


Book Description

One of the core problems the brain has to solve is how to navigate and interact with the external world. This requires a complex analysis of sensory input, the translation of perceptual input to goal-directed behavior, followed by motor planning and execution. In this thesis we investigated two crucial aspects of this perception-action cycle. First, we examined the underlying neural mechanisms that support response inhibition. Here, novel sensory information is integrated on very short time-scales to cancel an already planned action. The frontal cortex is believed to play a crucial role in the temporal organization of goal-directed behavior and cognitive control and is implicated in stopping a motor response. Using the high spatiotemporal resolution of electrocorticography (ECoG), we found evidence for two distinct processes localized to the middle frontal gyrus (MFG). High-frequency band (HFB) power increased in stop-trials before the stop-signal reaction time (SSRT), showing no difference between successful and unsuccessful stops. We interpret this activation as contributing to the stopping process, either by signaling the stop-signal itself, or by implementing attentional control. A second HFB activation was observed after the go and stop processes have finished, and was larger for unsuccessful stops, and is likely related to behavioral monitoring. Our results support the notion that frontal cortex implements different functions related to stopping. Implementing the perception-action cycle not only involves re-acting to novel information from the senses in a bottom-up manner. It is believed that the brain also implements a strategy anticipating future events based on prior knowledge. Here we investigated how anticipation of sounds influences auditory processing. Using both EEG and ECoG, we employed a task with omissions of expected sounds, thereby isolating endogenous responses to expectations in auditory cortex. We found that a subset of auditory active electrodes in lateral superior temporal gyrus (STG) and superior temporal sulcus (STS) showing HFB power increases to omissions. We were able to successfully decode whether the subject heard the syllable ‘Ba’ or ‘Ga’. However, which sound was omitted could not be decoded from auditory active sites, nor from the omission HFB increase specifically. We also observed a negative ERP in posterior STG in the intracranial data, which may be related to an auditory cortical generator of the N2 component. In a separate EEG studies we also observed both an N2 negativity, as well as a negativity occurring before the intracranial negativity, the source of which may be in A1, a region which we could not access intracranially. Finally, a P3a ERP was observed in EEG, which points to both the HFB and ERP effects in posterior STG to be signatures of auditory-specific salience or mismatch detection.







Carry-over or prediction? Investigating the predictive coding model using an auditory listening task


Book Description

Bachelor Thesis from the year 2018 in the subject Psychology - Cognition, grade: 1,0, University of Salzburg, language: English, abstract: Researches have come up with the framework, that for the fluency of our perception we fundamentally rely on top-down predictions, which occur prior to the appearance of actual external stimuli. These predictions lead to very specific modulations of our perceptual units to facilitate perception. The theory behind this framework is the predictive coding theory, which has gathered increasing interest in research. The predictive coding theory could provide a better understanding of how we cope with perceiving our complex environment. For this study focus lies on the auditory domain. A recent study, conducted by Demarchi et al. (2018), could find evidence supporting the predictive coding framework. By analyzing MEG data they could even show, that predictions are so sharply tuned, that they contain specific tonotopic information about an upcoming tone. Due to the fact, that they trained a classifier on pre-stimulus data to decode post-stimulus data, their results are confounded with a carry-over effect (activity still present from previous stimuli). The purpose of this study is supporting this study and rule the carry-over effect out as the only explanation for their findings. We therefore conducted a follow-up experiment and changed the paradigm, as we included conditions with fixed and random stimulus omissions. Since no prediction activity should be found when the omission is fixed, a higher mean decoding accuracy in the random omission condition would directly indicate towards a tone-specific prediction. In our MEG-experiment we can provide further evidence for the findings of Demarchi et al. (2018), by finding this very result.




Cognitive Electrophysiology


Book Description

MICHAEL S. GAZZANIGA The investigation of the human brain and mind involves a myriad of ap proaches. Cognitive neuroscience has grown out of the appreciation that these approaches have common goals that are separate from other goals in the neural sciences. By identifying cognition as the construct of interest, cognitive neuro science limits the scope of investigation to higher mental functions, while simultaneously tackling the greatest complexity of creation, the human mind. The chapters of this collection have their common thread in cognitive neuroscience. They attack the major cognitive processes using functional stud ies in humans. Indeed, functional measures of human sensation, perception, and cognition are the keystone of much of the neuroscience of cognitive sci ence, and event-related potentials (ERPs) represent a methodological "coming of age" in the study of the intricate temporal characteristics of cognition. Moreover, as the field of cognitive ERPs has matured, the very nature of physiology has undergone a significant revolution. It is no longer sufficient to describe the physiology of non-human primates; one must consider also the detailed knowledge of human brain function and cognition that is now available from functional studies in humans-including the electrophysiological studies in humans described here. Together with functional imaging of the human brain via positron emission tomography (PET) and functional magnetic resonance imaging (fMRI), ERPs fill our quiver with the arrows required to pierce more than the single neuron, but the networks of cognition.




Auditory Monitoring


Book Description




The Electrophysiology and Layout of the Auditory Nervous System


Book Description

This volume contains a brief account of the principles underlying the organization and functions of the auditory nervous system, and is a continuation of a previous study, The Anatomy and Physiology of the Peripheral Hearing Mechanism, which takes the reader up to, but does not include, the first-order neuron. These volumes, with the addition of a third, Psychoacoustics, are designed as texts for a one-semester course on the ear and hearing. A recommended preliminary for the student using these texts is a semester of experimental or, preferably, physiological psychology, or a minimum of one semester of introductory speech pathology/audiology, including the elementary principles of neurophysiology. The student may find a few titles helpful in this respect listed in the Suggested Readings at the back of this volume.




Auditory Cognition and Human Performance


Book Description

Hearing and understanding sound- auditory processing- greatly enriches everyday life and enhances our ability to perform many tasks essential to survival. The complex soundscape in which we live influences where we direct our attention, how we communicate with each other, and how we interact with technological systems. Auditory Cognition and Human




Brain Responses to Auditory Mismatch and Novelty Detection


Book Description

Brain Responses to Auditory Mismatch and Novelty Detection: Predictive Coding from Cocktail Parties to Auditory-Related Disorders provides the connections between changes in the 'error-generating network' and disorder-specific changes while also exploring its diagnostic properties. The book allows the reader to appreciate the outcomes of predictive coding theory in fields of auditory streaming (including the cocktail-party effect) and psychiatric disorders with an auditory component. These include mild cognitive impairment (MCI), Alzheimer's disease, attention-deficit and hyperactivity disorder (ADHD), autism spectrum disorder (ASD), schizophrenia and the cognitive aspects of Parkinson's disease. The book combines animal experiments on adaptation, human auditory evoked potentials, including MMN and their maturational, as well as aging aspects into one comprehensive resource. - Compares and contrasts animal vs human data - Provides detailed maturational and aging aspects - Details the differences between auditory, visual and somatosensory MMN networks - Reviews predictive coding in various psychiatric disorders




Involuntary Spatial Attention Influences Auditory Processing


Book Description

The appearance of spatially non-predictive auditory cues can attract attention resulting in facilitation or inhibition of responses to subsequent targets at short or long cue-target intervals, respectively. With most research focusing on visual and crossmodal spatial attention, little is known about the neural mechanisms associated with auditory cue effects. The present study used ERPs to investigate the consequences of involuntary auditory spatial attention on the neural processing of sounds in spatial and non-spatial go/no-go tasks. The negative-difference component -- which is known to reflect attentional enhancement of target processing -- was observed in both experiments, indicating that salient, spatially non-predictive auditory cues captured attention. A subsequent positive difference was observed only in the spatial task, suggesting this component corresponds with the presence or absence of RT cue effects in auditory spatial cueing tasks. In both tasks, auditory sounds activated occipital regions, suggesting that visual regions are involved in processing auditory stimuli.