Canonical Correlation Analysis in Speech Enhancement


Book Description

This book focuses on the application of canonical correlation analysis (CCA) to speech enhancement using the filtering approach. The authors explain how to derive different classes of time-domain and time-frequency-domain noise reduction filters, which are optimal from the CCA perspective for both single-channel and multichannel speech enhancement. Enhancement of noisy speech has been a challenging problem for many researchers over the past few decades and remains an active research area. Typically, speech enhancement algorithms operate in the short-time Fourier transform (STFT) domain, where the clean speech spectral coefficients are estimated using a multiplicative gain function. A filtering approach, which can be performed in the time domain or in the subband domain, obtains an estimate of the clean speech sample at every time instant or time-frequency bin by applying a filtering vector to the noisy speech vector. Compared to the multiplicative gain approach, the filtering approach more naturally takes into account the correlation of the speech signal in adjacent time frames. In this study, the authors pursue the filtering approach and show how to apply CCA to the speech enhancement problem. They also address the problem of adaptive beamforming from the CCA perspective, and show that the well-known Wiener and minimum variance distortionless response (MVDR) beamformers are particular cases of a general class of CCA-based adaptive beamformers.




Fundamentals of Speech Enhancement


Book Description

This book presents and develops several important concepts of speech enhancement in a simple but rigorous way. Many of the ideas are new; not only do they shed light on this old problem but they also offer valuable tips on how to improve on some well-known conventional approaches. The book unifies all aspects of speech enhancement, from single channel, multichannel, beamforming, time domain, frequency domain and time–frequency domain, to binaural in a clear and flexible framework. It starts with an exhaustive discussion on the fundamental best (linear and nonlinear) estimators, showing how they are connected to various important measures such as the coefficient of determination, the correlation coefficient, the conditional correlation coefficient, and the signal-to-noise ratio (SNR). It then goes on to show how to exploit these measures in order to derive all kinds of noise reduction algorithms that can offer an accurate and versatile compromise between noise reduction and speech distortion.




Deep Learning Applications


Book Description

Deep learning is a branch of machine learning similar to artificial intelligence. The applications of deep learning vary from medical imaging to industrial quality checking, sports, and precision agriculture. This book is divided into two sections. The first section covers deep learning architectures and the second section describes the state of the art of applications based on deep learning.




Biometric ID Management and Multimodal Communication


Book Description

This book constitutes the research papers presented at the Joint 2101 & 2102 International Conference on Biometric ID Management and Multimodal Communication. BioID_MultiComm'09 is a joint International Conference organized cooperatively by COST Actions 2101 & 2102. COST 2101 Action is focused on 'Biometrics for Identity Documents and Smart Cards (BIDS)', while COST 2102 Action is entitled 'Cross-Modal Analysis of Verbal and Non-verbal Communication'. The aim of COST 2101 is to investigate novel technologies for unsupervised multimodal biometric authentication systems using a new generation of biometrics-enabled identity documents and smart cards. COST 2102 is devoted to develop an advanced acoustical, perceptual and psychological analysis of verbal and non-verbal communication signals originating in spontaneous face-to-face interaction, in order to identify algorithms and automatic procedures capable of recognizing human emotional states.




Computer Communication, Networking and IoT


Book Description

This book features a collection of high-quality, peer-reviewed papers presented at the Fourth International Conference on Intelligent Computing and Communication (ICICC 2020) organized by the Department of Computer Science and Engineering and the Department of Computer Science and Technology, Dayananda Sagar University, Bengaluru, India, on 18–20 September 2020. The book is organized in two volumes and discusses advanced and multi-disciplinary research regarding the design of smart computing and informatics. It focuses on innovation paradigms in system knowledge, intelligence and sustainability that can be applied to provide practical solutions to a number of problems in society, the environment and industry. Further, the book also addresses the deployment of emerging computational and knowledge transfer approaches, optimizing solutions in various disciplines of science, technology and health care.




Cognitively Inspired Audiovisual Speech Filtering


Book Description

This book presents a summary of the cognitively inspired basis behind multimodal speech enhancement, covering the relationship between audio and visual modalities in speech, as well as recent research into audiovisual speech correlation. A number of audiovisual speech filtering approaches that make use of this relationship are also discussed. A novel multimodal speech enhancement system, making use of both visual and audio information to filter speech, is presented, and this book explores the extension of this system with the use of fuzzy logic to demonstrate an initial implementation of an autonomous, adaptive, and context aware multimodal system. This work also discusses the challenges presented with regard to testing such a system, the limitations with many current audiovisual speech corpora, and discusses a suitable approach towards development of a corpus designed to test this novel, cognitively inspired, speech filtering system.




Proceedings of the 2nd International Conference on Cognitive Based Information Processing and Applications (CIPA 2022)


Book Description

This book contains papers presented at the 2nd International Conference on Cognitive based Information Processing and Applications (CIPA) in Changzhou, China, from September 22 to 23, 2022. The book is divided into a 2-volume series and the papers represent the various technological advancements in network information processing, graphics and image processing, medical care, machine learning, smart cities. It caters to postgraduate students, researchers, and practitioners specializing and working in the area of cognitive-inspired computing and information processing.




Computational Analysis of Sound Scenes and Events


Book Description

This book presents computational methods for extracting the useful information from audio signals, collecting the state of the art in the field of sound event and scene analysis. The authors cover the entire procedure for developing such methods, ranging from data acquisition and labeling, through the design of taxonomies used in the systems, to signal processing methods for feature extraction and machine learning methods for sound recognition. The book also covers advanced techniques for dealing with environmental variation and multiple overlapping sound sources, and taking advantage of multiple microphones or other modalities. The book gives examples of usage scenarios in large media databases, acoustic monitoring, bioacoustics, and context-aware devices. Graphical illustrations of sound signals and their spectrographic representations are presented, as well as block diagrams and pseudocode of algorithms.




Progress in Applied Mathematical Modeling


Book Description

This book presents new research related to the mathematical modelling of engineering and environmental processes, manufacturing, and industrial systems. It includes heat transfer, fluid mechanics, CFD, and transport phenomena; solid mechanics and mechanics of metals; electromagnets and MHD; reliability modelling and system optimisation; finite volume, finite element, and boundary element procedures; decision sciences in an industrial and manufacturing context; civil engineering systems and structures; mineral and energy resources; relevant software engineering issues associated with CAD and CAE; and materials and metallurgical engineering.




Signal Processing Techniques for Computational Health Informatics


Book Description

This book focuses on signal processing techniques used in computational health informatics. As computational health informatics is the interdisciplinary study of the design, development, adoption and application of information and technology-based innovations, specifically, computational techniques that are relevant in health care, the book covers a comprehensive and representative range of signal processing techniques used in biomedical applications, including: bio-signal origin and dynamics, sensors used for data acquisition, artefact and noise removal techniques, feature extraction techniques in the time, frequency, time–frequency and complexity domain, and image processing techniques in different image modalities. Moreover, it includes an extensive discussion of security and privacy challenges, opportunities and future directions for computational health informatics in the big data age, and addresses the incorporation of recent techniques from the areas of artificial intelligence, deep learning and human–computer interaction. The systematic analysis of the state-of-the-art techniques covered here helps to further our understanding of the physiological processes involved and expandour capabilities in medical diagnosis and prognosis. In closing, the book, the first of its kind, blends state-of-the-art theory and practices of signal processing techniques inthe health informatics domain with real-world case studies building on those theories. As a result, it can be used as a text for health informatics courses to provide medics with cutting-edge signal processing techniques, or to introducehealth professionals who are already serving in this sector to some of the most exciting computational ideas that paved the way for the development of computational health informatics.