Elliptically Symmetric Distributions in Signal Processing and Machine Learning


Book Description

This book constitutes a review of recent developments in the theory and practical exploitation of the elliptical model for measured data in both classical and emerging areas of signal processing. It develops techniques usable in (among other areas): graph learning, robust clustering, linear shrinkage, information geometry, subspace-based algorithm design, and semiparametric and misspecified estimation. The various contributions combine to show how the goal of inferring information from a set of acquired data, recurrent in statistical signal processing, can be achieved, even when the common practical assumption of Gaussian distribution in the data is not valid. The elliptical model propounded maintains the performance of its inference procedures even when that assumption fails. The elliptical distribution, being fully characterized by its location vector, its scatter/covariance matrix and its so-called density generator, used to describe the impulsiveness of the data, is sufficiently flexible to model heterogeneous applications. This book is of interest to any graduate students and academic researchers wishing to acquaint themselves with the latest research in an area of rising consequence. It is also of assistance to practitioners working in data analysis, wireless communications, radar, and image processing.







Blind Identification and Separation of Complex-valued Signals


Book Description

Blind identification consists of estimating a multi-dimensional system only through the use of its output, and source separation, the blind estimation of the inverse of the system. Estimation is generally carried out using different statistics of the output. The authors of this book consider the blind identification and source separation problem in the complex-domain, where the available statistical properties are richer and include non-circularity of the sources – underlying components. They define identifiability conditions and present state-of-the-art algorithms that are based on algebraic methods as well as iterative algorithms based on maximum likelihood theory. Contents 1. Mathematical Preliminaries. 2. Estimation by Joint Diagonalization. 3. Maximum Likelihood ICA. About the Authors Eric Moreau is Professor of Electrical Engineering at the University of Toulon, France. His research interests concern statistical signal processing, high order statistics and matrix/tensor decompositions with applications to data analysis, telecommunications and radar. Tülay Adali is Professor of Electrical Engineering and Director of the Machine Learning for Signal Processing Laboratory at the University of Maryland, Baltimore County, USA. Her research interests concern statistical and adaptive signal processing, with an emphasis on nonlinear and complex-valued signal processing, and applications in biomedical data analysis and communications. Blind identification consists of estimating a multidimensional system through the use of only its output. Source separation is concerned with the blind estimation of the inverse of the system. The estimation is generally performed by using different statistics of the outputs. The authors consider the blind estimation of a multiple input/multiple output (MIMO) system that mixes a number of underlying signals of interest called sources. They also consider the case of direct estimation of the inverse system for the purpose of source separation. They then describe the estimation theory associated with the identifiability conditions and dedicated algebraic algorithms. The algorithms depend critically on (statistical and/or time frequency) properties of complex sources that will be precisely described.




Algorithmic Advances in Riemannian Geometry and Applications


Book Description

This book presents a selection of the most recent algorithmic advances in Riemannian geometry in the context of machine learning, statistics, optimization, computer vision, and related fields. The unifying theme of the different chapters in the book is the exploitation of the geometry of data using the mathematical machinery of Riemannian geometry. As demonstrated by all the chapters in the book, when the data is intrinsically non-Euclidean, the utilization of this geometrical information can lead to better algorithms that can capture more accurately the structures inherent in the data, leading ultimately to better empirical performance. This book is not intended to be an encyclopedic compilation of the applications of Riemannian geometry. Instead, it focuses on several important research directions that are currently actively pursued by researchers in the field. These include statistical modeling and analysis on manifolds,optimization on manifolds, Riemannian manifolds and kernel methods, and dictionary learning and sparse coding on manifolds. Examples of applications include novel algorithms for Monte Carlo sampling and Gaussian Mixture Model fitting, 3D brain image analysis,image classification, action recognition, and motion tracking.




Coherence


Book Description

This book organizes principles and methods of signal processing and machine learning into the framework of coherence. The book contains a wealth of classical and modern methods of inference, some reported here for the first time. General results are applied to problems in communications, cognitive radio, passive and active radar and sonar, multi-sensor array processing, spectrum analysis, hyperspectral imaging, subspace clustering, and related. The reader will find new results for model fitting; for dimension reduction in models and ambient spaces; for detection, estimation, and space-time series analysis; for subspace averaging; and for uncertainty quantification. Throughout, the transformation invariances of statistics are clarified, geometries are illuminated, and null distributions are given where tractable. Stochastic representations are emphasized, as these are central to Monte Carlo simulations. The appendices contain a comprehensive account of matrix theory, the SVD, the multivariate normal distribution, and many of the important distributions for coherence statistics. The book begins with a review of classical results in the physical and engineering sciences where coherence plays a fundamental role. Then least squares theory and the theory of minimum mean-squared error estimation are developed, with special attention paid to statistics that may be interpreted as coherence statistics. A chapter on classical hypothesis tests for covariance structure introduces the next three chapters on matched and adaptive subspace detectors. These detectors are derived from likelihood reasoning, but it is their geometries and invariances that qualify them as coherence statistics. A chapter on independence testing in space-time data sets leads to a definition of broadband coherence, and contains novel applications to cognitive radio and the analysis of cyclostationarity. The chapter on subspace averaging reviews basic results and derives an order-fitting rule for determining the dimension of an average subspace. These results are used to enumerate sources of acoustic and electromagnetic radiation and to cluster subspaces into similarity classes. The chapter on performance bounds and uncertainty quantification emphasizes the geometry of the Cramèr-Rao bound and its related information geometry.




Machine Learning for Signal Processing


Book Description

Describes in detail the fundamental mathematics and algorithms of machine learning (an example of artificial intelligence) and signal processing, two of the most important and exciting technologies in the modern information economy. Builds up concepts gradually so that the ideas and algorithms can be implemented in practical software applications.




Pattern Recognition and Machine Intelligence


Book Description

The two-volume set of LNCS 11941 and 11942 constitutes the refereed proceedings of the 8th International Conference on Pattern Recognition and Machine Intelligence, PReMI 2019, held in Tezpur, India, in December 2019. The 131 revised full papers presented were carefully reviewed and selected from 341 submissions. They are organized in topical sections named: Pattern Recognition; Machine Learning; Deep Learning; Soft and Evolutionary Computing; Image Processing; Medical Image Processing; Bioinformatics and Biomedical Signal Processing; Information Retrieval; Remote Sensing; Signal and Video Processing; and Smart and Intelligent Sensors.




Robust and Multivariate Statistical Methods


Book Description

This book presents recent developments in multivariate and robust statistical methods. Featuring contributions by leading experts in the field it covers various topics, including multivariate and high-dimensional methods, time series, graphical models, robust estimation, supervised learning and normal extremes. It will appeal to statistics and data science researchers, PhD students and practitioners who are interested in modern multivariate and robust statistics. The book is dedicated to David E. Tyler on the occasion of his pending retirement and also includes a review contribution on the popular Tyler’s shape matrix.




Financial Signal Processing and Machine Learning


Book Description

The modern financial industry has been required to deal with large and diverse portfolios in a variety of asset classes often with limited market data available. Financial Signal Processing and Machine Learning unifies a number of recent advances made in signal processing and machine learning for the design and management of investment portfolios and financial engineering. This book bridges the gap between these disciplines, offering the latest information on key topics including characterizing statistical dependence and correlation in high dimensions, constructing effective and robust risk measures, and their use in portfolio optimization and rebalancing. The book focuses on signal processing approaches to model return, momentum, and mean reversion, addressing theoretical and implementation aspects. It highlights the connections between portfolio theory, sparse learning and compressed sensing, sparse eigen-portfolios, robust optimization, non-Gaussian data-driven risk measures, graphical models, causal analysis through temporal-causal modeling, and large-scale copula-based approaches. Key features: Highlights signal processing and machine learning as key approaches to quantitative finance. Offers advanced mathematical tools for high-dimensional portfolio construction, monitoring, and post-trade analysis problems. Presents portfolio theory, sparse learning and compressed sensing, sparsity methods for investment portfolios. including eigen-portfolios, model return, momentum, mean reversion and non-Gaussian data-driven risk measures with real-world applications of these techniques. Includes contributions from leading researchers and practitioners in both the signal and information processing communities, and the quantitative finance community.




Digital Signal Processing Using MATLAB for Students and Researchers


Book Description

Quickly Engages in Applying Algorithmic Techniques to Solve Practical Signal Processing Problems With its active, hands-on learning approach, this text enables readers to master the underlying principles of digital signal processing and its many applications in industries such as digital television, mobile and broadband communications, and medical/scientific devices. Carefully developed MATLAB® examples throughout the text illustrate the mathematical concepts and use of digital signal processing algorithms. Readers will develop a deeper understanding of how to apply the algorithms by manipulating the codes in the examples to see their effect. Moreover, plenty of exercises help to put knowledge into practice solving real-world signal processing challenges. Following an introductory chapter, the text explores: Sampled signals and digital processing Random signals Representing signals and systems Temporal and spatial signal processing Frequency analysis of signals Discrete-time filters and recursive filters Each chapter begins with chapter objectives and an introduction. A summary at the end of each chapter ensures that one has mastered all the key concepts and techniques before progressing in the text. Lastly, appendices listing selected web resources, research papers, and related textbooks enable the investigation of individual topics in greater depth. Upon completion of this text, readers will understand how to apply key algorithmic techniques to address practical signal processing problems as well as develop their own signal processing algorithms. Moreover, the text provides a solid foundation for evaluating and applying new digital processing signal techniques as they are developed.