Handbook of Mixture Analysis


Book Description

Mixture models have been around for over 150 years, and they are found in many branches of statistical modelling, as a versatile and multifaceted tool. They can be applied to a wide range of data: univariate or multivariate, continuous or categorical, cross-sectional, time series, networks, and much more. Mixture analysis is a very active research topic in statistics and machine learning, with new developments in methodology and applications taking place all the time. The Handbook of Mixture Analysis is a very timely publication, presenting a broad overview of the methods and applications of this important field of research. It covers a wide array of topics, including the EM algorithm, Bayesian mixture models, model-based clustering, high-dimensional data, hidden Markov models, and applications in finance, genomics, and astronomy. Features: Provides a comprehensive overview of the methods and applications of mixture modelling and analysis Divided into three parts: Foundations and Methods; Mixture Modelling and Extensions; and Selected Applications Contains many worked examples using real data, together with computational implementation, to illustrate the methods described Includes contributions from the leading researchers in the field The Handbook of Mixture Analysis is targeted at graduate students and young researchers new to the field. It will also be an important reference for anyone working in this field, whether they are developing new methodology, or applying the models to real scientific problems.




Random Fields for Spatial Data Modeling


Book Description

This book provides an inter-disciplinary introduction to the theory of random fields and its applications. Spatial models and spatial data analysis are integral parts of many scientific and engineering disciplines. Random fields provide a general theoretical framework for the development of spatial models and their applications in data analysis. The contents of the book include topics from classical statistics and random field theory (regression models, Gaussian random fields, stationarity, correlation functions) spatial statistics (variogram estimation, model inference, kriging-based prediction) and statistical physics (fractals, Ising model, simulated annealing, maximum entropy, functional integral representations, perturbation and variational methods). The book also explores links between random fields, Gaussian processes and neural networks used in machine learning. Connections with applied mathematics are highlighted by means of models based on stochastic partial differential equations. An interlude on autoregressive time series provides useful lower-dimensional analogies and a connection with the classical linear harmonic oscillator. Other chapters focus on non-Gaussian random fields and stochastic simulation methods. The book also presents results based on the author’s research on Spartan random fields that were inspired by statistical field theories originating in physics. The equivalence of the one-dimensional Spartan random field model with the classical, linear, damped harmonic oscillator driven by white noise is highlighted. Ideas with potentially significant computational gains for the processing of big spatial data are presented and discussed. The final chapter concludes with a description of the Karhunen-Loève expansion of the Spartan model. The book will appeal to engineers, physicists, and geoscientists whose research involves spatial models or spatial data analysis. Anyone with background in probability and statistics can read at least parts of the book. Some chapters will be easier to understand by readers familiar with differential equations and Fourier transforms.




Bayesian Nonparametrics


Book Description

This book is the first systematic treatment of Bayesian nonparametric methods and the theory behind them. It will also appeal to statisticians in general. The book is primarily aimed at graduate students and can be used as the text for a graduate course in Bayesian non-parametrics.




Mixtures


Book Description

This book uses the EM (expectation maximization) algorithm to simultaneously estimate the missing data and unknown parameter(s) associated with a data set. The parameters describe the component distributions of the mixture; the distributions may be continuous or discrete. The editors provide a complete account of the applications, mathematical structure and statistical analysis of finite mixture distributions along with MCMC computational methods, together with a range of detailed discussions covering the applications of the methods and features chapters from the leading experts on the subject. The applications are drawn from scientific discipline, including biostatistics, computer science, ecology and finance. This area of statistics is important to a range of disciplines, and its methodology attracts interest from researchers in the fields in which it can be applied.




Hidden Conditional Random Fields for Speech Recognition


Book Description

This thesis investigates using a new graphical model, hidden conditional random fields (HCRFs), for speech recognition. Conditional random fields (CRFs) are discriminative sequence models that have been successfully applied to several tasks in text processing, such as named entity recognition. Recently, there has been increasing interest in applying CRFs to speech recognition due to the similarity between speech and text processing. HCRFs are CRFs augmented with hidden variables that are capable of representing the dynamic changes and variations in speech signals. HCRFs also have the ability to incorporate correlated features from both speech signals and text without making strong independence assumptions among them. This thesis presents my current research on applying HCRFs to speech recognition and HCRFs' potential to replace the current hidden Markov model (HMM) for acoustic modeling. Experimental results of phone classification, phone recognition, and speaker adaptation are presented and discussed. Our monophone HCRFs outperform both maximum mutual information estimation (MMIE) and minimum phone error (MPE) trained HMMs and achieve the-start-of-the-art performance in TIMIT phone classification and recognition tasks. We also show how to jointly train acoustic models and language models in HCRFs, which shows improvement in the results. Maximum a posterior (MAP) and maximum conditional likelihood linear regression (MCLLR) successfully adapt speaker-independent models to speaker-dependent models with a small amount of adaptation data for HCRF speaker adaptation. Finally, we explore adding gender and dialect features for phone recognition, and experimental results are presented.




Finite Mixture Models


Book Description

An up-to-date, comprehensive account of major issues in finitemixture modeling This volume provides an up-to-date account of the theory andapplications of modeling via finite mixture distributions. With anemphasis on the applications of mixture models in both mainstreamanalysis and other areas such as unsupervised pattern recognition,speech recognition, and medical imaging, the book describes theformulations of the finite mixture approach, details itsmethodology, discusses aspects of its implementation, andillustrates its application in many common statisticalcontexts. Major issues discussed in this book include identifiabilityproblems, actual fitting of finite mixtures through use of the EMalgorithm, properties of the maximum likelihood estimators soobtained, assessment of the number of components to be used in themixture, and the applicability of asymptotic theory in providing abasis for the solutions to some of these problems. The author alsoconsiders how the EM algorithm can be scaled to handle the fittingof mixture models to very large databases, as in data miningapplications. This comprehensive, practical guide: * Provides more than 800 references-40% published since 1995 * Includes an appendix listing available mixture software * Links statistical literature with machine learning and patternrecognition literature * Contains more than 100 helpful graphs, charts, and tables Finite Mixture Models is an important resource for both applied andtheoretical statisticians as well as for researchers in the manyareas in which finite mixture models can be used to analyze data.




Mixture Models and Applications


Book Description

This book focuses on recent advances, approaches, theories and applications related to mixture models. In particular, it presents recent unsupervised and semi-supervised frameworks that consider mixture models as their main tool. The chapters considers mixture models involving several interesting and challenging problems such as parameters estimation, model selection, feature selection, etc. The goal of this book is to summarize the recent advances and modern approaches related to these problems. Each contributor presents novel research, a practical study, or novel applications based on mixture models, or a survey of the literature. Reports advances on classic problems in mixture modeling such as parameter estimation, model selection, and feature selection; Present theoretical and practical developments in mixture-based modeling and their importance in different applications; Discusses perspectives and challenging future works related to mixture modeling.




Practical Nonparametric and Semiparametric Bayesian Statistics


Book Description

A compilation of original articles by Bayesian experts, this volume presents perspectives on recent developments on nonparametric and semiparametric methods in Bayesian statistics. The articles discuss how to conceptualize and develop Bayesian models using rich classes of nonparametric and semiparametric methods, how to use modern computational tools to summarize inferences, and how to apply these methodologies through the analysis of case studies.




On Statistical Pattern Recognition in Independent Component Analysis Mixture Modelling


Book Description

A natural evolution of statistical signal processing, in connection with the progressive increase in computational power, has been exploiting higher-order information. Thus, high-order spectral analysis and nonlinear adaptive filtering have received the attention of many researchers. One of the most successful techniques for non-linear processing of data with complex non-Gaussian distributions is the independent component analysis mixture modelling (ICAMM). This thesis defines a novel formalism for pattern recognition and classification based on ICAMM, which unifies a certain number of pattern recognition tasks allowing generalization. The versatile and powerful framework developed in this work can deal with data obtained from quite different areas, such as image processing, impact-echo testing, cultural heritage, hypnograms analysis, web-mining and might therefore be employed to solve many different real-world problems.




Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications


Book Description

This book constitutes the refereed post-conference proceedings of the 21st Iberoamerican Congress on Pattern Recognition, CIARP 2016, held in Lima, Peru, in November 2016. The 69 papers presented were carefully reviewed and selected from 131 submissions. The papers feature research results in the areas of pattern recognition, biometrics, image processing, computer vision, speech recognition, and remote sensing. They constitute theoretical as well as applied contributions in many fields related to the main topics of the conference.