Bayesian Bounds for Parameter Estimation and Nonlinear Filtering/Tracking


Book Description

The first comprehensive development of Bayesian Bounds for parameter estimation and nonlinear filtering/tracking Bayesian estimation plays a central role in many signal processing problems encountered in radar, sonar, communications, seismology, and medical diagnosis. There are often highly nonlinear problems for which analytic evaluation of the exact performance is intractable. A widely used technique is to find bounds on the performance of any estimator and compare the performance of various estimators to these bounds. This book provides a comprehensive overview of the state of the art in Bayesian Bounds. It addresses two related problems: the estimation of multiple parameters based on noisy measurements and the estimation of random processes, either continuous or discrete, based on noisy measurements. An extensive introductory chapter provides an overview of Bayesian estimation and the interrelationship and applicability of the various Bayesian Bounds for both static parameters and random processes. It provides the context for the collection of papers that are included. This book will serve as a comprehensive reference for engineers and statisticians interested in both theory and application. It is also suitable as a text for a graduate seminar or as a supplementary reference for an estimation theory course.




Bayesian Estimation and Tracking


Book Description

A practical approach to estimating and tracking dynamic systems in real-worl applications Much of the literature on performing estimation for non-Gaussian systems is short on practical methodology, while Gaussian methods often lack a cohesive derivation. Bayesian Estimation and Tracking addresses the gap in the field on both accounts, providing readers with a comprehensive overview of methods for estimating both linear and nonlinear dynamic systems driven by Gaussian and non-Gaussian noices. Featuring a unified approach to Bayesian estimation and tracking, the book emphasizes the derivation of all tracking algorithms within a Bayesian framework and describes effective numerical methods for evaluating density-weighted integrals, including linear and nonlinear Kalman filters for Gaussian-weighted integrals and particle filters for non-Gaussian cases. The author first emphasizes detailed derivations from first principles of eeach estimation method and goes on to use illustrative and detailed step-by-step instructions for each method that makes coding of the tracking filter simple and easy to understand. Case studies are employed to showcase applications of the discussed topics. In addition, the book supplies block diagrams for each algorithm, allowing readers to develop their own MATLAB® toolbox of estimation methods. Bayesian Estimation and Tracking is an excellent book for courses on estimation and tracking methods at the graduate level. The book also serves as a valuable reference for research scientists, mathematicians, and engineers seeking a deeper understanding of the topics.




Optimal State Estimation


Book Description

A bottom-up approach that enables readers to master and apply the latest techniques in state estimation This book offers the best mathematical approaches to estimating the state of a general system. The author presents state estimation theory clearly and rigorously, providing the right amount of advanced material, recent research results, and references to enable the reader to apply state estimation techniques confidently across a variety of fields in science and engineering. While there are other textbooks that treat state estimation, this one offers special features and a unique perspective and pedagogical approach that speed learning: * Straightforward, bottom-up approach begins with basic concepts and then builds step by step to more advanced topics for a clear understanding of state estimation * Simple examples and problems that require only paper and pen to solve lead to an intuitive understanding of how theory works in practice * MATLAB(r)-based source code that corresponds to examples in the book, available on the author's Web site, enables readers to recreate results and experiment with other simulation setups and parameters Armed with a solid foundation in the basics, readers are presented with a careful treatment of advanced topics, including unscented filtering, high order nonlinear filtering, particle filtering, constrained state estimation, reduced order filtering, robust Kalman filtering, and mixed Kalman/H? filtering. Problems at the end of each chapter include both written exercises and computer exercises. Written exercises focus on improving the reader's understanding of theory and key concepts, whereas computer exercises help readers apply theory to problems similar to ones they are likely to encounter in industry. With its expert blend of theory and practice, coupled with its presentation of recent research results, Optimal State Estimation is strongly recommended for undergraduate and graduate-level courses in optimal control and state estimation theory. It also serves as a reference for engineers and science professionals across a wide array of industries.




Bayesian Filtering and Smoothing


Book Description

A unified Bayesian treatment of the state-of-the-art filtering, smoothing, and parameter estimation algorithms for non-linear state space models.




Bayesian Inference of State Space Models


Book Description

Bayesian Inference of State Space Models: Kalman Filtering and Beyond offers a comprehensive introduction to Bayesian estimation and forecasting for state space models. The celebrated Kalman filter, with its numerous extensions, takes centre stage in the book. Univariate and multivariate models, linear Gaussian, non-linear and non-Gaussian models are discussed with applications to signal processing, environmetrics, economics and systems engineering. Over the past years there has been a growing literature on Bayesian inference of state space models, focusing on multivariate models as well as on non-linear and non-Gaussian models. The availability of time series data in many fields of science and industry on the one hand, and the development of low-cost computational capabilities on the other, have resulted in a wealth of statistical methods aimed at parameter estimation and forecasting. This book brings together many of these methods, presenting an accessible and comprehensive introduction to state space models. A number of data sets from different disciplines are used to illustrate the methods and show how they are applied in practice. The R package BTSA, created for the book, includes many of the algorithms and examples presented. The book is essentially self-contained and includes a chapter summarising the prerequisites in undergraduate linear algebra, probability and statistics. An up-to-date and complete account of state space methods, illustrated by real-life data sets and R code, this textbook will appeal to a wide range of students and scientists, notably in the disciplines of statistics, systems engineering, signal processing, data science, finance and econometrics. With numerous exercises in each chapter, and prerequisite knowledge conveniently recalled, it is suitable for upper undergraduate and graduate courses.




Nonlinear Dynamics and Statistics


Book Description

This book describes the state of the art in nonlinear dynamical reconstruction theory. The chapters are based upon a workshop held at the Isaac Newton Institute, Cambridge University, UK, in late 1998. The book's chapters present theory and methods topics by leading researchers in applied and theoretical nonlinear dynamics, statistics, probability, and systems theory. Features and topics: * disentangling uncertainty and error: the predictability of nonlinear systems * achieving good nonlinear models * delay reconstructions: dynamics vs. statistics * introduction to Monte Carlo Methods for Bayesian Data Analysis * latest results in extracting dynamical behavior via Markov Models * data compression, dynamics and stationarity Professionals, researchers, and advanced graduates in nonlinear dynamics, probability, optimization, and systems theory will find the book a useful resource and guide to current developments in the subject.




Bayesian Multiple Target Tracking, Second Edition


Book Description

This second edition has undergone substantial revision from the 1999 first edition, recognizing that a lot has changed in the multiple target tracking field. One of the most dramatic changes is in the widespread use of particle filters to implement nonlinear, non-Gaussian Bayesian trackers. This book views multiple target tracking as a Bayesian inference problem. Within this framework it develops the theory of single target tracking, multiple target tracking, and likelihood ratio detection and tracking. In addition to providing a detailed description of a basic particle filter that implements the Bayesian single target recursion, this resource provides numerous examples that involve the use of particle filters. With these examples illustrating the developed concepts, algorithms, and approaches -- the book helps radar engineers develop tracking solutions when observations are non-linear functions of target state, when the target state distributions or measurement error distributions are not Gaussian, in low data rate and low signal to noise ratio situations, and when notions of contact and association are merged or unresolved among more than one target.







Recursive Nonlinear Estimation


Book Description

In a close analogy to matching data in Euclidean space, this monograph views parameter estimation as matching of the empirical distribution of data with a model-based distribution. Using an appealing Pythagorean-like geometry of the empirical and model distributions, the book brings a new solution to the problem of recursive estimation of non-Gaussian and nonlinear models which can be regarded as a specific approximation of Bayesian estimation. The cases of independent observations and controlled dynamic systems are considered in parallel; the former case giving initial insight into the latter case which is of primary interest to the control community. A number of examples illustrate the key concepts and tools used. This unique monograph follows some previous results on the Pythagorean theory of estimation in the literature (e.g., Chentsov, Csiszar and Amari) but extends the results to the case of controlled dynamic systems.




Nonlinear System Identification


Book Description

Nonlinear System Identification: NARMAX Methods in the Time, Frequency, and Spatio-Temporal Domains describes a comprehensive framework for the identification and analysis of nonlinear dynamic systems in the time, frequency, and spatio-temporal domains. This book is written with an emphasis on making the algorithms accessible so that they can be applied and used in practice. Includes coverage of: The NARMAX (nonlinear autoregressive moving average with exogenous inputs) model The orthogonal least squares algorithm that allows models to be built term by term where the error reduction ratio reveals the percentage contribution of each model term Statistical and qualitative model validation methods that can be applied to any model class Generalised frequency response functions which provide significant insight into nonlinear behaviours A completely new class of filters that can move, split, spread, and focus energy The response spectrum map and the study of sub harmonic and severely nonlinear systems Algorithms that can track rapid time variation in both linear and nonlinear systems The important class of spatio-temporal systems that evolve over both space and time Many case study examples from modelling space weather, through identification of a model of the visual processing system of fruit flies, to tracking causality in EEG data are all included to demonstrate how easily the methods can be applied in practice and to show the insight that the algorithms reveal even for complex systems NARMAX algorithms provide a fundamentally different approach to nonlinear system identification and signal processing for nonlinear systems. NARMAX methods provide models that are transparent, which can easily be analysed, and which can be used to solve real problems. This book is intended for graduates, postgraduates and researchers in the sciences and engineering, and also for users from other fields who have collected data and who wish to identify models to help to understand the dynamics of their systems.