Computationally Efficient Kalman Filter Approaches for Fitting Smoothing Splines


Book Description

Smoothing spline models have shown to be effective in various fields (e.g., engineering and biomedical sciences) for understanding complex signals from noisy data. As nonparametric models, smoothing spline ANOVA (Analysis Of variance) models do not fix the structure of the regression function, leading to more flexible model estimates (e.g., linear or nonlinear estimates). The functional ANOVA decomposition of the regression function estimates offers interpretable results that describe the relationship between the outcome variable, and the main and interaction effects of different covariates/predictors. However, smoothing spline ANOVA (SS-ANOVA) models suffer from high computational costs, with a computational complexity of ON3 for N observations. Various numerical approaches can address this problem. In this chapter, we focus on the introduction to a state space representation of SS-ANOVA models. The estimation algorithms based on the Kalman filter are implemented within the SS-ANOVA framework using the state space representation, reducing the computational costs significantly.




Curve and Surface Fitting with Splines


Book Description

The fitting of a curve or surface through a set of observational data is a very frequent problem in different disciplines (mathematics, engineering, medicine, ...) with many interesting applications. This book describes the algorithms and mathematical fundamentals of a widely used software package for data fitting with (tensor product) splines. As such it gives a survey of possibilities and benefits but also of the problems to cope with when approximating with this popular type of function. In particular it is demonstrated in detail how the properties of B-splines can be fully exploited for improving the computational efficiency and for incorporating different boundary or shape preserving constraints. Special attention is also paid to strategies for an automatic and adaptive knot selection with intent to obtain serious data reductions. The practical use of the smoothing software is illustrated with many examples, academic as well as taken from real life.




Smoothing Splines


Book Description

A general class of powerful and flexible modeling techniques, spline smoothing has attracted a great deal of research attention in recent years and has been widely used in many application areas, from medicine to economics. Smoothing Splines: Methods and Applications covers basic smoothing spline models, including polynomial, periodic, spherical, t




Kalman Filtering


Book Description

This book provides readers with a solid introduction to the theoretical and practical aspects of Kalman filtering. It has been updated with the latest developments in the implementation and application of Kalman filtering, including adaptations for nonlinear filtering, more robust smoothing methods, and developing applications in navigation. All software is provided in MATLAB, giving readers the opportunity to discover how the Kalman filter works in action and to consider the practical arithmetic needed to preserve the accuracy of results. Note: CD-ROM/DVD and other supplementary materials are not included as part of eBook file. An Instructor's Manual presenting detailed solutions to all the problems in the book is available from the Wiley editorial department -- to obtain the manual, send an email to [email protected].




Restricted Kalman Filtering


Book Description

​​​​​​​​ ​In statistics, the Kalman filter is a mathematical method whose purpose is to use a series of measurements observed over time, containing random variations and other inaccuracies, and produce estimates that tend to be closer to the true unknown values than those that would be based on a single measurement alone. This Brief offers developments on Kalman filtering subject to general linear constraints. There are essentially three types of contributions: new proofs for results already established; new results within the subject; and applications in investment analysis and macroeconomics, where the proposed methods are illustrated and evaluated. The Brief has a short chapter on linear state space models and the Kalman filter, aiming to make the book self-contained and to give a quick reference to the reader (notation and terminology). The prerequisites would be a contact with time series analysis in the level of Hamilton (1994) or Brockwell & Davis (2002) and also with linear state models and the Kalman filter – each of these books has a chapter entirely dedicated to the subject. The book is intended for graduate students, researchers and practitioners in statistics (specifically: time series analysis and econometrics).




Kalman Filtering Under Information Theoretic Criteria


Book Description

This book provides several efficient Kalman filters (linear or nonlinear) under information theoretic criteria. They achieve excellent performance in complicated non-Gaussian noises with low computation complexity and have great practical application potential. The book combines all these perspectives and results in a single resource for students and practitioners in relevant application fields. Each chapter starts with a brief review of fundamentals, presents the material focused on the most important properties and evaluates comparatively the models discussing free parameters and their effect on the results. Proofs are provided at the end of each chapter. The book is geared to senior undergraduates with a basic understanding of linear algebra, signal processing and statistics, as well as graduate students or practitioners with experience in Kalman filtering.




CURVE and SURFACE FITTING with MATLAB. INTERPOLATION, SMOOTHING and SPLINE FITTING


Book Description

The Curve Fitting Toolbox software supports these nonparametric fitting methods: -"Interpolation Methods" - Estimate values that lie between known data points.-"Smoothing Splines" - Create a smooth curve through the data. You adjust the level of smoothness by varying a parameter that changes the curve from a least-squares straight-line approximation to a cubic spline interpolant.-"Lowess Smoothing" - Create a smooth surface through the data using locally weighted linear regression to smooth data.Interpolation is a process for estimating values that lie between known data points. There are several interpolation methods: - Linear: Linear interpolation. This method fit a different linear polynomial between each pair of data points for curves, or between sets of three points for surfaces.- Nearest neighbor: Nearest neighbor interpolation. This method sets the value of an interpolated point to the value of the nearest data point. Therefore, this method does not generate any new data points.- Cubic spline: Cubic spline interpolation. This method fit a different cubic polynomial between each pair of data points for curves, or between sets of three points for surfaces.After fitting data with one or more models, you should evaluate the goodness of fit A visual examination of the fitte curve displayed in Curve Fitting app should be your firs step. Beyond that, the toolbox provides these methods to assess goodness of fi for both linear and nonlinear parametric fits-"Goodness-of-Fit Statistics" -"Residual Analysis" -"Confidence and Prediction Bounds" The Curve Fitting Toolbox spline functions are a collection of tools for creating, viewing, and analyzing spline approximations of data. Splines are smooth piecewise polynomials that can be used to represent functions over large intervals, where it would be impractical to use a single approximating polynomial. The spline functionality includes a graphical user interface (GUI) that provides easy access to functions for creating, visualizing, and manipulating splines. The toolbox also contains functions that enable you to evaluate, plot, combine, differentiate and integrate splines. Because all toolbox functions are implemented in the open MATLAB language, you can inspect the algorithms, modify the source code, and create your own custom functions. Key spline features: -GUIs that let you create, view, and manipulate splines and manage and compare spline approximations-Functions for advanced spline operations, including differentiation integration, break/knot manipulation, and optimal knot placement-Support for piecewise polynomial form (ppform) and basis form (B-form) splines-Support for tensor-product splines and rational splines (including NURBS)- Shape-preserving: Piecewise cubic Hermite interpolation (PCHIP). This method preserves monotonicity and the shape of the data. For curves only.- Biharmonic (v4): MATLAB 4 grid data method. For surfaces only.- Thin-plate spline: Thin-plate spline interpolation. This method fit smooth surfaces that also extrapolate well. For surfaces only.If your data is noisy, you might want to fit it using a smoothing spline. Alternatively, you can use one of the smoothing methods. The smoothing spline s is constructed for the specified smoothing parameter p and the specified weights wi.




Time Series Analysis by State Space Methods


Book Description

This is a comprehensive treatment of the state space approach to time series analysis. A distinguishing feature of state space time series models is that observations are regarded as made up of distinct components, which are each modelled separately.




Smoothing and Regression


Book Description

A comprehensive introduction to a wide variety of univariate and multivariate smoothing techniques for regression Smoothing and Regression: Approaches, Computation, and Application bridges the many gaps that exist among competing univariate and multivariate smoothing techniques. It introduces, describes, and in some cases compares a large number of the latest and most advanced techniques for regression modeling. Unlike many other volumes on this topic, which are highly technical and specialized, this book discusses all methods in light of both computational efficiency and their applicability for real data analysis. Using examples of applications from the biosciences, environmental sciences, engineering, and economics, as well as medical research and marketing, this volume addresses the theory, computation, and application of each approach. A number of the techniques discussed, such as smoothing under shape restrictions or of dependent data, are presented for the first time in book form. Special features of this book include: * Comprehensive coverage of smoothing and regression with software hints and applications from a wide variety of disciplines * A unified, easy-to-follow format * Contributions from more than 25 leading researchers from around the world * More than 150 illustrations also covering new graphical techniques important for exploratory data analysis and visualization of high-dimensional problems * Extensive end-of-chapter references For professionals and aspiring professionals in statistics, applied mathematics, computer science, and econometrics, as well as for researchers in the applied and social sciences, Smoothing and Regression is a unique and important new resource destined to become one the most frequently consulted references in the field.




Advanced Kalman Filtering, Least-Squares and Modeling


Book Description

This book is intended primarily as a handbook for engineers who must design practical systems. Its primary goal is to discuss model development in sufficient detail so that the reader may design an estimator that meets all application requirements and is robust to modeling assumptions. Since it is sometimes difficult to a priori determine the best model structure, use of exploratory data analysis to define model structure is discussed. Methods for deciding on the “best” model are also presented. A second goal is to present little known extensions of least squares estimation or Kalman filtering that provide guidance on model structure and parameters, or make the estimator more robust to changes in real-world behavior. A third goal is discussion of implementation issues that make the estimator more accurate or efficient, or that make it flexible so that model alternatives can be easily compared. The fourth goal is to provide the designer/analyst with guidance in evaluating estimator performance and in determining/correcting problems. The final goal is to provide a subroutine library that simplifies implementation, and flexible general purpose high-level drivers that allow both easy analysis of alternative models and access to extensions of the basic filtering. Supplemental materials and up-to-date errata are downloadable at http://booksupport.wiley.com.