Fundamentals of Statistical Signal Processing


Book Description

"For those involved in the design and implementation of signal processing algorithms, this book strikes a balance between highly theoretical expositions and the more practical treatments, covering only those approaches necessary for obtaining an optimal estimator and analyzing its performance. Author Steven M. Kay discusses classical estimation followed by Bayesian estimation, and illustrates the theory with numerous pedagogical and real-world examples."--Cover, volume 1.




Foundations of Estimation Theory


Book Description

The application of estimation theory renders the processing of experimental results both rational and effective, and thus helps not only to make our knowledge more precise but to determine the measure of its reliability. As a consequence, estimation theory is indispensable in the analysis of the measuring processes and of experiments in general.The knowledge necessary for studying this book encompasses the disciplines of probability and mathematical statistics as studied in the third or fourth year at university. For readers interested in applications, comparatively detailed chapters on linear and quadratic estimations, and normality of observation vectors have been included. Chapter 2 includes selected items of information from algebra, functional analysis and the theory of probability, intended to facilitate the reading of the text proper and to save the reader looking up individual theorems in various textbooks and papers; it is mainly devoted to the reproducing kernel Hilbert spaces, helpful in solving many estimation problems. The text proper of the book begins with Chapter 3. This is divided into two parts: the first deals with sufficient statistics, complete sufficient statistics, minimal sufficient statistics and relations between them; the second contains the mostimportant inequalities of estimation theory for scalar and vector valued parameters and presents properties of the exponential family of distributions.The fourth chapter is an introduction to asymptotic methods of estimation. The method of statistical moments and the maximum-likelihood method are investigated. The sufficient conditions for asymptotical normality of the estimators are given for both methods. The linear and quadratic methods of estimation are dealt with in the fifth chapter. The method of least squares estimation is treated. Five basic regular versions of the regression model and the unified linear model of estimation are described. Unbiased estimators for unit dispersion (factor of the covariance matrix) are given for all mentioned cases. The equivalence of the least-squares method to the method of generalized minimum norm inversion of the design matrix of the regression model is studied in detail. The problem of estimating the covariance components in the mixed model is mentioned as well. Statistical properties of linear and quadratic estimators developed in the fifth chapter in the case of normally distributed errors of measurement are given in Chapter 6. Further, the application of tensor products of Hilbert spaces generated by the covariance matrix of random error vector of observations is demonstrated. Chapter 7 reviews some further important methods of estimation theory. In the first part Wald's method of decision functions is applied to the construction of estimators. The method of contracted estimators and the method of Hoerl and Kennard are presented in the second part. The basic ideas of robustness and Bahadur's approach to estimation theory are presented in the third and fourth parts of this last chapter.




Foundations of Econometrics


Book Description

Advanced Textbooks in Economics, Volume 7: Foundations of Econometrics focuses on the principles, processes, methodologies, and approaches involved in the study of econometrics. The publication examines matrix theory and multivariate statistical analysis. Discussions focus on the maximum likelihood estimation of multivariate normal distribution parameters, point estimation theory, multivariate normal distribution, multivariate probability distributions, Euclidean spaces and linear transformations, orthogonal transformations and symmetric matrices, and determinants. The manuscript then ponders on linear expected value models and simultaneous equation estimation. Topics include random exogenous variables, maximum likelihood estimation of a single equation, identification of a single equation, linear stochastic difference equations, and errors-in-variables models. The book takes a look at a prolegomenon to econometric model building, tests of hypotheses in econometric models, multivariate statistical analysis, and simultaneous equation estimation. Concerns include maximum likelihood estimation of a single equation, tests of linear hypotheses, testing for independence, and causality in economic models. The publication is a valuable source of data for economists and researchers interested in the foundations of econometrics.







Statistical Signal Processing


Book Description

This book embraces the many mathematical procedures that engineers and statisticians use to draw inference from imperfect or incomplete measurements. This book presents the fundamental ideas in statistical signal processing along four distinct lines: mathematical and statistical preliminaries; decision theory; estimation theory; and time series analysis.




Lessons in Estimation Theory for Signal Processing, Communications, and Control


Book Description

Estimation theory is a product of need and technology. As a result, it is an integral part of many branches of science and engineering. To help readers differentiate among the rich collection of estimation methods and algorithms, this book describes in detail many of the important estimation methods and shows how they are interrelated. Written as a collection of lessons, this book introduces readers o the general field of estimation theory and includes abundant supplementary material.




An Introduction to Signal Detection and Estimation


Book Description

The purpose of this book is to introduce the reader to the basic theory of signal detection and estimation. It is assumed that the reader has a working knowledge of applied probabil ity and random processes such as that taught in a typical first-semester graduate engineering course on these subjects. This material is covered, for example, in the book by Wong (1983) in this series. More advanced concepts in these areas are introduced where needed, primarily in Chapters VI and VII, where continuous-time problems are treated. This book is adapted from a one-semester, second-tier graduate course taught at the University of Illinois. However, this material can also be used for a shorter or first-tier course by restricting coverage to Chapters I through V, which for the most part can be read with a background of only the basics of applied probability, including random vectors and conditional expectations. Sufficient background for the latter option is given for exam pIe in the book by Thomas (1986), also in this series.




Theory of Point Estimation


Book Description

This second, much enlarged edition by Lehmann and Casella of Lehmann's classic text on point estimation maintains the outlook and general style of the first edition. All of the topics are updated, while an entirely new chapter on Bayesian and hierarchical Bayesian approaches is provided, and there is much new material on simultaneous estimation. Each chapter concludes with a Notes section which contains suggestions for further study. This is a companion volume to the second edition of Lehmann's "Testing Statistical Hypotheses".







Parameter Estimation and Inverse Problems


Book Description

Parameter Estimation and Inverse Problems, Third Edition, is structured around a course at New Mexico Tech and is designed to be accessible to typical graduate students in the physical sciences who do not have an extensive mathematical background. The book is complemented by a companion website that includes MATLAB codes that correspond to examples that are illustrated with simple, easy to follow problems that illuminate the details of particular numerical methods. Updates to the new edition include more discussions of Laplacian smoothing, an expansion of basis function exercises, the addition of stochastic descent, an improved presentation of Fourier methods and exercises, and more. - Features examples that are illustrated with simple, easy to follow problems that illuminate the details of a particular numerical method - Includes an online instructor's guide that helps professors teach and customize exercises and select homework problems - Covers updated information on adjoint methods that are presented in an accessible manner