Statistical Estimation


Book Description

when certain parameters in the problem tend to limiting values (for example, when the sample size increases indefinitely, the intensity of the noise ap proaches zero, etc.) To address the problem of asymptotically optimal estimators consider the following important case. Let X 1, X 2, ... , X n be independent observations with the joint probability density !(x,O) (with respect to the Lebesgue measure on the real line) which depends on the unknown patameter o e 9 c R1. It is required to derive the best (asymptotically) estimator 0:( X b ... , X n) of the parameter O. The first question which arises in connection with this problem is how to compare different estimators or, equivalently, how to assess their quality, in terms of the mean square deviation from the parameter or perhaps in some other way. The presently accepted approach to this problem, resulting from A. Wald's contributions, is as follows: introduce a nonnegative function w(0l> ( ), Ob Oe 9 (the loss function) and given two estimators Of and O! n 2 2 the estimator for which the expected loss (risk) Eown(Oj, 0), j = 1 or 2, is smallest is called the better with respect to Wn at point 0 (here EoO is the expectation evaluated under the assumption that the true value of the parameter is 0). Obviously, such a method of comparison is not without its defects.




Non-Regular Statistical Estimation


Book Description

In order to obtain many of the classical results in the theory of statistical estimation, it is usual to impose regularity conditions on the distributions under consideration. In small sample and large sample theories of estimation there are well established sets of regularity conditions, and it is worth while to examine what may follow if any one of these regularity conditions fail to hold. "Non-regular estimation" literally means the theory of statistical estimation when some or other of the regularity conditions fail to hold. In this monograph, the authors present a systematic study of the meaning and implications of regularity conditions, and show how the relaxation of such conditions can often lead to surprising conclusions. Their emphasis is on considering small sample results and to show how pathological examples may be considered in this broader framework.




Non-Regular Statistical Estimation


Book Description

In order to obtain many of the classical results in the theory of statistical estimation, it is usual to impose regularity conditions on the distributions under consideration. In small sample and large sample theories of estimation there are well established sets of regularity conditions, and it is worth while to examine what may follow if any one of these regularity conditions fail to hold. "Non-regular estimation" literally means the theory of statistical estimation when some or other of the regularity conditions fail to hold. In this monograph, the authors present a systematic study of the meaning and implications of regularity conditions, and show how the relaxation of such conditions can often lead to surprising conclusions. Their emphasis is on considering small sample results and to show how pathological examples may be considered in this broader framework.




Asymptotic Efficiency of Statistical Estimators: Concepts and Higher Order Asymptotic Efficiency


Book Description

This monograph is a collection of results recently obtained by the authors. Most of these have been published, while others are awaitlng publication. Our investigation has two main purposes. Firstly, we discuss higher order asymptotic efficiency of estimators in regular situa tions. In these situations it is known that the maximum likelihood estimator (MLE) is asymptotically efficient in some (not always specified) sense. However, there exists here a whole class of asymptotically efficient estimators which are thus asymptotically equivalent to the MLE. It is required to make finer distinctions among the estimators, by considering higher order terms in the expansions of their asymptotic distributions. Secondly, we discuss asymptotically efficient estimators in non regular situations. These are situations where the MLE or other estimators are not asymptotically normally distributed, or where l 2 their order of convergence (or consistency) is not n / , as in the regular cases. It is necessary to redefine the concept of asympto tic efficiency, together with the concept of the maximum order of consistency. Under the new definition as asymptotically efficient estimator may not always exist. We have not attempted to tell the whole story in a systematic way. The field of asymptotic theory in statistical estimation is relatively uncultivated. So, we have tried to focus attention on such aspects of our recent results which throw light on the area.




Asymptotic Statistics


Book Description

This book is an introduction to the field of asymptotic statistics. The treatment is both practical and mathematically rigorous. In addition to most of the standard topics of an asymptotics course, including likelihood inference, M-estimation, the theory of asymptotic efficiency, U-statistics, and rank procedures, the book also presents recent research topics such as semiparametric models, the bootstrap, and empirical processes and their applications. The topics are organized from the central idea of approximation by limit experiments, which gives the book one of its unifying themes. This entails mainly the local approximation of the classical i.i.d. set up with smooth parameters by location experiments involving a single, normally distributed observation. Thus, even the standard subjects of asymptotic statistics are presented in a novel way. Suitable as a graduate or Master s level statistics text, this book will also give researchers an overview of the latest research in asymptotic statistics.







Asymptotic Theory Of Quantum Statistical Inference: Selected Papers


Book Description

Quantum statistical inference, a research field with deep roots in the foundations of both quantum physics and mathematical statistics, has made remarkable progress since 1990. In particular, its asymptotic theory has been developed during this period. However, there has hitherto been no book covering this remarkable progress after 1990; the famous textbooks by Holevo and Helstrom deal only with research results in the earlier stage (1960s-1970s).This book presents the important and recent results of quantum statistical inference. It focuses on the asymptotic theory, which is one of the central issues of mathematical statistics and had not been investigated in quantum statistical inference until the early 1980s. It contains outstanding papers after Holevo's textbook, some of which are of great importance but are not available now.The reader is expected to have only elementary mathematical knowledge, and therefore much of the content will be accessible to graduate students as well as research workers in related fields. Introductions to quantum statistical inference have been specially written for the book. Asymptotic Theory of Quantum Statistical Inference: Selected Papers will give the reader a new insight into physics and statistical inference.




A Course in Large Sample Theory


Book Description

A Course in Large Sample Theory is presented in four parts. The first treats basic probabilistic notions, the second features the basic statistical tools for expanding the theory, the third contains special topics as applications of the general theory, and the fourth covers more standard statistical topics. Nearly all topics are covered in their multivariate setting.The book is intended as a first year graduate course in large sample theory for statisticians. It has been used by graduate students in statistics, biostatistics, mathematics, and related fields. Throughout the book there are many examples and exercises with solutions. It is an ideal text for self study.




Joint Statistical Papers Of Akahira And Takeuchi


Book Description

Masafumi Akahira and Kei Takeuchi have collaborated in research on mathematical statistics for nearly thirty years and have published many articles and papers. This volume is a collection of their papers, some published in well-known and others in lesser-known journals. The papers cover various fields, but the main subject is the theory of estimation — asymptotic, non-regular, sequential, etc. All the papers are theoretical in nature, but have implications for applied problems.




Contemporary Developments in Statistical Theory


Book Description

This volume highlights Prof. Hira Koul’s achievements in many areas of Statistics, including Asymptotic theory of statistical inference, Robustness, Weighted empirical processes and their applications, Survival Analysis, Nonlinear time series and Econometrics, among others. Chapters are all original papers that explore the frontiers of these areas and will assist researchers and graduate students working in Statistics, Econometrics and related areas. Prof. Hira Koul was the first Ph.D. student of Prof. Peter Bickel. His distinguished career in Statistics includes the receipt of many prestigious awards, including the Senior Humbolt award (1995), and dedicated service to the profession through editorial work for journals and through leadership roles in professional societies, notably as the past president of the International Indian Statistical Association. Prof. Hira Koul has graduated close to 30 Ph.D. students, and made several seminal contributions in about 125 innovative research papers. The long list of his distinguished collaborators is represented by the contributors to this volume.