Empirical Process Techniques for Dependent Data


Book Description

Empirical process techniques for independent data have been used for many years in statistics and probability theory. These techniques have proved very useful for studying asymptotic properties of parametric as well as non-parametric statistical procedures. Recently, the need to model the dependence structure in data sets from many different subject areas such as finance, insurance, and telecommunications has led to new developments concerning the empirical distribution function and the empirical process for dependent, mostly stationary sequences. This work gives an introduction to this new theory of empirical process techniques, which has so far been scattered in the statistical and probabilistic literature, and surveys the most recent developments in various related fields. Key features: A thorough and comprehensive introduction to the existing theory of empirical process techniques for dependent data * Accessible surveys by leading experts of the most recent developments in various related fields * Examines empirical process techniques for dependent data, useful for studying parametric and non-parametric statistical procedures * Comprehensive bibliographies * An overview of applications in various fields related to empirical processes: e.g., spectral analysis of time-series, the bootstrap for stationary sequences, extreme value theory, and the empirical process for mixing dependent observations, including the case of strong dependence. To date this book is the only comprehensive treatment of the topic in book literature. It is an ideal introductory text that will serve as a reference or resource for classroom use in the areas of statistics, time-series analysis, extreme value theory, point process theory, and applied probability theory. Contributors: P. Ango Nze, M.A. Arcones, I. Berkes, R. Dahlhaus, J. Dedecker, H.G. Dehling,




Introduction to Empirical Processes and Semiparametric Inference


Book Description

Kosorok’s brilliant text provides a self-contained introduction to empirical processes and semiparametric inference. These powerful research techniques are surprisingly useful for developing methods of statistical inference for complex models and in understanding the properties of such methods. This is an authoritative text that covers all the bases, and also a friendly and gradual introduction to the area. The book can be used as research reference and textbook.







Empirical Processes


Book Description




High-Dimensional Probability


Book Description

An integrated package of powerful probabilistic tools and key applications in modern mathematical data science.




Oracle Inequalities in Empirical Risk Minimization and Sparse Recovery Problems


Book Description

The purpose of these lecture notes is to provide an introduction to the general theory of empirical risk minimization with an emphasis on excess risk bounds and oracle inequalities in penalized problems. In recent years, there have been new developments in this area motivated by the study of new classes of methods in machine learning such as large margin classification methods (boosting, kernel machines). The main probabilistic tools involved in the analysis of these problems are concentration and deviation inequalities by Talagrand along with other methods of empirical processes theory (symmetrization inequalities, contraction inequality for Rademacher sums, entropy and generic chaining bounds). Sparse recovery based on l_1-type penalization and low rank matrix recovery based on the nuclear norm penalization are other active areas of research, where the main problems can be stated in the framework of penalized empirical risk minimization, and concentration inequalities and empirical processes tools have proved to be very useful.




Functional Gaussian Approximation for Dependent Structures


Book Description

Functional Gaussian Approximation for Dependent Structures develops and analyses mathematical models for phenomena that evolve in time and influence each another. It provides a better understanding of the structure and asymptotic behaviour of stochastic processes. Two approaches are taken. Firstly, the authors present tools for dealing with the dependent structures used to obtain normal approximations. Secondly, they apply normal approximations to various examples. The main tools consist of inequalities for dependent sequences of random variables, leading to limit theorems, including the functional central limit theorem and functional moderate deviation principle. The results point out large classes of dependent random variables which satisfy invariance principles, making possible the statistical study of data coming from stochastic processes both with short and long memory. The dependence structures considered throughout the book include the traditional mixing structures, martingale-like structures, and weakly negatively dependent structures, which link the notion of mixing to the notions of association and negative dependence. Several applications are carefully selected to exhibit the importance of the theoretical results. They include random walks in random scenery and determinantal processes. In addition, due to their importance in analysing new data in economics, linear processes with dependent innovations will also be considered and analysed.




Statistical Inference for Discrete Time Stochastic Processes


Book Description

This work is an overview of statistical inference in stationary, discrete time stochastic processes. Results in the last fifteen years, particularly on non-Gaussian sequences and semi-parametric and non-parametric analysis have been reviewed. The first chapter gives a background of results on martingales and strong mixing sequences, which enable us to generate various classes of CAN estimators in the case of dependent observations. Topics discussed include inference in Markov chains and extension of Markov chains such as Raftery's Mixture Transition Density model and Hidden Markov chains and extensions of ARMA models with a Binomial, Poisson, Geometric, Exponential, Gamma, Weibull, Lognormal, Inverse Gaussian and Cauchy as stationary distributions. It further discusses applications of semi-parametric methods of estimation such as conditional least squares and estimating functions in stochastic models. Construction of confidence intervals based on estimating functions is discussed in some detail. Kernel based estimation of joint density and conditional expectation are also discussed. Bootstrap and other resampling procedures for dependent sequences such as Markov chains, Markov sequences, linear auto-regressive moving average sequences, block based bootstrap for stationary sequences and other block based procedures are also discussed in some detail. This work can be useful for researchers interested in knowing developments in inference in discrete time stochastic processes. It can be used as a material for advanced level research students.




Empirical Likelihood


Book Description

Empirical likelihood provides inferences whose validity does not depend on specifying a parametric model for the data. Because it uses a likelihood, the method has certain inherent advantages over resampling methods: it uses the data to determine the shape of the confidence regions, and it makes it easy to combined data from multiple sources. It al




Contemporary Developments in Statistical Theory


Book Description

This volume highlights Prof. Hira Koul’s achievements in many areas of Statistics, including Asymptotic theory of statistical inference, Robustness, Weighted empirical processes and their applications, Survival Analysis, Nonlinear time series and Econometrics, among others. Chapters are all original papers that explore the frontiers of these areas and will assist researchers and graduate students working in Statistics, Econometrics and related areas. Prof. Hira Koul was the first Ph.D. student of Prof. Peter Bickel. His distinguished career in Statistics includes the receipt of many prestigious awards, including the Senior Humbolt award (1995), and dedicated service to the profession through editorial work for journals and through leadership roles in professional societies, notably as the past president of the International Indian Statistical Association. Prof. Hira Koul has graduated close to 30 Ph.D. students, and made several seminal contributions in about 125 innovative research papers. The long list of his distinguished collaborators is represented by the contributors to this volume.