Fundamental Statistical Inference


Book Description

A hands-on approach to statistical inference that addresses the latest developments in this ever-growing field This clear and accessible book for beginning graduate students offers a practical and detailed approach to the field of statistical inference, providing complete derivations of results, discussions, and MATLAB programs for computation. It emphasizes details of the relevance of the material, intuition, and discussions with a view towards very modern statistical inference. In addition to classic subjects associated with mathematical statistics, topics include an intuitive presentation of the (single and double) bootstrap for confidence interval calculations, shrinkage estimation, tail (maximal moment) estimation, and a variety of methods of point estimation besides maximum likelihood, including use of characteristic functions, and indirect inference. Practical examples of all methods are given. Estimation issues associated with the discrete mixtures of normal distribution, and their solutions, are developed in detail. Much emphasis throughout is on non-Gaussian distributions, including details on working with the stable Paretian distribution and fast calculation of the noncentral Student's t. An entire chapter is dedicated to optimization, including development of Hessian-based methods, as well as heuristic/genetic algorithms that do not require continuity, with MATLAB codes provided. The book includes both theory and nontechnical discussions, along with a substantial reference to the literature, with an emphasis on alternative, more modern approaches. The recent literature on the misuse of hypothesis testing and p-values for model selection is discussed, and emphasis is given to alternative model selection methods, though hypothesis testing of distributional assumptions is covered in detail, notably for the normal distribution. Presented in three parts—Essential Concepts in Statistics; Further Fundamental Concepts in Statistics; and Additional Topics—Fundamental Statistical Inference: A Computational Approach offers comprehensive chapters on: Introducing Point and Interval Estimation; Goodness of Fit and Hypothesis Testing; Likelihood; Numerical Optimization; Methods of Point Estimation; Q-Q Plots and Distribution Testing; Unbiased Point Estimation and Bias Reduction; Analytic Interval Estimation; Inference in a Heavy-Tailed Context; The Method of Indirect Inference; and, as an appendix, A Review of Fundamental Concepts in Probability Theory, the latter to keep the book self-contained, and giving material on some advanced subjects such as saddlepoint approximations, expected shortfall in finance, calculation with the stable Paretian distribution, and convergence theorems and proofs.




Statistical Inference


Book Description

A concise, easily accessible introduction to descriptive and inferential techniques Statistical Inference: A Short Course offers a concise presentation of the essentials of basic statistics for readers seeking to acquire a working knowledge of statistical concepts, measures, and procedures. The author conducts tests on the assumption of randomness and normality, provides nonparametric methods when parametric approaches might not work. The book also explores how to determine a confidence interval for a population median while also providing coverage of ratio estimation, randomness, and causality. To ensure a thorough understanding of all key concepts, Statistical Inference provides numerous examples and solutions along with complete and precise answers to many fundamental questions, including: How do we determine that a given dataset is actually a random sample? With what level of precision and reliability can a population sample be estimated? How are probabilities determined and are they the same thing as odds? How can we predict the level of one variable from that of another? What is the strength of the relationship between two variables? The book is organized to present fundamental statistical concepts first, with later chapters exploring more advanced topics and additional statistical tests such as Distributional Hypotheses, Multinomial Chi-Square Statistics, and the Chi-Square Distribution. Each chapter includes appendices and exercises, allowing readers to test their comprehension of the presented material. Statistical Inference: A Short Course is an excellent book for courses on probability, mathematical statistics, and statistical inference at the upper-undergraduate and graduate levels. The book also serves as a valuable reference for researchers and practitioners who would like to develop further insights into essential statistical tools.




Principles of Statistical Inference


Book Description

In this definitive book, D. R. Cox gives a comprehensive and balanced appraisal of statistical inference. He develops the key concepts, describing and comparing the main ideas and controversies over foundational issues that have been keenly argued for more than two-hundred years. Continuing a sixty-year career of major contributions to statistical thought, no one is better placed to give this much-needed account of the field. An appendix gives a more personal assessment of the merits of different ideas. The content ranges from the traditional to the contemporary. While specific applications are not treated, the book is strongly motivated by applications across the sciences and associated technologies. The mathematics is kept as elementary as feasible, though previous knowledge of statistics is assumed. The book will be valued by every user or student of statistics who is serious about understanding the uncertainty inherent in conclusions from statistical analyses.




Probability and Statistical Inference


Book Description

Now updated in a valuable new edition—this user-friendly book focuses on understanding the "why" of mathematical statistics Probability and Statistical Inference, Second Edition introduces key probability and statis-tical concepts through non-trivial, real-world examples and promotes the developmentof intuition rather than simple application. With its coverage of the recent advancements in computer-intensive methods, this update successfully provides the comp-rehensive tools needed to develop a broad understanding of the theory of statisticsand its probabilistic foundations. This outstanding new edition continues to encouragereaders to recognize and fully understand the why, not just the how, behind the concepts,theorems, and methods of statistics. Clear explanations are presented and appliedto various examples that help to impart a deeper understanding of theorems and methods—from fundamental statistical concepts to computational details. Additional features of this Second Edition include: A new chapter on random samples Coverage of computer-intensive techniques in statistical inference featuring Monte Carlo and resampling methods, such as bootstrap and permutation tests, bootstrap confidence intervals with supporting R codes, and additional examples available via the book's FTP site Treatment of survival and hazard function, methods of obtaining estimators, and Bayes estimating Real-world examples that illuminate presented concepts Exercises at the end of each section Providing a straightforward, contemporary approach to modern-day statistical applications, Probability and Statistical Inference, Second Edition is an ideal text for advanced undergraduate- and graduate-level courses in probability and statistical inference. It also serves as a valuable reference for practitioners in any discipline who wish to gain further insight into the latest statistical tools.




Aspects of Statistical Inference


Book Description

Relevant, concrete, and thorough--the essential data-based text onstatistical inference The ability to formulate abstract concepts and draw conclusionsfrom data is fundamental to mastering statistics. Aspects ofStatistical Inference equips advanced undergraduate and graduatestudents with a comprehensive grounding in statistical inference,including nonstandard topics such as robustness, randomization, andfinite population inference. A. H. Welsh goes beyond the standard texts and expertly synthesizesbroad, critical theory with concrete data and relevant topics. Thetext follows a historical framework, uses real-data sets andstatistical graphics, and treats multiparameter problems, yet isultimately about the concepts themselves. Written with clarity and depth, Aspects of Statistical Inference: * Provides a theoretical and historical grounding in statisticalinference that considers Bayesian, fiducial, likelihood, andfrequentist approaches * Illustrates methods with real-data sets on diabetic retinopathy,the pharmacological effects of caffeine, stellar velocity, andindustrial experiments * Considers multiparameter problems * Develops large sample approximations and shows how to use them * Presents the philosophy and application of robustness theory * Highlights the central role of randomization in statistics * Uses simple proofs to illuminate foundational concepts * Contains an appendix of useful facts concerning expansions,matrices, integrals, and distribution theory Here is the ultimate data-based text for comparing and presentingthe latest approaches to statistical inference.




Introduction to the Theory of Statistical Inference


Book Description

Based on the authors' lecture notes, this text presents concise yet complete coverage of statistical inference theory, focusing on the fundamental classical principles. Unlike related textbooks, it combines the theoretical basis of statistical inference with a useful applied toolbox that includes linear models. Suitable for a second semester undergraduate course on statistical inference, the text offers proofs to support the mathematics and does not require any use of measure theory. It illustrates core concepts using cartoons and provides solutions to all examples and problems.




Probability and Statistical Inference


Book Description

Probability and Statistical Inference: From Basic Principles to Advanced Models covers aspects of probability, distribution theory, and inference that are fundamental to a proper understanding of data analysis and statistical modelling. It presents these topics in an accessible manner without sacrificing mathematical rigour, bridging the gap between the many excellent introductory books and the more advanced, graduate-level texts. The book introduces and explores techniques that are relevant to modern practitioners, while being respectful to the history of statistical inference. It seeks to provide a thorough grounding in both the theory and application of statistics, with even the more abstract parts placed in the context of a practical setting. Features: •Complete introduction to mathematical probability, random variables, and distribution theory. •Concise but broad account of statistical modelling, covering topics such as generalised linear models, survival analysis, time series, and random processes. •Extensive discussion of the key concepts in classical statistics (point estimation, interval estimation, hypothesis testing) and the main techniques in likelihood-based inference. •Detailed introduction to Bayesian statistics and associated topics. •Practical illustration of some of the main computational methods used in modern statistical inference (simulation, boostrap, MCMC). This book is for students who have already completed a first course in probability and statistics, and now wish to deepen and broaden their understanding of the subject. It can serve as a foundation for advanced undergraduate or postgraduate courses. Our aim is to challenge and excite the more mathematically able students, while providing explanations of statistical concepts that are more detailed and approachable than those in advanced texts. This book is also useful for data scientists, researchers, and other applied practitioners who want to understand the theory behind the statistical methods used in their fields.




Asymptotic Statistical Inference


Book Description

The book presents the fundamental concepts from asymptotic statistical inference theory, elaborating on some basic large sample optimality properties of estimators and some test procedures. The most desirable property of consistency of an estimator and its large sample distribution, with suitable normalization, are discussed, the focus being on the consistent and asymptotically normal (CAN) estimators. It is shown that for the probability models belonging to an exponential family and a Cramer family, the maximum likelihood estimators of the indexing parameters are CAN. The book describes some large sample test procedures, in particular, the most frequently used likelihood ratio test procedure. Various applications of the likelihood ratio test procedure are addressed, when the underlying probability model is a multinomial distribution. These include tests for the goodness of fit and tests for contingency tables. The book also discusses a score test and Wald’s test, their relationship with the likelihood ratio test and Karl Pearson’s chi-square test. An important finding is that, while testing any hypothesis about the parameters of a multinomial distribution, a score test statistic and Karl Pearson’s chi-square test statistic are identical. Numerous illustrative examples of differing difficulty level are incorporated to clarify the concepts. For better assimilation of the notions, various exercises are included in each chapter. Solutions to almost all the exercises are given in the last chapter, to motivate students towards solving these exercises and to enable digestion of the underlying concepts. The concepts from asymptotic inference are crucial in modern statistics, but are difficult to grasp in view of their abstract nature. To overcome this difficulty, keeping up with the recent trend of using R software for statistical computations, the book uses it extensively, for illustrating the concepts, verifying the properties of estimators and carrying out various test procedures. The last section of the chapters presents R codes to reveal and visually demonstrate the hidden aspects of different concepts and procedures. Augmenting the theory with R software is a novel and a unique feature of the book. The book is designed primarily to serve as a text book for a one semester introductory course in asymptotic statistical inference, in a post-graduate program, such as Statistics, Bio-statistics or Econometrics. It will also provide sufficient background information for studying inference in stochastic processes. The book will cater to the need of a concise but clear and student-friendly book introducing, conceptually and computationally, basics of asymptotic inference.




Modes of Parametric Statistical Inference


Book Description

A fascinating investigation into the foundations of statistical inference This publication examines the distinct philosophical foundations of different statistical modes of parametric inference. Unlike many other texts that focus on methodology and applications, this book focuses on a rather unique combination of theoretical and foundational aspects that underlie the field of statistical inference. Readers gain a deeper understanding of the evolution and underlying logic of each mode as well as each mode's strengths and weaknesses. The book begins with fascinating highlights from the history of statistical inference. Readers are given historical examples of statistical reasoning used to address practical problems that arose throughout the centuries. Next, the book goes on to scrutinize four major modes of statistical inference: * Frequentist * Likelihood * Fiducial * Bayesian The author provides readers with specific examples and counterexamples of situations and datasets where the modes yield both similar and dissimilar results, including a violation of the likelihood principle in which Bayesian and likelihood methods differ from frequentist methods. Each example is followed by a detailed discussion of why the results may have varied from one mode to another, helping the reader to gain a greater understanding of each mode and how it works. Moreover, the author provides considerable mathematical detail on certain points to highlight key aspects of theoretical development. The author's writing style and use of examples make the text clear and engaging. This book is fundamental reading for graduate-level students in statistics as well as anyone with an interest in the foundations of statistics and the principles underlying statistical inference, including students in mathematics and the philosophy of science. Readers with a background in theoretical statistics will find the text both accessible and absorbing.




Aspects of Statistical Inference


Book Description

Relevant, concrete, and thorough--the essential data-based text onstatistical inference The ability to formulate abstract concepts and draw conclusionsfrom data is fundamental to mastering statistics. Aspects ofStatistical Inference equips advanced undergraduate and graduatestudents with a comprehensive grounding in statistical inference,including nonstandard topics such as robustness, randomization, andfinite population inference. A. H. Welsh goes beyond the standard texts and expertly synthesizesbroad, critical theory with concrete data and relevant topics. Thetext follows a historical framework, uses real-data sets andstatistical graphics, and treats multiparameter problems, yet isultimately about the concepts themselves. Written with clarity and depth, Aspects of Statistical Inference: * Provides a theoretical and historical grounding in statisticalinference that considers Bayesian, fiducial, likelihood, andfrequentist approaches * Illustrates methods with real-data sets on diabetic retinopathy,the pharmacological effects of caffeine, stellar velocity, andindustrial experiments * Considers multiparameter problems * Develops large sample approximations and shows how to use them * Presents the philosophy and application of robustness theory * Highlights the central role of randomization in statistics * Uses simple proofs to illuminate foundational concepts * Contains an appendix of useful facts concerning expansions,matrices, integrals, and distribution theory Here is the ultimate data-based text for comparing and presentingthe latest approaches to statistical inference.