The Estimation of Probabilities


Book Description

The problem of how to estimate probabilities has interested philosophers, statisticians, actuaries, and mathematicians for a long time. It is currently of interest for automatic recognition, medical diagnosis, and artificial intelligence in general. The main purpose of this monograph is to review existing methods, especially those that are new or have not been written up in a connected manner. The need for nontrivial theory arises because our samples are usually too small for us to rely exclusively on the frequency definition of probability. Most of the techniques described in this book depend on a modern Bayesian approach. The maximum-entropy principle, also relevant to this discussion, is used in the last chapter. It is hoped that the book will stimulate further work in a field whose importance will increasingly be recognized. Methods for estimating probabilities are related to another part of statistics, namely, significance testing, and examples of this relationship are also presented. Many readers will be persuaded by this work that it is necessary to make use of a theory of subjective probability in order to estimate physical probabilities; and also that a useful idea is that of a hierarchy of three types of probability which can sometimes be identified with, physical, logical, and subjective probabilities. The Estimation of Probabilities is intended for statisticians, probabilists, philosophers of science, mathematicians, medical diagnosticians, and workers on artificial intelligence.




The Estimation Of Probabilities


Book Description

The problem of how to estimate probabilities has interested philosophers, statisticians, actuaries, and mathematicians for a long time. It is currently of interest for automatic recognition, medical diagnosis, and artificial intelligence in general. This monograph reviews existing methods, including those that are new or have not been written up in a connected manner. The problem of how to estimate probabilities has interested philosophers, statisticians, actuaries, and mathematicians for a long time. It is currently of interest for automatic recognition, medical diagnosis, and artificial intelligence in general. The main purpose of this monograph is to review existing methods, especially those that are new or have not been written about in an organized way. The need for nontrivial theory arises because our samples are usually too small for us to rely exclusively on the frequency definition of probability. Most of the techniques described in this book depend on a modern Bayesian approach. The maximum-entropy principle, also relevant to this discussion, is used in the last chapter. It is hoped that the book will stimulate further work in a field whose importance will increasingly be recognized. Methods for estimating probabilities are related to another part of statistics, namely, significance testing, and example of this relationship are also presented. Many readers will be persuaded by this work that it is necessary to make use of a theory of subjective probability in order to estimate physical probabilities and also that a useful idea is that of a hierarchy of three types of probability which can sometimes be identified with physical, logical, and subjective probabilities.




Estimation of Rare Event Probabilities in Complex Aerospace and Other Systems


Book Description

Rare event probability (10-4 and less) estimation has become a large area of research in the reliability engineering and system safety domains. A significant number of methods have been proposed to reduce the computation burden for the estimation of rare events from advanced sampling approaches to extreme value theory. However, it is often difficult in practice to determine which algorithm is the most adapted to a given problem.Estimation of Rare Event Probabilities in Complex Aerospace and Other Systems: A Practical Approach provides a broad up-to-date view of the current available techniques to estimate rare event probabilities described with a unified notation, a mathematical pseudocode to ease their potential implementation and finally a large spectrum of simulation results on academic and realistic use cases. Provides a broad overview of the practical approach of rare event methods. Includes algorithms that are applied to aerospace benchmark test cases Offers insight into practical tuning issues




Estimating and Choosing


Book Description

Ever since the beginning of modern probability theory in the seventeenth century there has been a continuous debate over the meaning and applicability of the concept of probability. This book presents a coherent and well thoughtout framework for the use of probabilistic models to describe unique phenomena in a purely objective way. Although Estimating and Choosing was written with geostatistical applications in mind, the approach is of general applicability across the whole spectrum of probabilistic modelling. The only full-fledged treatment of the foundations of practical probability modelling ever written, this book fills an important gap in the literature of probability and statistics.




Sequential Estimation


Book Description

The only comprehensive guide to the theory and practice of one oftoday's most important probabilistic techniques The past 15 years have witnessed many significant advances insequential estimation, especially in the areas of three-stage andnonparametric methodology. Yet, until now, there were no referencesdevoted exclusively to this rapidly growing statisticalfield. Sequential Estimation is the first, single-source guide to thetheory and practice of both classical and modern sequentialestimation techniques--including parametric and nonparametricmethods. Researchers in sequential analysis will appreciate theunified, logically integrated treatment of the subject, as well ascoverage of important contemporary procedures not covered in moregeneral sequential analysis texts, such as: * Shrinkage estimation * Empirical and hierarchical Bayes procedures * Multistage sampling and accelerated sampling procedures * Time-sequential estimation * Sequential estimation in finite population sampling * Reliability estimation and capture-recapture methodologiesleading to sequential tagging schemes An indispensable resource for researchers in sequential analysis,Sequential Estimation is an ideal graduate-level text as well.




Probability, Random Variables, Statistics, and Random Processes


Book Description

Probability, Random Variables, Statistics, and Random Processes: Fundamentals & Applications is a comprehensive undergraduate-level textbook. With its excellent topical coverage, the focus of this book is on the basic principles and practical applications of the fundamental concepts that are extensively used in various Engineering disciplines as well as in a variety of programs in Life and Social Sciences. The text provides students with the requisite building blocks of knowledge they require to understand and progress in their areas of interest. With a simple, clear-cut style of writing, the intuitive explanations, insightful examples, and practical applications are the hallmarks of this book. The text consists of twelve chapters divided into four parts. Part-I, Probability (Chapters 1 – 3), lays a solid groundwork for probability theory, and introduces applications in counting, gambling, reliability, and security. Part-II, Random Variables (Chapters 4 – 7), discusses in detail multiple random variables, along with a multitude of frequently-encountered probability distributions. Part-III, Statistics (Chapters 8 – 10), highlights estimation and hypothesis testing. Part-IV, Random Processes (Chapters 11 – 12), delves into the characterization and processing of random processes. Other notable features include: Most of the text assumes no knowledge of subject matter past first year calculus and linear algebra With its independent chapter structure and rich choice of topics, a variety of syllabi for different courses at the junior, senior, and graduate levels can be supported A supplemental website includes solutions to about 250 practice problems, lecture slides, and figures and tables from the text Given its engaging tone, grounded approach, methodically-paced flow, thorough coverage, and flexible structure, Probability, Random Variables, Statistics, and Random Processes: Fundamentals & Applications clearly serves as a must textbook for courses not only in Electrical Engineering, but also in Computer Engineering, Software Engineering, and Computer Science.










Neural Networks for Conditional Probability Estimation


Book Description

Conventional applications of neural networks usually predict a single value as a function of given inputs. In forecasting, for example, a standard objective is to predict the future value of some entity of interest on the basis of a time series of past measurements or observations. Typical training schemes aim to minimise the sum of squared deviations between predicted and actual values (the 'targets'), by which, ideally, the network learns the conditional mean of the target given the input. If the underlying conditional distribution is Gaus sian or at least unimodal, this may be a satisfactory approach. However, for a multimodal distribution, the conditional mean does not capture the relevant features of the system, and the prediction performance will, in general, be very poor. This calls for a more powerful and sophisticated model, which can learn the whole conditional probability distribution. Chapter 1 demonstrates that even for a deterministic system and 'be nign' Gaussian observational noise, the conditional distribution of a future observation, conditional on a set of past observations, can become strongly skewed and multimodal. In Chapter 2, a general neural network structure for modelling conditional probability densities is derived, and it is shown that a universal approximator for this extended task requires at least two hidden layers. A training scheme is developed from a maximum likelihood approach in Chapter 3, and the performance ofthis method is demonstrated on three stochastic time series in chapters 4 and 5.




A Mathematical Primer for Social Statistics


Book Description

A Mathematical Primer for Social Statistics, Second Edition presents mathematics central to learning and understanding statistical methods beyond the introductory level: the basic "language" of matrices and linear algebra and its visual representation, vector geometry; differential and integral calculus; probability theory; common probability distributions; statistical estimation and inference, including likelihood-based and Bayesian methods. The volume concludes by applying mathematical concepts and operations to a familiar case, linear least-squares regression. The Second Edition pays more attention to visualization, including the elliptical geometry of quadratic forms and its application to statistics. It also covers some new topics, such as an introduction to Markov-Chain Monte Carlo methods, which are important in modern Bayesian statistics. A companion website includes materials that enable readers to use the R statistical computing environment to reproduce and explore computations and visualizations presented in the text. The book is an excellent companion to a "math camp" or a course designed to provide foundational mathematics needed to understand relatively advanced statistical methods.