Discretization and MCMC Convergence Assessment


Book Description

The exponential increase in the use of MCMC methods and the corre sponding applications in domains of even higher complexity have caused a growing concern about the available convergence assessment methods and the realization that some of these methods were not reliable enough for all-purpose analyses. Some researchers have mainly focussed on the con vergence to stationarity and the estimation of rates of convergence, in rela tion with the eigenvalues of the transition kernel. This monograph adopts a different perspective by developing (supposedly) practical devices to assess the mixing behaviour of the chain under study and, more particularly, it proposes methods based on finite (state space) Markov chains which are obtained either through a discretization of the original Markov chain or through a duality principle relating a continuous state space Markov chain to another finite Markov chain, as in missing data or latent variable models. The motivation for the choice of finite state spaces is that, although the resulting control is cruder, in the sense that it can often monitor con vergence for the discretized version alone, it is also much stricter than alternative methods, since the tools available for finite Markov chains are universal and the resulting transition matrix can be estimated more accu rately. Moreover, while some setups impose a fixed finite state space, other allow for possible refinements in the discretization level and for consecutive improvements in the convergence monitoring.




Elements of Computational Statistics


Book Description

Will provide a more elementary introduction to these topics than other books available; Gentle is the author of two other Springer books




Stochastic Processes: Modeling and Simulation


Book Description

This sequel to volume 19 of Handbook on Statistics on Stochastic Processes: Modelling and Simulation is concerned mainly with the theme of reviewing and, in some cases, unifying with new ideas the different lines of research and developments in stochastic processes of applied flavour. This volume consists of 23 chapters addressing various topics in stochastic processes. These include, among others, those on manufacturing systems, random graphs, reliability, epidemic modelling, self-similar processes, empirical processes, time series models, extreme value therapy, applications of Markov chains, modelling with Monte Carlo techniques, and stochastic processes in subjects such as engineering, telecommunications, biology, astronomy and chemistry. particular with modelling, simulation techniques and numerical methods concerned with stochastic processes. The scope of the project involving this volume as well as volume 19 is already clarified in the preface of volume 19. The present volume completes the aim of the project and should serve as an aid to students, teachers, researchers and practitioners interested in applied stochastic processes.




Random Number Generation and Monte Carlo Methods


Book Description

Monte Carlo simulation has become one of the most important tools in all fields of science. Simulation methodology relies on a good source of numbers that appear to be random. These "pseudorandom" numbers must pass statistical tests just as random samples would. Methods for producing pseudorandom numbers and transforming those numbers to simulate samples from various distributions are among the most important topics in statistical computing. This book surveys techniques of random number generation and the use of random numbers in Monte Carlo simulation. The book covers basic principles, as well as newer methods such as parallel random number generation, nonlinear congruential generators, quasi Monte Carlo methods, and Markov chain Monte Carlo. The best methods for generating random variates from the standard distributions are presented, but also general techniques useful in more complicated models and in novel settings are described. The emphasis throughout the book is on practical methods that work well in current computing environments. The book includes exercises and can be used as a test or supplementary text for various courses in modern statistics. It could serve as the primary test for a specialized course in statistical computing, or as a supplementary text for a course in computational statistics and other areas of modern statistics that rely on simulation. The book, which covers recent developments in the field, could also serve as a useful reference for practitioners. Although some familiarity with probability and statistics is assumed, the book is accessible to a broad audience. The second edition is approximately 50% longer than the first edition. It includes advances in methods for parallel random number generation, universal methods for generation of nonuniform variates, perfect sampling, and software for random number generation.




Case Studies in Bayesian Statistical Modelling and Analysis


Book Description

Provides an accessible foundation to Bayesian analysis using real world models This book aims to present an introduction to Bayesian modelling and computation, by considering real case studies drawn from diverse fields spanning ecology, health, genetics and finance. Each chapter comprises a description of the problem, the corresponding model, the computational method, results and inferences as well as the issues that arise in the implementation of these approaches. Case Studies in Bayesian Statistical Modelling and Analysis: Illustrates how to do Bayesian analysis in a clear and concise manner using real-world problems. Each chapter focuses on a real-world problem and describes the way in which the problem may be analysed using Bayesian methods. Features approaches that can be used in a wide area of application, such as, health, the environment, genetics, information science, medicine, biology, industry and remote sensing. Case Studies in Bayesian Statistical Modelling and Analysis is aimed at statisticians, researchers and practitioners who have some expertise in statistical modelling and analysis, and some understanding of the basics of Bayesian statistics, but little experience in its application. Graduate students of statistics and biostatistics will also find this book beneficial.




The Bayesian Choice


Book Description

This is an introduction to Bayesian statistics and decision theory, including advanced topics such as Monte Carlo methods. This new edition contains several revised chapters and a new chapter on model choice.




Bayesian Thinking, Modeling and Computation


Book Description

This volume describes how to develop Bayesian thinking, modelling and computation both from philosophical, methodological and application point of view. It further describes parametric and nonparametric Bayesian methods for modelling and how to use modern computational methods to summarize inferences using simulation. The book covers wide range of topics including objective and subjective Bayesian inferences with a variety of applications in modelling categorical, survival, spatial, spatiotemporal, Epidemiological, software reliability, small area and micro array data. The book concludes with a chapter on how to teach Bayesian thoughts to nonstatisticians. Critical thinking on causal effects Objective Bayesian philosophy Nonparametric Bayesian methodology Simulation based computing techniques Bioinformatics and Biostatistics




Approximating Integrals via Monte Carlo and Deterministic Methods


Book Description

This book is designed to introduce graduate students and researchers to the primary methods useful for approximating integrals. The emphasis is on those methods that have been found to be of practical use, and although the focus is on approximating higher- dimensional integrals the lower-dimensional case is also covered. Included in the book are asymptotic techniques, multiple quadrature and quasi-random techniques as well as a complete development of Monte Carlo algorithms. For the Monte Carlo section importance sampling methods, variance reduction techniques and the primary Markov Chain Monte Carlo algorithms are covered. This book brings these various techniques together for the first time, and hence provides an accessible textbook and reference for researchers in a wide variety of disciplines.




Finite Mixture Models


Book Description

An up-to-date, comprehensive account of major issues in finitemixture modeling This volume provides an up-to-date account of the theory andapplications of modeling via finite mixture distributions. With anemphasis on the applications of mixture models in both mainstreamanalysis and other areas such as unsupervised pattern recognition,speech recognition, and medical imaging, the book describes theformulations of the finite mixture approach, details itsmethodology, discusses aspects of its implementation, andillustrates its application in many common statisticalcontexts. Major issues discussed in this book include identifiabilityproblems, actual fitting of finite mixtures through use of the EMalgorithm, properties of the maximum likelihood estimators soobtained, assessment of the number of components to be used in themixture, and the applicability of asymptotic theory in providing abasis for the solutions to some of these problems. The author alsoconsiders how the EM algorithm can be scaled to handle the fittingof mixture models to very large databases, as in data miningapplications. This comprehensive, practical guide: * Provides more than 800 references-40% published since 1995 * Includes an appendix listing available mixture software * Links statistical literature with machine learning and patternrecognition literature * Contains more than 100 helpful graphs, charts, and tables Finite Mixture Models is an important resource for both applied andtheoretical statisticians as well as for researchers in the manyareas in which finite mixture models can be used to analyze data.




Monte Carlo Methods


Book Description

This volume contains the proceedings of the Workshop on Monte Carlo Methods held at The Fields Institute for Research in Mathematical Sciences (Toronto, 1998). The workshop brought together researchers in physics, statistics, and probability. The papers in this volume - of the invited speakers and contributors to the poster session - represent the interdisciplinary emphasis of the conference. Monte Carlo methods have been used intensively in many branches of scientific inquiry. Markov chain methods have been at the forefront of much of this work, serving as the basis of many numerical studies in statistical physics and related areas since the Metropolis algorithm was introduced in 1953. Statisticians and theoretical computer scientists have used these methods in recent years, working on different fundamental research questions, yet using similar Monte Carlo methodology. This volume focuses on Monte Carlo methods that appear to have wide applicability and emphasizes new methods, practical applications and theoretical analysis. It will be of interest to researchers and graduate students who study and/or use Monte Carlo methods in areas of probability, statistics, theoretical physics, or computer science.