Optimal Design of Experiments


Book Description

Optimal Design of Experiments offers a rare blend of linear algebra, convex analysis, and statistics. The optimal design for statistical experiments is first formulated as a concave matrix optimization problem. Using tools from convex analysis, the problem is solved generally for a wide class of optimality criteria such as D-, A-, or E-optimality. The book then offers a complementary approach that calls for the study of the symmetry properties of the design problem, exploiting such notions as matrix majorization and the Kiefer matrix ordering. The results are illustrated with optimal designs for polynomial fit models, Bayes designs, balanced incomplete block designs, exchangeable designs on the cube, rotatable designs on the sphere, and many other examples.




Model Calibration and Parameter Estimation


Book Description

This three-part book provides a comprehensive and systematic introduction to these challenging topics such as model calibration, parameter estimation, reliability assessment, and data collection design. Part 1 covers the classical inverse problem for parameter estimation in both deterministic and statistical frameworks, Part 2 is dedicated to system identification, hyperparameter estimation, and model dimension reduction, and Part 3 considers how to collect data and construct reliable models for prediction and decision-making. For the first time, topics such as multiscale inversion, stochastic field parameterization, level set method, machine learning, global sensitivity analysis, data assimilation, model uncertainty quantification, robust design, and goal-oriented modeling, are systematically described and summarized in a single book from the perspective of model inversion, and elucidated with numerical examples from environmental and water resources modeling. Readers of this book will not only learn basic concepts and methods for simple parameter estimation, but also get familiar with advanced methods for modeling complex systems. Algorithms for mathematical tools used in this book, such as numerical optimization, automatic differentiation, adaptive parameterization, hierarchical Bayesian, metamodeling, Markov chain Monte Carlo, are covered in details. This book can be used as a reference for graduate and upper level undergraduate students majoring in environmental engineering, hydrology, and geosciences. It also serves as an essential reference book for professionals such as petroleum engineers, mining engineers, chemists, mechanical engineers, biologists, biology and medical engineering, applied mathematicians, and others who perform mathematical modeling.




Applied Linear Statistical Models


Book Description

Linear regression with one predictor variable; Inferences in regression and correlation analysis; Diagnosticis and remedial measures; Simultaneous inferences and other topics in regression analysis; Matrix approach to simple linear regression analysis; Multiple linear regression; Nonlinear regression; Design and analysis of single-factor studies; Multi-factor studies; Specialized study designs.




The Oxford Handbook of Applied Bayesian Analysis


Book Description

Bayesian analysis has developed rapidly in applications in the last two decades and research in Bayesian methods remains dynamic and fast-growing. Dramatic advances in modelling concepts and computational technologies now enable routine application of Bayesian analysis using increasingly realistic stochastic models, and this drives the adoption of Bayesian approaches in many areas of science, technology, commerce, and industry. This Handbook explores contemporary Bayesian analysis across a variety of application areas. Chapters written by leading exponents of applied Bayesian analysis showcase the scientific ease and natural application of Bayesian modelling, and present solutions to real, engaging, societally important and demanding problems. The chapters are grouped into five general areas: Biomedical & Health Sciences; Industry, Economics & Finance; Environment & Ecology; Policy, Political & Social Sciences; and Natural & Engineering Sciences, and Appendix material in each touches on key concepts, models, and techniques of the chapter that are also of broader pedagogic and applied interest.




Bayesian Data Analysis, Third Edition


Book Description

Now in its third edition, this classic book is widely considered the leading text on Bayesian methods, lauded for its accessible, practical approach to analyzing data and solving research problems. Bayesian Data Analysis, Third Edition continues to take an applied approach to analysis using up-to-date Bayesian methods. The authors—all leaders in the statistics community—introduce basic concepts from a data-analytic perspective before presenting advanced methods. Throughout the text, numerous worked examples drawn from real applications and research emphasize the use of Bayesian inference in practice. New to the Third Edition Four new chapters on nonparametric modeling Coverage of weakly informative priors and boundary-avoiding priors Updated discussion of cross-validation and predictive information criteria Improved convergence monitoring and effective sample size calculations for iterative simulation Presentations of Hamiltonian Monte Carlo, variational Bayes, and expectation propagation New and revised software code The book can be used in three different ways. For undergraduate students, it introduces Bayesian inference starting from first principles. For graduate students, the text presents effective current approaches to Bayesian modeling and computation in statistics and related fields. For researchers, it provides an assortment of Bayesian methods in applied statistics. Additional materials, including data sets used in the examples, solutions to selected exercises, and software instructions, are available on the book’s web page.




Probability and Bayesian Statistics


Book Description

This book contains selected and refereed contributions to the "Inter national Symposium on Probability and Bayesian Statistics" which was orga nized to celebrate the 80th birthday of Professor Bruno de Finetti at his birthplace Innsbruck in Austria. Since Professor de Finetti died in 1985 the symposium was dedicated to the memory of Bruno de Finetti and took place at Igls near Innsbruck from 23 to 26 September 1986. Some of the pa pers are published especially by the relationship to Bruno de Finetti's scientific work. The evolution of stochastics shows growing importance of probability as coherent assessment of numerical values as degrees of believe in certain events. This is the basis for Bayesian inference in the sense of modern statistics. The contributions in this volume cover a broad spectrum ranging from foundations of probability across psychological aspects of formulating sub jective probability statements, abstract measure theoretical considerations, contributions to theoretical statistics and stochastic processes, to real applications in economics, reliability and hydrology. Also the question is raised if it is necessary to develop new techniques to model and analyze fuzzy observations in samples. The articles are arranged in alphabetical order according to the family name of the first author of each paper to avoid a hierarchical ordering of importance of the different topics. Readers interested in special topics can use the index at the end of the book as guide.







Bayesian Probability Theory


Book Description

From the basics to the forefront of modern research, this book presents all aspects of probability theory, statistics and data analysis from a Bayesian perspective for physicists and engineers. The book presents the roots, applications and numerical implementation of probability theory, and covers advanced topics such as maximum entropy distributions, stochastic processes, parameter estimation, model selection, hypothesis testing and experimental design. In addition, it explores state-of-the art numerical techniques required to solve demanding real-world problems. The book is ideal for students and researchers in physical sciences and engineering.




Sequential Analysis and Optimal Design


Book Description

An exploration of the interrelated fields of design of experiments and sequential analysis with emphasis on the nature of theoretical statistics and how this relates to the philosophy and practice of statistics.