Analyticity and Sparsity in Uncertainty Quantification for PDEs with Gaussian Random Field Inputs


Book Description

The present book develops the mathematical and numerical analysis of linear, elliptic and parabolic partial differential equations (PDEs) with coefficients whose logarithms are modelled as Gaussian random fields (GRFs), in polygonal and polyhedral physical domains. Both, forward and Bayesian inverse PDE problems subject to GRF priors are considered. Adopting a pathwise, affine-parametric representation of the GRFs, turns the random PDEs into equivalent, countably-parametric, deterministic PDEs, with nonuniform ellipticity constants. A detailed sparsity analysis of Wiener-Hermite polynomial chaos expansions of the corresponding parametric PDE solution families by analytic continuation into the complex domain is developed, in corner- and edge-weighted function spaces on the physical domain. The presented Algorithms and results are relevant for the mathematical analysis of many approximation methods for PDEs with GRF inputs, such as model order reduction, neural network and tensor-formatted surrogates of parametric solution families. They are expected to impact computational uncertainty quantification subject to GRF models of uncertainty in PDEs, and are of interest for researchers and graduate students in both, applied and computational mathematics, as well as in computational science and engineering.




Markov Random Fields


Book Description

In this book we study Markov random functions of several variables. What is traditionally meant by the Markov property for a random process (a random function of one time variable) is connected to the concept of the phase state of the process and refers to the independence of the behavior of the process in the future from its behavior in the past, given knowledge of its state at the present moment. Extension to a generalized random process immediately raises nontrivial questions about the definition of a suitable" phase state," so that given the state, future behavior does not depend on past behavior. Attempts to translate the Markov property to random functions of multi-dimensional "time," where the role of "past" and "future" are taken by arbitrary complementary regions in an appro priate multi-dimensional time domain have, until comparatively recently, been carried out only in the framework of isolated examples. How the Markov property should be formulated for generalized random functions of several variables is the principal question in this book. We think that it has been substantially answered by recent results establishing the Markov property for a whole collection of different classes of random functions. These results are interesting for their applications as well as for the theory. In establishing them, we found it useful to introduce a general probability model which we have called a random field. In this book we investigate random fields on continuous time domains. Contents CHAPTER 1 General Facts About Probability Distributions §1.




Advanced Spatial Modeling with Stochastic Partial Differential Equations Using R and INLA


Book Description

Modeling spatial and spatio-temporal continuous processes is an important and challenging problem in spatial statistics. Advanced Spatial Modeling with Stochastic Partial Differential Equations Using R and INLA describes in detail the stochastic partial differential equations (SPDE) approach for modeling continuous spatial processes with a Matérn covariance, which has been implemented using the integrated nested Laplace approximation (INLA) in the R-INLA package. Key concepts about modeling spatial processes and the SPDE approach are explained with examples using simulated data and real applications. This book has been authored by leading experts in spatial statistics, including the main developers of the INLA and SPDE methodologies and the R-INLA package. It also includes a wide range of applications: * Spatial and spatio-temporal models for continuous outcomes * Analysis of spatial and spatio-temporal point patterns * Coregionalization spatial and spatio-temporal models * Measurement error spatial models * Modeling preferential sampling * Spatial and spatio-temporal models with physical barriers * Survival analysis with spatial effects * Dynamic space-time regression * Spatial and spatio-temporal models for extremes * Hurdle models with spatial effects * Penalized Complexity priors for spatial models All the examples in the book are fully reproducible. Further information about this book, as well as the R code and datasets used, is available from the book website at http://www.r-inla.org/spde-book. The tools described in this book will be useful to researchers in many fields such as biostatistics, spatial statistics, environmental sciences, epidemiology, ecology and others. Graduate and Ph.D. students will also find this book and associated files a valuable resource to learn INLA and the SPDE approach for spatial modeling.




High-Dimensional Probability


Book Description

An integrated package of powerful probabilistic tools and key applications in modern mathematical data science.




Random Fields and Geometry


Book Description

This monograph is devoted to a completely new approach to geometric problems arising in the study of random fields. The groundbreaking material in Part III, for which the background is carefully prepared in Parts I and II, is of both theoretical and practical importance, and striking in the way in which problems arising in geometry and probability are beautifully intertwined. "Random Fields and Geometry" will be useful for probabilists and statisticians, and for theoretical and applied mathematicians who wish to learn about new relationships between geometry and probability. It will be helpful for graduate students in a classroom setting, or for self-study. Finally, this text will serve as a basic reference for all those interested in the companion volume of the applications of the theory.




Level Sets and Extrema of Random Processes and Fields


Book Description

A timely and comprehensive treatment of random field theory with applications across diverse areas of study Level Sets and Extrema of Random Processes and Fields discusses how to understand the properties of the level sets of paths as well as how to compute the probability distribution of its extremal values, which are two general classes of problems that arise in the study of random processes and fields and in related applications. This book provides a unified and accessible approach to these two topics and their relationship to classical theory and Gaussian processes and fields, and the most modern research findings are also discussed. The authors begin with an introduction to the basic concepts of stochastic processes, including a modern review of Gaussian fields and their classical inequalities. Subsequent chapters are devoted to Rice formulas, regularity properties, and recent results on the tails of the distribution of the maximum. Finally, applications of random fields to various areas of mathematics are provided, specifically to systems of random equations and condition numbers of random matrices. Throughout the book, applications are illustrated from various areas of study such as statistics, genomics, and oceanography while other results are relevant to econometrics, engineering, and mathematical physics. The presented material is reinforced by end-of-chapter exercises that range in varying degrees of difficulty. Most fundamental topics are addressed in the book, and an extensive, up-to-date bibliography directs readers to existing literature for further study. Level Sets and Extrema of Random Processes and Fields is an excellent book for courses on probability theory, spatial statistics, Gaussian fields, and probabilistic methods in real computation at the upper-undergraduate and graduate levels. It is also a valuable reference for professionals in mathematics and applied fields such as statistics, engineering, econometrics, mathematical physics, and biology.




Random Fields for Spatial Data Modeling


Book Description

This book provides an inter-disciplinary introduction to the theory of random fields and its applications. Spatial models and spatial data analysis are integral parts of many scientific and engineering disciplines. Random fields provide a general theoretical framework for the development of spatial models and their applications in data analysis. The contents of the book include topics from classical statistics and random field theory (regression models, Gaussian random fields, stationarity, correlation functions) spatial statistics (variogram estimation, model inference, kriging-based prediction) and statistical physics (fractals, Ising model, simulated annealing, maximum entropy, functional integral representations, perturbation and variational methods). The book also explores links between random fields, Gaussian processes and neural networks used in machine learning. Connections with applied mathematics are highlighted by means of models based on stochastic partial differential equations. An interlude on autoregressive time series provides useful lower-dimensional analogies and a connection with the classical linear harmonic oscillator. Other chapters focus on non-Gaussian random fields and stochastic simulation methods. The book also presents results based on the author’s research on Spartan random fields that were inspired by statistical field theories originating in physics. The equivalence of the one-dimensional Spartan random field model with the classical, linear, damped harmonic oscillator driven by white noise is highlighted. Ideas with potentially significant computational gains for the processing of big spatial data are presented and discussed. The final chapter concludes with a description of the Karhunen-Loève expansion of the Spartan model. The book will appeal to engineers, physicists, and geoscientists whose research involves spatial models or spatial data analysis. Anyone with background in probability and statistics can read at least parts of the book. Some chapters will be easier to understand by readers familiar with differential equations and Fourier transforms.




The Geometry of Random Fields


Book Description

An important treatment of the geometric properties of sets generated by random fields, including a comprehensive treatment of the mathematical basics of random fields in general. It is a standard reference for all researchers with an interest in random fields, whether they be theoreticians or come from applied areas.




Numerical Methods for Stochastic Partial Differential Equations with White Noise


Book Description

This book covers numerical methods for stochastic partial differential equations with white noise using the framework of Wong-Zakai approximation. The book begins with some motivational and background material in the introductory chapters and is divided into three parts. Part I covers numerical stochastic ordinary differential equations. Here the authors start with numerical methods for SDEs with delay using the Wong-Zakai approximation and finite difference in time. Part II covers temporal white noise. Here the authors consider SPDEs as PDEs driven by white noise, where discretization of white noise (Brownian motion) leads to PDEs with smooth noise, which can then be treated by numerical methods for PDEs. In this part, recursive algorithms based on Wiener chaos expansion and stochastic collocation methods are presented for linear stochastic advection-diffusion-reaction equations. In addition, stochastic Euler equations are exploited as an application of stochastic collocation methods, where a numerical comparison with other integration methods in random space is made. Part III covers spatial white noise. Here the authors discuss numerical methods for nonlinear elliptic equations as well as other equations with additive noise. Numerical methods for SPDEs with multiplicative noise are also discussed using the Wiener chaos expansion method. In addition, some SPDEs driven by non-Gaussian white noise are discussed and some model reduction methods (based on Wick-Malliavin calculus) are presented for generalized polynomial chaos expansion methods. Powerful techniques are provided for solving stochastic partial differential equations. This book can be considered as self-contained. Necessary background knowledge is presented in the appendices. Basic knowledge of probability theory and stochastic calculus is presented in Appendix A. In Appendix B some semi-analytical methods for SPDEs are presented. In Appendix C an introduction to Gauss quadrature is provided. In Appendix D, all the conclusions which are needed for proofs are presented, and in Appendix E a method to compute the convergence rate empirically is included. In addition, the authors provide a thorough review of the topics, both theoretical and computational exercises in the book with practical discussion of the effectiveness of the methods. Supporting Matlab files are made available to help illustrate some of the concepts further. Bibliographic notes are included at the end of each chapter. This book serves as a reference for graduate students and researchers in the mathematical sciences who would like to understand state-of-the-art numerical methods for stochastic partial differential equations with white noise.




Partial Differential Equations in Action


Book Description

The book is intended as an advanced undergraduate or first-year graduate course for students from various disciplines, including applied mathematics, physics and engineering. It has evolved from courses offered on partial differential equations (PDEs) over the last several years at the Politecnico di Milano. These courses had a twofold purpose: on the one hand, to teach students to appreciate the interplay between theory and modeling in problems arising in the applied sciences, and on the other to provide them with a solid theoretical background in numerical methods, such as finite elements. Accordingly, this textbook is divided into two parts. The first part, chapters 2 to 5, is more elementary in nature and focuses on developing and studying basic problems from the macro-areas of diffusion, propagation and transport, waves and vibrations. In turn the second part, chapters 6 to 11, concentrates on the development of Hilbert spaces methods for the variational formulation and the analysis of (mainly) linear boundary and initial-boundary value problems.