Two-Scale Stochastic Systems


Book Description

Two-scale systems described by singularly perturbed SDEs have been the subject of ample literature. However, this new monograph develops subjects that were rarely addressed and could be given the collective description "Stochastic Tikhonov-Levinson theory and its applications." The book provides a mathematical apparatus designed to analyze the dynamic behaviour of a randomly perturbed system with fast and slow variables. In contrast to the deterministic Tikhonov-Levinson theory, the basic model is described in a more realistic way by stochastic differential equations. This leads to a number of new theoretical questions but simultaneously allows us to treat in a unified way a surprisingly wide spectrum of applications like fast modulations, approximate filtering, and stochastic approximation.Two-scale systems described by singularly perturbed SDEs have been the subject of ample literature. However, this new monograph develops subjects that were rarely addressed and could be given the collective description "Stochastic Tikhonov-Levinson theory and its applications." The book provides a mathematical apparatus designed to analyze the dynamic behaviour of a randomly perturbed system with fast and slow variables. In contrast to the deterministic Tikhonov-Levinson theory, the basic model is described in a more realistic way by stochastic differential equations. This leads to a number of new theoretical questions but simultaneously allows us to treat in a unified way a surprisingly wide spectrum of applications like fast modulations, approximate filtering, and stochastic approximation.




Complex Stochastic Systems


Book Description

Complex stochastic systems comprises a vast area of research, from modelling specific applications to model fitting, estimation procedures, and computing issues. The exponential growth in computing power over the last two decades has revolutionized statistical analysis and led to rapid developments and great progress in this emerging field. In Complex Stochastic Systems, leading researchers address various statistical aspects of the field, illustrated by some very concrete applications. A Primer on Markov Chain Monte Carlo by Peter J. Green provides a wide-ranging mixture of the mathematical and statistical ideas, enriched with concrete examples and more than 100 references. Causal Inference from Graphical Models by Steffen L. Lauritzen explores causal concepts in connection with modelling complex stochastic systems, with focus on the effect of interventions in a given system. State Space and Hidden Markov Models by Hans R. Künschshows the variety of applications of this concept to time series in engineering, biology, finance, and geophysics. Monte Carlo Methods on Genetic Structures by Elizabeth A. Thompson investigates special complex systems and gives a concise introduction to the relevant biological methodology. Renormalization of Interacting Diffusions by Frank den Hollander presents recent results on the large space-time behavior of infinite systems of interacting diffusions. Stein's Method for Epidemic Processes by Gesine Reinert investigates the mean field behavior of a general stochastic epidemic with explicit bounds. Individually, these articles provide authoritative, tutorial-style exposition and recent results from various subjects related to complex stochastic systems. Collectively, they link these separate areas of study to form the first comprehensive overview of this rapidly developing field.




Discrete-Time Markov Chains


Book Description

Focusing on discrete-time-scale Markov chains, the contents of this book are an outgrowth of some of the authors' recent research. The motivation stems from existing and emerging applications in optimization and control of complex hybrid Markovian systems in manufacturing, wireless communication, and financial engineering. Much effort in this book is devoted to designing system models arising from these applications, analyzing them via analytic and probabilistic techniques, and developing feasible computational algorithms so as to reduce the inherent complexity. This book presents results including asymptotic expansions of probability vectors, structural properties of occupation measures, exponential bounds, aggregation and decomposition and associated limit processes, and interface of discrete-time and continuous-time systems. One of the salient features is that it contains a diverse range of applications on filtering, estimation, control, optimization, and Markov decision processes, and financial engineering. This book will be an important reference for researchers in the areas of applied probability, control theory, operations research, as well as for practitioners who use optimization techniques. Part of the book can also be used in a graduate course of applied probability, stochastic processes, and applications.




Stochastic Systems in Merging Phase Space


Book Description

This book provides recent results on the stochastic approximation of systems by weak convergence techniques. General and particular schemes of proofs for average, diffusion, and Poisson approximations of stochastic systems are presented, allowing one to simplify complex systems and obtain numerically tractable models.The systems discussed in the book include stochastic additive functionals, dynamical systems, stochastic integral functionals, increment processes and impulsive processes. All these systems are switched by Markov and semi-Markov processes whose phase space is considered in asymptotic split and merging schemes. Most of the results from semi-Markov processes are new and presented for the first time in this book.




Control and System Theory of Discrete-Time Stochastic Systems


Book Description

This book helps students, researchers, and practicing engineers to understand the theoretical framework of control and system theory for discrete-time stochastic systems so that they can then apply its principles to their own stochastic control systems and to the solution of control, filtering, and realization problems for such systems. Applications of the theory in the book include the control of ships, shock absorbers, traffic and communications networks, and power systems with fluctuating power flows. The focus of the book is a stochastic control system defined for a spectrum of probability distributions including Bernoulli, finite, Poisson, beta, gamma, and Gaussian distributions. The concepts of observability and controllability of a stochastic control system are defined and characterized. Each output process considered is, with respect to conditions, represented by a stochastic system called a stochastic realization. The existence of a control law is related to stochastic controllability while the existence of a filter system is related to stochastic observability. Stochastic control with partial observations is based on the existence of a stochastic realization of the filtration of the observed process.​




Stochastic Models of Systems


Book Description

In this monograph stochastic models of systems analysis are discussed. It covers many aspects and different stages from the construction of mathematical models of real systems, through mathematical analysis of models based on simplification methods, to the interpretation of real stochastic systems. The stochastic models described here share the property that their evolutionary aspects develop under the influence of random factors. It has been assumed that the evolution takes place in a random medium, i.e. unilateral interaction between the system and the medium. As only Markovian models of random medium are considered in this book, the stochastic models described here are determined by two processes, a switching process describing the evolution of the systems and a switching process describing the changes of the random medium. Audience: This book will be of interest to postgraduate students and researchers whose work involves probability theory, stochastic processes, mathematical systems theory, ordinary differential equations, operator theory, or mathematical modelling and industrial mathematics.




Multiple Time Scale Dynamics


Book Description

This book provides an introduction to dynamical systems with multiple time scales. The approach it takes is to provide an overview of key areas, particularly topics that are less available in the introductory form. The broad range of topics included makes it accessible for students and researchers new to the field to gain a quick and thorough overview. The first of its kind, this book merges a wide variety of different mathematical techniques into a more unified framework. The book is highly illustrated with many examples and exercises and an extensive bibliography. The target audience of this book are senior undergraduates, graduate students as well as researchers interested in using the multiple time scale dynamics theory in nonlinear science, either from a theoretical or a mathematical modeling perspective.




From Stochastic Calculus to Mathematical Finance


Book Description

Dedicated to the Russian mathematician Albert Shiryaev on his 70th birthday, this is a collection of papers written by his former students, co-authors and colleagues. The book represents the modern state of art of a quickly maturing theory and will be an essential source and reading for researchers in this area. Diversity of topics and comprehensive style of the papers make the book attractive for PhD students and young researchers.




Discrete-Time Semi-Markov Random Evolutions and Their Applications


Book Description

This book extends the theory and applications of random evolutions to semi-Markov random media in discrete time, essentially focusing on semi-Markov chains as switching or driving processes. After giving the definitions of discrete-time semi-Markov chains and random evolutions, it presents the asymptotic theory in a functional setting, including weak convergence results in the series scheme, and their extensions in some additional directions, including reduced random media, controlled processes, and optimal stopping. Finally, applications of discrete-time semi-Markov random evolutions in epidemiology and financial mathematics are discussed. This book will be of interest to researchers and graduate students in applied mathematics and statistics, and other disciplines, including engineering, epidemiology, finance and economics, who are concerned with stochastic models of systems.




Information-Spectrum Methods in Information Theory


Book Description

From the reviews: "This book nicely complements the existing literature on information and coding theory by concentrating on arbitrary nonstationary and/or nonergodic sources and channels with arbitrarily large alphabets. Even with such generality the authors have managed to successfully reach a highly unconventional but very fertile exposition rendering new insights into many problems." -- MATHEMATICAL REVIEWS