Modelling and Application of Stochastic Processes


Book Description

The subject of modelling and application of stochastic processes is too vast to be exhausted in a single volume. In this book, attention is focused on a small subset of this vast subject. The primary emphasis is on realization and approximation of stochastic systems. Recently there has been considerable interest in the stochastic realization problem, and hence, an attempt has been made here to collect in one place some of the more recent approaches and algorithms for solving the stochastic realiza tion problem. Various different approaches for realizing linear minimum-phase systems, linear nonminimum-phase systems, and bilinear systems are presented. These approaches range from time-domain methods to spectral-domain methods. An overview of the chapter contents briefly describes these approaches. Also, in most of these chapters special attention is given to the problem of developing numerically ef ficient algorithms for obtaining reduced-order (approximate) stochastic realizations. On the application side, chapters on use of Markov random fields for modelling and analyzing image signals, use of complementary models for the smoothing problem with missing data, and nonlinear estimation are included. Chapter 1 by Klein and Dickinson develops the nested orthogonal state space realization for ARMA processes. As suggested by the name, nested orthogonal realizations possess two key properties; (i) the state variables are orthogonal, and (ii) the system matrices for the (n + l)st order realization contain as their "upper" n-th order blocks the system matrices from the n-th order realization (nesting property).




An Introduction to Stochastic Modeling


Book Description

An Introduction to Stochastic Modeling provides information pertinent to the standard concepts and methods of stochastic modeling. This book presents the rich diversity of applications of stochastic processes in the sciences. Organized into nine chapters, this book begins with an overview of diverse types of stochastic models, which predicts a set of possible outcomes weighed by their likelihoods or probabilities. This text then provides exercises in the applications of simple stochastic analysis to appropriate problems. Other chapters consider the study of general functions of independent, identically distributed, nonnegative random variables representing the successive intervals between renewals. This book discusses as well the numerous examples of Markov branching processes that arise naturally in various scientific disciplines. The final chapter deals with queueing models, which aid the design process by predicting system performance. This book is a valuable resource for students of engineering and management science. Engineers will also find this book useful.




Stochastic Models With Applications To Genetics, Cancers, Aids And Other Biomedical Systems


Book Description

This book presents a systematic treatment of Markov chains, diffusion processes and state space models, as well as alternative approaches to Markov chains through stochastic difference equations and stochastic differential equations. It illustrates how these processes and approaches are applied to many problems in genetics, carcinogenesis, AIDS epidemiology and other biomedical systems.One feature of the book is that it describes the basic MCMC (Markov chain and Monte Carlo) procedures and illustrates how to use the Gibbs sampling method and the multilevel Gibbs sampling method to solve many problems in genetics, carcinogenesis, AIDS and other biomedical systems.As another feature, the book develops many state space models for many genetic problems, carcinogenesis, AIDS epidemiology and HIV pathogenesis. It shows in detail how to use the multilevel Gibbs sampling method to estimate (or predict) simultaneously the state variables and the unknown parameters in cancer chemotherapy, carcinogenesis, AIDS epidemiology and HIV pathogenesis. As a matter of fact, this book is the first to develop many state space models for many genetic problems, carcinogenesis and other biomedical problems.




Stochastic Modelling of Social Processes


Book Description

Stochastic Modelling of Social Processes provides information pertinent to the development in the field of stochastic modeling and its applications in the social sciences. This book demonstrates that stochastic models can fulfill the goals of explanation and prediction. Organized into nine chapters, this book begins with an overview of stochastic models that fulfill normative, predictive, and structural–analytic roles with the aid of the theory of probability. This text then examines the study of labor market structures using analysis of job and career mobility, which is one of the approaches taken by sociologists in research on the labor market. Other chapters consider the characteristic trends and patterns from data on divorces. This book discusses as well the two approaches of stochastic modeling of social processes, namely competing risk models and semi-Markov processes. The final chapter deals with the practical application of regression models of survival data. This book is a valuable resource for social scientists and statisticians.




Generalized Stochastic Processes


Book Description

This textbook shall serve a double purpose: first of all, it is a book about generalized stochastic processes, a very important but highly neglected part of probability theory which plays an outstanding role in noise modelling. Secondly, this textbook is a guide to noise modelling for mathematicians and engineers to foster the interdisciplinary discussion between mathematicians (to provide effective noise models) and engineers (to be familiar with the mathematical backround of noise modelling in order to handle noise models in an optimal way).Two appendices on "A Short Course in Probability Theory" and "Spectral Theory of Stochastic Processes" plus a well-choosen set of problems and solutions round this compact textbook off.




Stochastic Processes: Modeling and Simulation


Book Description

This sequel to volume 19 of Handbook on Statistics on Stochastic Processes: Modelling and Simulation is concerned mainly with the theme of reviewing and, in some cases, unifying with new ideas the different lines of research and developments in stochastic processes of applied flavour. This volume consists of 23 chapters addressing various topics in stochastic processes. These include, among others, those on manufacturing systems, random graphs, reliability, epidemic modelling, self-similar processes, empirical processes, time series models, extreme value therapy, applications of Markov chains, modelling with Monte Carlo techniques, and stochastic processes in subjects such as engineering, telecommunications, biology, astronomy and chemistry. particular with modelling, simulation techniques and numerical methods concerned with stochastic processes. The scope of the project involving this volume as well as volume 19 is already clarified in the preface of volume 19. The present volume completes the aim of the project and should serve as an aid to students, teachers, researchers and practitioners interested in applied stochastic processes.




Basics of Applied Stochastic Processes


Book Description

Stochastic processes are mathematical models of random phenomena that evolve according to prescribed dynamics. Processes commonly used in applications are Markov chains in discrete and continuous time, renewal and regenerative processes, Poisson processes, and Brownian motion. This volume gives an in-depth description of the structure and basic properties of these stochastic processes. A main focus is on equilibrium distributions, strong laws of large numbers, and ordinary and functional central limit theorems for cost and performance parameters. Although these results differ for various processes, they have a common trait of being limit theorems for processes with regenerative increments. Extensive examples and exercises show how to formulate stochastic models of systems as functions of a system’s data and dynamics, and how to represent and analyze cost and performance measures. Topics include stochastic networks, spatial and space-time Poisson processes, queueing, reversible processes, simulation, Brownian approximations, and varied Markovian models. The technical level of the volume is between that of introductory texts that focus on highlights of applied stochastic processes, and advanced texts that focus on theoretical aspects of processes.




On the Use of Stochastic Processes in Modeling Reliability Problems


Book Description

Stochastic processes are powerful tools for the investigation of reliability and availability of repairable equipment and systems. Because of the involved models, and in order to be mathematically tractable, these processes are generally confined to the class of regenerative stochastic processes with a finite state space, to which belong: renewal processes, Markov processes, semi-Markov processes, and more general regenerative processes with only one (or a few) regeneration staters). The object of this monograph is to review these processes and to use them in solving some reliability problems encountered in practical applications. Emphasis is given to a comprehensive exposition of the analytical procedures, to the limitations in volved, and to the unification and extension of. the models known in the literature. The models investigated here assume. that systems have only one repair crew and that no further failure can occur at system down. Repair and failure rates are general ized step-by-step, up to the case in which the involved process is regenerative with only one (or a few) regeneration state(s). Investigations deal with different kinds of reliabilities and availabilities for series/parallel structures. Preventive main tenance and imperfect switching are considered in some examples.




Algebraic Structures and Applications


Book Description

This book explores the latest advances in algebraic structures and applications, and focuses on mathematical concepts, methods, structures, problems, algorithms and computational methods important in the natural sciences, engineering and modern technologies. In particular, it features mathematical methods and models of non-commutative and non-associative algebras, hom-algebra structures, generalizations of differential calculus, quantum deformations of algebras, Lie algebras and their generalizations, semi-groups and groups, constructive algebra, matrix analysis and its interplay with topology, knot theory, dynamical systems, functional analysis, stochastic processes, perturbation analysis of Markov chains, and applications in network analysis, financial mathematics and engineering mathematics. The book addresses both theory and applications, which are illustrated with a wealth of ideas, proofs and examples to help readers understand the material and develop new mathematical methods and concepts of their own. The high-quality chapters share a wealth of new methods and results, review cutting-edge research and discuss open problems and directions for future research. Taken together, they offer a source of inspiration for a broad range of researchers and research students whose work involves algebraic structures and their applications, probability theory and mathematical statistics, applied mathematics, engineering mathematics and related areas.




Stochastic Processes and Applications


Book Description

This book presents various results and techniques from the theory of stochastic processes that are useful in the study of stochastic problems in the natural sciences. The main focus is analytical methods, although numerical methods and statistical inference methodologies for studying diffusion processes are also presented. The goal is the development of techniques that are applicable to a wide variety of stochastic models that appear in physics, chemistry and other natural sciences. Applications such as stochastic resonance, Brownian motion in periodic potentials and Brownian motors are studied and the connection between diffusion processes and time-dependent statistical mechanics is elucidated. The book contains a large number of illustrations, examples, and exercises. It will be useful for graduate-level courses on stochastic processes for students in applied mathematics, physics and engineering. Many of the topics covered in this book (reversible diffusions, convergence to equilibrium for diffusion processes, inference methods for stochastic differential equations, derivation of the generalized Langevin equation, exit time problems) cannot be easily found in textbook form and will be useful to both researchers and students interested in the applications of stochastic processes.