Analyzing Markov Chains using Kronecker Products


Book Description

Kronecker products are used to define the underlying Markov chain (MC) in various modeling formalisms, including compositional Markovian models, hierarchical Markovian models, and stochastic process algebras. The motivation behind using a Kronecker structured representation rather than a flat one is to alleviate the storage requirements associated with the MC. With this approach, systems that are an order of magnitude larger can be analyzed on the same platform. The developments in the solution of such MCs are reviewed from an algebraic point of view and possible areas for further research are indicated with an emphasis on preprocessing using reordering, grouping, and lumping and numerical analysis using block iterative, preconditioned projection, multilevel, decompositional, and matrix analytic methods. Case studies from closed queueing networks and stochastic chemical kinetics are provided to motivate decompositional and matrix analytic methods, respectively.




Kronecker Modeling and Analysis of Multidimensional Markovian Systems


Book Description

This work considers Kronecker-based models with finite as well as countably infinite state spaces for multidimensional Markovian systems by paying particular attention to those whose reachable state spaces are smaller than their product state spaces. Numerical methods for steady-state and transient analysis of Kronecker-based multidimensional Markovian models are discussed in detail together with implementation issues. Case studies are provided to explain concepts and motivate use of methods. Having grown out of research from the past twenty years, this book expands upon the author’s previously published book Analyzing Markov Chains using Kronecker Products (Springer, 2012). The subject matter is interdisciplinary and at the intersection of applied mathematics and computer science. The book will be of use to researchers and graduate students with an understanding of basic linear algebra, probability, and discrete mathematics.




Introduction to Matrix Analytic Methods in Queues 1


Book Description

Matrix-analytic methods (MAM) were introduced by Professor Marcel Neuts and have been applied to a variety of stochastic models since. In order to provide a clear and deep understanding of MAM while showing their power, this book presents MAM concepts and explains the results using a number of worked-out examples. This book’s approach will inform and kindle the interest of researchers attracted to this fertile field. To allow readers to practice and gain experience in the algorithmic and computational procedures of MAM, Introduction to Matrix Analytic Methods in Queues 1 provides a number of computational exercises. It also incorporates simulation as another tool for studying complex stochastic models, especially when the state space of the underlying stochastic models under analytic study grows exponentially. The book’s detailed approach will make it more accessible for readers interested in learning about MAM in stochastic models.




Quantitative Evaluation of Systems


Book Description

This book constitutes the proceedings of the 13th International Conference on Quantitative Evaluation Systems, QEST 2016, held in Quebec City, Canada, in August 2016. The 21 full papers and 3 tool demonstration papers presented were carefully reviewed and selected from 46 submissions. They are organized in topical sections entitled: Markov processes; tools; sampling, inference, and optimization methods; Markov decision processes and Markovian analysis; networks.




Reliability and Availability Engineering


Book Description

Do you need to know what technique to use to evaluate the reliability of an engineered system? This self-contained guide provides comprehensive coverage of all the analytical and modeling techniques currently in use, from classical non-state and state space approaches, to newer and more advanced methods such as binary decision diagrams, dynamic fault trees, Bayesian belief networks, stochastic Petri nets, non-homogeneous Markov chains, semi-Markov processes, and phase type expansions. Readers will quickly understand the relative pros and cons of each technique, as well as how to combine different models together to address complex, real-world modeling scenarios. Numerous examples, case studies and problems provided throughout help readers put knowledge into practice, and a solutions manual and Powerpoint slides for instructors accompany the book online. This is the ideal self-study guide for students, researchers and practitioners in engineering and computer science.




Input Modeling with Phase-Type Distributions and Markov Models


Book Description

Containing a summary of several recent results on Markov-based input modeling in a coherent notation, this book introduces and compares algorithms for parameter fitting and gives an overview of available software tools in the area. Due to progress made in recent years with respect to new algorithms to generate PH distributions and Markovian arrival processes from measured data, the models outlined are useful alternatives to other distributions or stochastic processes used for input modeling. Graduate students and researchers in applied probability, operations research and computer science along with practitioners using simulation or analytical models for performance analysis and capacity planning will find the unified notation and up-to-date results presented useful. Input modeling is the key step in model based system analysis to adequately describe the load of a system using stochastic models. The goal of input modeling is to find a stochastic model to describe a sequence of measurements from a real system to model for example the inter-arrival times of packets in a computer network or failure times of components in a manufacturing plant. Typical application areas are performance and dependability analysis of computer systems, communication networks, logistics or manufacturing systems but also the analysis of biological or chemical reaction networks and similar problems. Often the measured values have a high variability and are correlated. It’s been known for a long time that Markov based models like phase type distributions or Markovian arrival processes are very general and allow one to capture even complex behaviors. However, the parameterization of these models results often in a complex and non-linear optimization problem. Only recently, several new results about the modeling capabilities of Markov based models and algorithms to fit the parameters of those models have been published.​




Measurement, Modelling and Evaluation of Computing Systems


Book Description

This book constitutes the proceedings of the 19th International GI/ITG Conference on Measurement, Modelling and Evaluation of Computing Systems, MMB 2018, held in Erlangen, Germany, in February 2018. The 16 full papers, 4 PhD track papers, and 9 tool papers presented in this volume were carefully reviewed and selected from 42 submissions. They are dealing with performance and dependability evaluation techniques for computer and communication systems and its related fields.




Sensitivity Analysis: Matrix Methods in Demography and Ecology


Book Description

This open access book shows how to use sensitivity analysis in demography. It presents new methods for individuals, cohorts, and populations, with applications to humans, other animals, and plants. The analyses are based on matrix formulations of age-classified, stage-classified, and multistate population models. Methods are presented for linear and nonlinear, deterministic and stochastic, and time-invariant and time-varying cases. Readers will discover results on the sensitivity of statistics of longevity, life disparity, occupancy times, the net reproductive rate, and statistics of Markov chain models in demography. They will also see applications of sensitivity analysis to population growth rates, stable population structures, reproductive value, equilibria under immigration and nonlinearity, and population cycles. Individual stochasticity is a theme throughout, with a focus that goes beyond expected values to include variances in demographic outcomes. The calculations are easily and accurately implemented in matrix-oriented programming languages such as Matlab or R. Sensitivity analysis will help readers create models to predict the effect of future changes, to evaluate policy effects, and to identify possible evolutionary responses to the environment. Complete with many examples of the application, the book will be of interest to researchers and graduate students in human demography and population biology. The material will also appeal to those in mathematical biology and applied mathematics.




Matrix-Analytic Methods in Stochastic Models


Book Description

Matrix-analytic and related methods have become recognized as an important and fundamental approach for the mathematical analysis of general classes of complex stochastic models. Research in the area of matrix-analytic and related methods seeks to discover underlying probabilistic structures intrinsic in such stochastic models, develop numerical algorithms for computing functionals (e.g., performance measures) of the underlying stochastic processes, and apply these probabilistic structures and/or computational algorithms within a wide variety of fields. This volume presents recent research results on: the theory, algorithms and methodologies concerning matrix-analytic and related methods in stochastic models; and the application of matrix-analytic and related methods in various fields, which includes but is not limited to computer science and engineering, communication networks and telephony, electrical and industrial engineering, operations research, management science, financial and risk analysis, and bio-statistics. These research studies provide deep insights and understanding of the stochastic models of interest from a mathematics and/or applications perspective, as well as identify directions for future research.




Information Technologies and Mathematical Modelling. Queueing Theory and Applications


Book Description

This book constitutes the refereed proceedings of the 21st International Conference on Information Technologies and Mathematical Modelling. Queueing Theory and Applications, ITMM 2022, held in Karshi, Uzbekistan, during October 25–29, 2022. The 19 full papers included in this book were carefully reviewed and selected from 89 submissions. The papers are devoted to new results in queueing theory and its applications. Its target audience includes specialists in probabilistic theory, random processes, mathematical modeling as well as engineers engaged in logical and technical design and operational management of data processing systems, communication, and computer networks./div