Analyzing Markov Chains using Kronecker Products


Book Description

Kronecker products are used to define the underlying Markov chain (MC) in various modeling formalisms, including compositional Markovian models, hierarchical Markovian models, and stochastic process algebras. The motivation behind using a Kronecker structured representation rather than a flat one is to alleviate the storage requirements associated with the MC. With this approach, systems that are an order of magnitude larger can be analyzed on the same platform. The developments in the solution of such MCs are reviewed from an algebraic point of view and possible areas for further research are indicated with an emphasis on preprocessing using reordering, grouping, and lumping and numerical analysis using block iterative, preconditioned projection, multilevel, decompositional, and matrix analytic methods. Case studies from closed queueing networks and stochastic chemical kinetics are provided to motivate decompositional and matrix analytic methods, respectively.




Kronecker Modeling and Analysis of Multidimensional Markovian Systems


Book Description

This work considers Kronecker-based models with finite as well as countably infinite state spaces for multidimensional Markovian systems by paying particular attention to those whose reachable state spaces are smaller than their product state spaces. Numerical methods for steady-state and transient analysis of Kronecker-based multidimensional Markovian models are discussed in detail together with implementation issues. Case studies are provided to explain concepts and motivate use of methods. Having grown out of research from the past twenty years, this book expands upon the author’s previously published book Analyzing Markov Chains using Kronecker Products (Springer, 2012). The subject matter is interdisciplinary and at the intersection of applied mathematics and computer science. The book will be of use to researchers and graduate students with an understanding of basic linear algebra, probability, and discrete mathematics.




Engineering Reliability and Risk Assessment


Book Description

Engineering Reliability and Risk Assessment explains how to improve the performance of a system using the latest risk and reliability models. Against a backdrop of increasing availability of industrial data, and ever-increasing global commercial competition, the standards for optimal efficiency with minimum hazards keep improving. Topics explained include Effective strategies for the maintenance of the mechanical components of a system, How to schedule necessary interventions throughout the product life cycle, How to understand the structure and cost of complex systems, Planning a schedule to improve the reliability and life of the system, software, system safety and risk informed asset management, and more. - Uses case studies from industry practice to explain innovative solutions to real world risk assessment problems - Addresses the full interdisciplinary range of topics that influence this complex field - Provides brief introductions to important concepts, including risk and reliability analysis and fuzzy reliability




Adaptation and Cross Layer Design in Wireless Networks


Book Description

Adaptive techniques play a key role in modern wireless communication systems. The concept of adaptation is emphasized in the Adaptation in Wireless Communications Series through a unified framework across all layers of the wireless protocol stack ranging from the physical layer to the application layer, and from cellular systems to next-generation wireless networks. Adaptation and Cross Layer Design in Wireless Networks is devoted to adaptation in the data link layer, network layer, and application layer. The book presents state-of-the-art adaptation techniques and methodologies, including cross-layer adaptation, joint signal processing, coding and networking, selfishness in mobile ad hoc networks, cooperative and opportunistic protocols, adaptation techniques for multimedia support, self –organizing routing, and tunable security services. It presents several new theoretical paradigms and analytical findings which are supported with various simulation and experimental results. Adaptation in wireless communications is needed in order to achieve high capacity and ubiquitous communications. The current trend in wireless communication systems is to make adaptation dependent upon the state of the relevant parameters in all layers of the system. Focusing on simplified cross layer design approaches, this volume describes advanced techniques such as adaptive resource management, adaptive modulation and coding, 4G communications, QoS, diversity combining, and energy and mobility aware MAC protocols. The first volume in the series, Adaptive Signal Processing in Wireless Communications (cat no.46012) covers adaptive signal processing at the physical layer.




Numerical Solution of Markov Chains


Book Description

Papers presented at a workshop held January 1990 (location unspecified) cover just about all aspects of solving Markov models numerically. There are papers on matrix generation techniques and generalized stochastic Petri nets; the computation of stationary distributions, including aggregation/disagg




Matrix Analysis and Applied Linear Algebra


Book Description

Matrix Analysis and Applied Linear Algebra is an honest math text that circumvents the traditional definition-theorem-proof format that has bored students in the past. Meyer uses a fresh approach to introduce a variety of problems and examples ranging from the elementary to the challenging and from simple applications to discovery problems. The focus on applications is a big difference between this book and others. Meyer's book is more rigorous and goes into more depth than some. He includes some of the more contemporary topics of applied linear algebra which are not normally found in undergraduate textbooks. Modern concepts and notation are used to introduce the various aspects of linear equations, leading readers easily to numerical computations and applications. The theoretical developments are always accompanied with examples, which are worked out in detail. Each section ends with a large number of carefully chosen exercises from which the students can gain further insight.




Handbook of Stochastic Models and Analysis of Manufacturing System Operations


Book Description

This handbook surveys important stochastic problems and models in manufacturing system operations and their stochastic analysis. Using analytical models to design and control manufacturing systems and their operations entail critical stochastic performance analysis as well as integrated optimization models of these systems. Topics deal with the areas of facilities planning, transportation, and material handling systems, logistics and supply chain management, and integrated productivity and quality models covering: • Stochastic modeling and analysis of manufacturing systems • Design, analysis, and optimization of manufacturing systems • Facilities planning, transportation, and material handling systems analysis • Production planning, scheduling systems, management, and control • Analytical approaches to logistics and supply chain management • Integrated productivity and quality models, and their analysis • Literature surveys of issues relevant in manufacturing systems • Case studies of manufacturing system operations and analysis Today’s manufacturing system operations are becoming increasingly complex. Advanced knowledge of best practices for treating these problems is not always well known. The purpose of the book is to create a foundation for the development of stochastic models and their analysis in manufacturing system operations. Given the handbook nature of the volume, introducing basic principles, concepts, and algorithms for treating these problems and their solutions is the main intent of this handbook. Readers unfamiliar with these research areas will be able to find a research foundation for studying these problems and systems.




Lectures on Formal Methods and Performance Analysis


Book Description

Traditionally, models and methods for the analysis of the functional correctness of reactive systems, and those for the analysis of their performance (and - pendability) aspects, have been studied by di?erent research communities. This has resulted in the development of successful, but distinct and largely unrelated modeling and analysis techniques for both domains. In many modern systems, however, the di?erence between their functional features and their performance properties has become blurred, as relevant functionalities become inextricably linked to performance aspects, e.g. isochronous data transfer for live video tra- mission. During the last decade, this trend has motivated an increased interest in c- bining insights and results from the ?eld of formal methods – traditionally - cused on functionality – with techniques for performance modeling and analysis. Prominent examples of this cross-fertilization are extensions of process algebra and Petri nets that allow for the automatic generation of performance models, the use of formal proof techniques to assess the correctness of randomized - gorithms, and extensions of model checking techniques to analyze performance requirements automatically. We believe that these developments markthe - ginning of a new paradigm for the modeling and analysis of systems in which qualitative and quantitative aspects are studied from an integrated perspective. We are convinced that the further worktowards the realization of this goal will be a growing source of inspiration and progress for both communities.




Performance Analysis of Closed Queueing Networks


Book Description

This book deals with the performance analysis of closed queueing networks with general processing times and finite buffer spaces. It offers a detailed introduction to the problem and a comprehensive literature review. Two approaches to the performance of closed queueing networks are presented. One is an approximate decomposition approach, while the second is the first exact approach for finite-capacity networks with general processing times. In this Markov chain approach, queueing networks are analyzed by modeling the entire system as one Markov chain. As this approach is exact, it is well-suited both as a reference quantity for approximate procedures and as extension to other queueing networks. Moreover, for the first time, the exact distribution of the time between processing starts is provided.




Process Algebra and Probabilistic Methods. Performance Modelling and Verification


Book Description

This book constitutes the refereed proceedings of the Joint Workshop on Process Algebra and Performance Modeling and Probabilistic Methods in Verification, PAPM-PROBMIV 2001, held in Aachen, Germany in September 2001. The 12 revised full papers presented together with one invited paper were carefully reviewed and selected from 23 submissions. Among the topics addressed are model representation, model checking, probabilistic systems analysis, refinement, Markov chains, random variables, stochastic timed systems, Max-Plus algebra, process algebra, system modeling, and the Mobius modeling framework.