Continuous Average Control of Piecewise Deterministic Markov Processes


Book Description

The intent of this book is to present recent results in the control theory for the long run average continuous control problem of piecewise deterministic Markov processes (PDMPs). The book focuses mainly on the long run average cost criteria and extends to the PDMPs some well-known techniques related to discrete-time and continuous-time Markov decision processes, including the so-called ``average inequality approach'', ``vanishing discount technique'' and ``policy iteration algorithm''. We believe that what is unique about our approach is that, by using the special features of the PDMPs, we trace a parallel with the general theory for discrete-time Markov Decision Processes rather than the continuous-time case. The two main reasons for doing that is to use the powerful tools developed in the discrete-time framework and to avoid working with the infinitesimal generator associated to a PDMP, which in most cases has its domain of definition difficult to be characterized. Although the book is mainly intended to be a theoretically oriented text, it also contains some motivational examples. The book is targeted primarily for advanced students and practitioners of control theory. The book will be a valuable source for experts in the field of Markov decision processes. Moreover, the book should be suitable for certain advanced courses or seminars. As background, one needs an acquaintance with the theory of Markov decision processes and some knowledge of stochastic processes and modern analysis.




Optimal Flow Control in Manufacturing Systems


Book Description

This book presents a unified optimal control approach to a large class of problems arising in the field of production planning and scheduling. It introduces a leading optimal flow control paradigm which results in efficient solutions for planning and scheduling problems. This book also introduces the reader to analytical and numerical methods of the maximum principle, used here as a mathematical instrument in modeling and solving production planning and scheduling problems. The book examines control of production flows rather than sequencing of distinct jobs. Methodologically, this paradigm allows us to progress from initial assumptions about a manufacturing environment, through mathematical models and construction of numerical methods, up to practical applications which prove the relevance of the theory developed here to the real world. Given a manufacturing system, the goal is to control the production, subject to given constraints, in such a way that the demands are tracked as closely as possible. The book considers a wide variety of problems encountered in actual production planning and scheduling. Among the problems are production flow sequencing and timing, capacity expansion and deterioration, subcontracting and overtime. The last chapter is entirely devoted to applications of the theory to scheduling production flows in real-life manufacturing systems. The enclosed disk provides software implementations of the developed methods with easy, convenient user interface. We aimed this book at a student audience - final year undergraduates as weIl as master and Ph. D.




Stochastic Processes: Modeling and Simulation


Book Description

This sequel to volume 19 of Handbook on Statistics on Stochastic Processes: Modelling and Simulation is concerned mainly with the theme of reviewing and, in some cases, unifying with new ideas the different lines of research and developments in stochastic processes of applied flavour. This volume consists of 23 chapters addressing various topics in stochastic processes. These include, among others, those on manufacturing systems, random graphs, reliability, epidemic modelling, self-similar processes, empirical processes, time series models, extreme value therapy, applications of Markov chains, modelling with Monte Carlo techniques, and stochastic processes in subjects such as engineering, telecommunications, biology, astronomy and chemistry. particular with modelling, simulation techniques and numerical methods concerned with stochastic processes. The scope of the project involving this volume as well as volume 19 is already clarified in the preface of volume 19. The present volume completes the aim of the project and should serve as an aid to students, teachers, researchers and practitioners interested in applied stochastic processes.




Autonomous Cooperation and Control in Logistics


Book Description

Many new technologies – like RFID, GPS, and sensor networks – that dominate innovative developments in logistics are based on the idea of autonomous cooperation and control. This self-organisational concept describes „...processes of decentralized decision-making in heterarchical structures. It presumes interacting elements in non-deterministic systems, which possess the capability and possibility to render decisions. The objective of autonomous cooperation and control is the achievement of increased robustness and positive emergence of the total system due to distributed and flexible coping with dynamics and complexity“ (Hülsmann & Windt, 2007). In order to underlie these technology-driven developments with a fundamental theoretical foundation this edited volume asks for contributions and limitations of applying the principles of autonomous cooperation and control to logistics processes and systems. It intends to identify, describe, and explain – in the context of production and distribution logistics – the effects on performance and robustness, the enablers and impediments for the feasibility, the essential cause-effect-relations, etc. of concepts, methods, technologies, and routines of autonomous cooperation and control in logistics. Therefore, the analyses collected in this edited volume aim to develop a framework for finding the optimal degree as well as the upper and lower boundaries of autonomous cooperation and control of logistics processes from the different perspectives of production technology, electronics and communication engineering, informatics and mathematics, as well as management sciences and economics.







Control Techniques for Complex Networks


Book Description

From foundations to state-of-the-art; the tools and philosophy you need to build network models.




INFORMS Conference Program


Book Description







Average-Cost Control of Stochastic Manufacturing Systems


Book Description

This book articulates a new theory that shows that hierarchical decision making can in fact lead to a near optimization of system goals. The material in the book cuts across disciplines. It will appeal to graduate students and researchers in applied mathematics, operations management, operations research, and system and control theory.