Probability, Stochastic Processes, and Queueing Theory


Book Description

We will occasionally footnote a portion of text with a "**,, to indicate Notes on the that this portion can be initially bypassed. The reasons for bypassing a Text portion of the text include: the subject is a special topic that will not be referenced later, the material can be skipped on first reading, or the level of mathematics is higher than the rest of the text. In cases where a topic is self-contained, we opt to collect the material into an appendix that can be read by students at their leisure. The material in the text cannot be fully assimilated until one makes it Notes on "their own" by applying the material to specific problems. Self-discovery Problems is the best teacher and although they are no substitute for an inquiring mind, problems that explore the subject from different viewpoints can often help the student to think about the material in a uniquely per sonal way. With this in mind, we have made problems an integral part of this work and have attempted to make them interesting as well as informative.




Stochastic Processes in Queueing Theory


Book Description

The object of queueing theory (or the theory of mass service) is the investigation of stochastic processes of a special form which are called queueing (or service) processes in this book. Two approaches to the definition of these processes are possible depending on the direction of investigation. In accordance with this fact, the exposition of the subject can be broken up into two self-contained parts. The first of these forms the content of this monograph. . The definition of the queueing processes (systems) to be used here is dose to the traditional one and is connected with the introduction of so-called governing random sequences. We will introduce algorithms which describe the governing of a system with the aid of such sequences. Such a definition inevitably becomes rather qualitative since under these conditions a completely formal construction of a stochastic process uniquely describing the evolution of the system would require introduction of a complicated phase space not to mention the difficulties of giving the distribution of such a process on this phase space.




Stochastic Models in Queueing Theory


Book Description

This is a graduate level textbook that covers the fundamental topics in queuing theory. The book has a broad coverage of methods to calculate important probabilities, and gives attention to proving the general theorems. It includes many recent topics, such as server-vacation models, diffusion approximations and optimal operating policies, and more about bulk-arrival and bull-service models than other general texts. - Current, clear and comprehensive coverage - A wealth of interesting and relevant examples and exercises to reinforce concepts - Reference lists provided after each chapter for further investigation




Stochastic Storage Processes


Book Description

This book is based on a course I have taught at Cornell University since 1965. The primary topic of this course was queueing theory, but related topics such as inventories, insurance risk, and dams were also included. As a text I used my earlier book, Queues and Inventories (John Wiley, New York, 1965). Over the years the emphasis in this course shifted from detailed analysis of probability models to the study of stochastic processes that arise from them, and the subtitle of the text, "A Study of Their Basic Stochastic Processes," became a more appropriate description of the course. My own research into the fluctuation theory for U:vy processes provided a new perspective on the topics discussed, and enabled me to reorganize the material. The lecture notes used for the course went through several versions, and the final version became this book. A detailed description of my approach will be found in the Introduction. I have not attempted to give credit to authors of individual results. Readers interested in the historical literature should consult the Selected Bibliography given at the end of the Introduction. The original work in this area is presented here with simpler proofs that make full use of the special features of the underlying stochastic processes. The same approach makes it possible to provide several new results. Thanks are due to Kathy King for her excellent typing of the manuscript.




Probability, Statistics, and Queueing Theory


Book Description

This is a textbook on applied probability and statistics with computer science applications for students at the upper undergraduate level. It may also be used as a self study book for the practicing computer science professional. The successful first edition of this book proved extremely useful to students who need to use probability, statistics and queueing theory to solve problems in other fields, such as engineering, physics, operations research, and management science. The book has also been successfully used for courses in queueing theory for operations research students. This second edition includes a new chapter on regression as well as more than twice as many exercises at the end of each chapter. While the emphasis is the same as in the first edition, this new book makes more extensive use of available personal computer software, such as Minitab and Mathematica.




Stochastic Modeling and the Theory of Queues


Book Description

An integrated and up-to-date treatment of applied stochastic processes and queueing theory, with an emphasis on time-averages and long-run behavior. Theory demonstrates practical effects, such as priorities, pooling of queues, and bottlenecks. Appropriate for senior/graduate courses in queueing theory in Operations Research, Computer Science, Statistics, or Industrial Engineering departments. (vs. Ross, Karlin, Kleinrock, Heyman)




Applied Probability and Stochastic Processes


Book Description

In this book, Feldman and Valdez-Flores present applied probability and stochastic processes in an elementary but mathematically precise manner, with numerous examples and exercises to illustrate the range of engineering and science applications for the concepts. The book is designed to give the reader an intuitive understanding of probabilistic reasoning, in addition to an understanding of mathematical concepts and principles. Unique features of the book include a self-contained chapter on simulation (Chapter 3) and early introduction of Markov chains.




Probability, Random Processes, and Statistical Analysis


Book Description

Together with the fundamentals of probability, random processes and statistical analysis, this insightful book also presents a broad range of advanced topics and applications. There is extensive coverage of Bayesian vs. frequentist statistics, time series and spectral representation, inequalities, bound and approximation, maximum-likelihood estimation and the expectation-maximization (EM) algorithm, geometric Brownian motion and Itô process. Applications such as hidden Markov models (HMM), the Viterbi, BCJR, and Baum–Welch algorithms, algorithms for machine learning, Wiener and Kalman filters, and queueing and loss networks are treated in detail. The book will be useful to students and researchers in such areas as communications, signal processing, networks, machine learning, bioinformatics, econometrics and mathematical finance. With a solutions manual, lecture slides, supplementary materials and MATLAB programs all available online, it is ideal for classroom teaching as well as a valuable reference for professionals.




An Introduction to Queueing Theory


Book Description

This introductory textbook is designed for a one-semester course on queueing theory that does not require a course on stochastic processes as a prerequisite. By integrating the necessary background on stochastic processes with the analysis of models, the work provides a sound foundational introduction to the modeling and analysis of queueing systems for a broad interdisciplinary audience of students in mathematics, statistics, and applied disciplines such as computer science, operations research, and engineering. This edition includes additional topics in methodology and applications. Key features: • An introductory chapter including a historical account of the growth of queueing theory in more than 100 years. • A modeling-based approach with emphasis on identification of models • Rigorous treatment of the foundations of basic models commonly used in applications with appropriate references for advanced topics. • A chapter on matrix-analytic method as an alternative to the traditional methods of analysis of queueing systems. • A comprehensive treatment of statistical inference for queueing systems. • Modeling exercises and review exercises when appropriate. The second edition of An Introduction of Queueing Theory may be used as a textbook by first-year graduate students in fields such as computer science, operations research, industrial and systems engineering, as well as related fields such as manufacturing and communications engineering. Upper-level undergraduate students in mathematics, statistics, and engineering may also use the book in an introductory course on queueing theory. With its rigorous coverage of basic material and extensive bibliography of the queueing literature, the work may also be useful to applied scientists and practitioners as a self-study reference for applications and further research. "...This book has brought a freshness and novelty as it deals mainly with modeling and analysis in applications as well as with statistical inference for queueing problems. With his 40 years of valuable experience in teaching and high level research in this subject area, Professor Bhat has been able to achieve what he aimed: to make [the work] somewhat different in content and approach from other books." - Assam Statistical Review of the first edition




Probability Theory and Stochastic Processes


Book Description

The ultimate objective of this book is to present a panoramic view of the main stochastic processes which have an impact on applications, with complete proofs and exercises. Random processes play a central role in the applied sciences, including operations research, insurance, finance, biology, physics, computer and communications networks, and signal processing. In order to help the reader to reach a level of technical autonomy sufficient to understand the presented models, this book includes a reasonable dose of probability theory. On the other hand, the study of stochastic processes gives an opportunity to apply the main theoretical results of probability theory beyond classroom examples and in a non-trivial manner that makes this discipline look more attractive to the applications-oriented student. One can distinguish three parts of this book. The first four chapters are about probability theory, Chapters 5 to 8 concern random sequences, or discrete-time stochastic processes, and the rest of the book focuses on stochastic processes and point processes. There is sufficient modularity for the instructor or the self-teaching reader to design a course or a study program adapted to her/his specific needs. This book is in a large measure self-contained.