Near Real-time Risk Assessment Using Hidden Markov Models


Book Description

Business objectives and methods in an organization change periodically. Their supporting Information Systems (ISs) change even more dynamically for various reasons: system upgrades, software patches, routine maintenance, and intentionally or unintentionally induced attacks. Unless regular, routine, and timely risk assessments are conducted, changes in IS risks may never be noticed. Risk assessments need to be performed more frequently and faster in order to discover potential threats and to determine the changes that must be made to corporate computing environments to address them. Furthermore, conducting risk assessments on organizational assets can be time consuming, burdensome, and misleading in many cases because of the dynamically changing security states of assets. In theory, each asset can change its security states from one of secure, mitigated, vulnerable, or compromised. However, the secure state is only temporary and imaginary; it may never exist. Therefore, it is more accurate to say that each asset changes its security state from mitigated, vulnerable, or compromised. If we can predict an asset's future security state based on its current security state, we would have a good indicator of risk for the organization's mission-critical assets. Similarly, if risk factors of each mission critical asset could be quantified in near real-time, a risk assessment could be valuable in informing organizational stakeholders of the level of risk of their mission critical assets, which would then aid in their risk mitigation decisions. Quantifying organizational IS risk factors could be meaningful to an organization because quantifying risk levels could prompt a solution space in mitigating risks. In this research, we introduce an effective risk assessment using hidden Markov models (HMMs) in order to predict future security states and to quantify dynamically changing organizational IS assets by exploring possible security states from an insider user's perspective. HMMs have been used in many scientific fields to predict future states based on current states. Using these models, organizational mission critical assets could be assessed for their risk levels in a near real-time basis to determine the future risk level of each dynamically changing asset due to internally or externally induced threats.




Hidden Markov Models for Time Series


Book Description

Hidden Markov Models for Time Series: An Introduction Using R, Second Edition illustrates the great flexibility of hidden Markov models (HMMs) as general-purpose models for time series data. The book provides a broad understanding of the models and their uses. After presenting the basic model formulation, the book covers estimation, forecasting, decoding, prediction, model selection, and Bayesian inference for HMMs. Through examples and applications, the authors describe how to extend and generalize the basic model so that it can be applied in a rich variety of situations. The book demonstrates how HMMs can be applied to a wide range of types of time series: continuous-valued, circular, multivariate, binary, bounded and unbounded counts, and categorical observations. It also discusses how to employ the freely available computing environment R to carry out the computations. Features Presents an accessible overview of HMMs Explores a variety of applications in ecology, finance, epidemiology, climatology, and sociology Includes numerous theoretical and programming exercises Provides most of the analysed data sets online New to the second edition A total of five chapters on extensions, including HMMs for longitudinal data, hidden semi-Markov models and models with continuous-valued state process New case studies on animal movement, rainfall occurrence and capture-recapture data




Hidden Markov Models


Book Description

As more applications are found, interest in Hidden Markov Models continues to grow. Following comments and feedback from colleagues, students and other working with Hidden Markov Models the corrected 3rd printing of this volume contains clarifications, improvements and some new material, including results on smoothing for linear Gaussian dynamics. In Chapter 2 the derivation of the basic filters related to the Markov chain are each presented explicitly, rather than as special cases of one general filter. Furthermore, equations for smoothed estimates are given. The dynamics for the Kalman filter are derived as special cases of the authors’ general results and new expressions for a Kalman smoother are given. The Chapters on the control of Hidden Markov Chains are expanded and clarified. The revised Chapter 4 includes state estimation for discrete time Markov processes and Chapter 12 has a new section on robust control.




Applications of Machine Learning


Book Description

This book covers applications of machine learning in artificial intelligence. The specific topics covered include human language, heterogeneous and streaming data, unmanned systems, neural information processing, marketing and the social sciences, bioinformatics and robotics, etc. It also provides a broad range of techniques that can be successfully applied and adopted in different areas. Accordingly, the book offers an interesting and insightful read for scholars in the areas of computer vision, speech recognition, healthcare, business, marketing, and bioinformatics.




Mixture and Hidden Markov Models with R


Book Description

This book discusses mixture and hidden Markov models for modeling behavioral data. Mixture and hidden Markov models are statistical models which are useful when an observed system occupies a number of distinct “regimes” or unobserved (hidden) states. These models are widely used in a variety of fields, including artificial intelligence, biology, finance, and psychology. Hidden Markov models can be viewed as an extension of mixture models, to model transitions between states over time. Covering both mixture and hidden Markov models in a single book allows main concepts and issues to be introduced in the relatively simpler context of mixture models. After a thorough treatment of the theory and practice of mixture modeling, the conceptual leap towards hidden Markov models is relatively straightforward. This book provides many practical examples illustrating the wide variety of uses of the models. These examples are drawn from our own work in psychology, as well as other areas such as financial time series and climate data. Most examples illustrate the use of the authors’ depmixS4 package, which provides a flexible framework to construct and estimate mixture and hidden Markov models. All examples are fully reproducible and the accompanying hmmR package provides all the datasets used, as well as additional functionality. This book is suitable for advanced students and researchers with an applied background.




Hidden Markov and Other Models for Discrete- valued Time Series


Book Description

Discrete-valued time series are common in practice, but methods for their analysis are not well-known. In recent years, methods have been developed which are specifically designed for the analysis of discrete-valued time series. Hidden Markov and Other Models for Discrete-Valued Time Series introduces a new, versatile, and computationally tractable class of models, the "hidden Markov" models. It presents a detailed account of these models, then applies them to data from a wide range of diverse subject areas, including medicine, climatology, and geophysics. This book will be invaluable to researchers and postgraduate and senior undergraduate students in statistics. Researchers and applied statisticians who analyze time series data in medicine, animal behavior, hydrology, and sociology will also find this information useful.




Hidden Markov Models


Book Description

Markov chains have increasingly become useful way of capturing stochastic nature of many economic and financial variables. Although the hidden Markov processes have been widely employed for some time in many engineering applications e.g. speech recognition, its effectiveness has now been recognized in areas of social science research as well. The main aim of Hidden Markov Models: Applications to Financial Economics is to make such techniques available to more researchers in financial economics. As such we only cover the necessary theoretical aspects in each chapter while focusing on real life applications using contemporary data mainly from OECD group of countries. The underlying assumption here is that the researchers in financial economics would be familiar with such application although empirical techniques would be more traditional econometrics. Keeping the application level in a more familiar level, we focus on the methodology based on hidden Markov processes. This will, we believe, help the reader to develop more in-depth understanding of the modeling issues thereby benefiting their future research.




Hidden Markov Models


Book Description

This book presents, in an integrated form, both the analysis and synthesis of three different types of hidden Markov models. Unlike other books on the subject, it is generic and does not focus on a specific theme, e.g. speech processing. Moreover, it presents the translation of hidden Markov models’ concepts from the domain of formal mathematics into computer codes using MATLAB®. The unique feature of this book is that the theoretical concepts are first presented using an intuition-based approach followed by the description of the fundamental algorithms behind hidden Markov models using MATLAB®. This approach, by means of analysis followed by synthesis, is suitable for those who want to study the subject using a more empirical approach. Key Selling Points: Presents a broad range of concepts related to Hidden Markov Models (HMM), from simple problems to advanced theory Covers the analysis of both continuous and discrete Markov chains Discusses the translation of HMM concepts from the realm of formal mathematics into computer code Offers many examples to supplement mathematical notation when explaining new concepts




Prognostics and Remaining Useful Life (RUL) Estimation


Book Description

Maintenance combines various methods, tools, and techniques in a bid to reduce maintenance costs while increasing the reliability, availability, and security of equipment. Condition-based maintenance (CBM) is one such method, and prognostics forms a key element of a CBM program based on mathematical models for predicting remaining useful life (RUL). Prognostics and Remaining Useful Life (RUL) Estimation: Predicting with Confidence compares the techniques and models used to estimate the RUL of different assets, including a review of the relevant literature on prognostic techniques and their use in the industrial field. This book describes different approaches and prognosis methods for different assets backed up by appropriate case studies. FEATURES Presents a compendium of RUL estimation methods and technologies used in predictive maintenance Describes different approaches and prognosis methods for different assets Includes a comprehensive compilation of methods from model-based and data-driven to hybrid Discusses the benchmarking of RUL estimation methods according to accuracy and uncertainty, depending on the target application, the type of asset, and the forecast performance expected Contains a toolset of methods and a way of deployment aimed at a versatile audience This book is aimed at professionals, senior undergraduates, and graduate students in all interdisciplinary engineering streams that focus on prognosis and maintenance.




The Application of Hidden Markov Models in Speech Recognition


Book Description

The Application of Hidden Markov Models in Speech Recognition presents the core architecture of a HMM-based LVCSR system and proceeds to describe the various refinements which are needed to achieve state-of-the-art performance.