Entropy Application for Forecasting


Book Description

This book shows the potential of entropy and information theory in forecasting, including both theoretical developments and empirical applications. The contents cover a great diversity of topics, such as the aggregation and combination of individual forecasts, the comparison of forecasting performance, and the debate concerning the tradeoff between complexity and accuracy. Analyses of forecasting uncertainty, robustness, and inconsistency are also included, as are proposals for new forecasting approaches. The proposed methods encompass a variety of time series techniques (e.g., ARIMA, VAR, state space models) as well as econometric methods and machine learning algorithms. The empirical contents include both simulated experiments and real-world applications focusing on GDP, M4-Competition series, confidence and industrial trend surveys, and stock exchange composite indices, among others. In summary, this collection provides an engaging insight into entropy applications for forecasting, offering an interesting overview of the current situation and suggesting possibilities for further research in this field.




Entropy-Based Parameter Estimation in Hydrology


Book Description

Since the pioneering work of Shannon in the late 1940's on the development of the theory of entropy and the landmark contributions of Jaynes a decade later leading to the development of the principle of maximum entropy (POME), the concept of entropy has been increasingly applied in a wide spectrum of areas, including chemistry, electronics and communications engineering, data acquisition and storage and retreival, data monitoring network design, ecology, economics, environmental engineering, earth sciences, fluid mechanics, genetics, geology, geomorphology, geophysics, geotechnical engineering, hydraulics, hydrology, image processing, management sciences, operations research, pattern recognition and identification, photogrammetry, psychology, physics and quantum mechanics, reliability analysis, reservoir engineering, statistical mechanics, thermodynamics, topology, transportation engineering, turbulence modeling, and so on. New areas finding application of entropy have since continued to unfold. The entropy concept is indeed versatile and its applicability widespread. In the area of hydrology and water resources, a range of applications of entropy have been reported during the past three decades or so. This book focuses on parameter estimation using entropy for a number of distributions frequently used in hydrology. In the entropy-based parameter estimation the distribution parameters are expressed in terms of the given information, called constraints. Thus, the method lends itself to a physical interpretation of the parameters. Because the information to be specified usually constitutes sufficient statistics for the distribution under consideration, the entropy method provides a quantitative way to express the information contained in the distribution.




Entropy Applications in Environmental and Water Engineering


Book Description

Entropy theory has wide applications to a range of problems in the fields of environmental and water engineering, including river hydraulic geometry, fluvial hydraulics, water monitoring network design, river flow forecasting, floods and droughts, river network analysis, infiltration, soil moisture, sediment transport, surface water and groundwater quality modeling, ecosystems modeling, water distribution networks, environmental and water resources management, and parameter estimation. Such applications have used several different entropy formulations, such as Shannon, Tsallis, Rényi, Burg, Kolmogorov, Kapur, configurational, and relative entropies, which can be derived in time, space, or frequency domains. More recently, entropy-based concepts have been coupled with other theories, including copula and wavelets, to study various issues associated with environmental and water resources systems. Recent studies indicate the enormous scope and potential of entropy theory in advancing research in the fields of environmental and water engineering, including establishing and explaining physical connections between theory and reality. The objective of this Special Issue is to provide a platform for compiling important recent and current research on the applications of entropy theory in environmental and water engineering. The contributions to this Special Issue have addressed many aspects associated with entropy theory applications and have shown the enormous scope and potential of entropy theory in advancing research in the fields of environmental and water engineering.




A Neutrosophic Forecasting Model for Time Series Based on First-Order State and Information Entropy of High-Order Fluctuation


Book Description

In time series forecasting, information presentation directly affects prediction efficiency. Most existing time series forecasting models follow logical rules according to the relationships between neighboring states, without considering the inconsistency of fluctuations for a related period. In this paper, we propose a new perspective to study the problem of prediction, in which inconsistency is quantified and regarded as a key characteristic of prediction rules. First, a time series is converted to a fluctuation time series by comparing each of the current data with corresponding previous data.







Modern Time Series Forecasting with Python


Book Description

Learn traditional and cutting-edge machine learning (ML) and deep learning techniques and best practices for time series forecasting, including global forecasting models, conformal prediction, and transformer architectures Key Features Apply ML and global models to improve forecasting accuracy through practical examples Enhance your time series toolkit by using deep learning models, including RNNs, transformers, and N-BEATS Learn probabilistic forecasting with conformal prediction, Monte Carlo dropout, and quantile regressions Purchase of the print or Kindle book includes a free eBook in PDF format Book Description Predicting the future, whether it's market trends, energy demand, or website traffic, has never been more crucial. This practical, hands-on guide empowers you to build and deploy powerful time series forecasting models. Whether you’re working with traditional statistical methods or cutting-edge deep learning architectures, this book provides structured learning and best practices for both. Starting with the basics, this data science book introduces fundamental time series concepts, such as ARIMA and exponential smoothing, before gradually progressing to advanced topics, such as machine learning for time series, deep neural networks, and transformers. As part of your fundamentals training, you’ll learn preprocessing, feature engineering, and model evaluation. As you progress, you’ll also explore global forecasting models, ensemble methods, and probabilistic forecasting techniques. This new edition goes deeper into transformer architectures and probabilistic forecasting, including new content on the latest time series models, conformal prediction, and hierarchical forecasting. Whether you seek advanced deep learning insights or specialized architecture implementations, this edition provides practical strategies and new content to elevate your forecasting skills. What you will learn Build machine learning models for regression-based time series forecasting Apply powerful feature engineering techniques to enhance prediction accuracy Tackle common challenges like non-stationarity and seasonality Combine multiple forecasts using ensembling and stacking for superior results Explore cutting-edge advancements in probabilistic forecasting and handle intermittent or sparse time series Evaluate and validate your forecasts using best practices and statistical metrics Who this book is for This book is ideal for data scientists, financial analysts, quantitative analysts, machine learning engineers, and researchers who need to model time-dependent data across industries, such as finance, energy, meteorology, risk analysis, and retail. Whether you are a professional looking to apply cutting-edge models to real-world problems or a student aiming to build a strong foundation in time series analysis and forecasting, this book will provide the tools and techniques you need. Familiarity with Python and basic machine learning concepts is recommended.




Computational Intelligence: Theories, Applications and Future Directions - Volume II


Book Description

This book presents selected proceedings of ICCI-2017, discussing theories, applications and future directions in the field of computational intelligence (CI). ICCI-2017 brought together international researchers presenting innovative work on self-adaptive systems and methods. This volume covers the current state of the field and explores new, open research directions. The book serves as a guide for readers working to develop and validate real-time problems and related applications using computational intelligence. It focuses on systems that deal with raw data intelligently, generate qualitative information that improves decision-making, and behave as smart systems, making it a valuable resource for researchers and professionals alike.







Advances in Time Series Forecasting


Book Description

"Time series analysis is applicable in a variety of disciplines such as business administration, economics, public finances, engineering, statistics, econometrics, mathematics and actuarial sciences. Forecasting the future assists in critical organizationa"




Assessing and Improving Prediction and Classification


Book Description

Assess the quality of your prediction and classification models in ways that accurately reflect their real-world performance, and then improve this performance using state-of-the-art algorithms such as committee-based decision making, resampling the dataset, and boosting. This book presents many important techniques for building powerful, robust models and quantifying their expected behavior when put to work in your application. Considerable attention is given to information theory, especially as it relates to discovering and exploiting relationships between variables employed by your models. This presentation of an often confusing subject avoids advanced mathematics, focusing instead on concepts easily understood by those with modest background in mathematics. All algorithms include an intuitive explanation of operation, essential equations, references to more rigorous theory, and commented C++ source code. Many of these techniques are recent developments, still not in widespread use. Others are standard algorithms given a fresh look. In every case, the emphasis is on practical applicability, with all code written in such a way that it can easily be included in any program. What You'll Learn Compute entropy to detect problematic predictors Improve numeric predictions using constrained and unconstrained combinations, variance-weighted interpolation, and kernel-regression smoothing Carry out classification decisions using Borda counts, MinMax and MaxMin rules, union and intersection rules, logistic regression, selection by local accuracy, maximization of the fuzzy integral, and pairwise coupling Harness information-theoretic techniques to rapidly screen large numbers of candidate predictors, identifying those that are especially promising Use Monte-Carlo permutation methods to assess the role of good luck in performance results Compute confidence and tolerance intervals for predictions, as well as confidence levels for classification decisions Who This Book is For Anyone who creates prediction or classification models will find a wealth of useful algorithms in this book. Although all code examples are written in C++, the algorithms are described in sufficient detail that they can easily be programmed in any language.