Overfitting in Judgment-based Economic Forecasts: The Case of IMF Growth Projections


Book Description

I regress real GDP growth rates on the IMF’s growth forecasts and find that IMF forecasts behave similarly to those generated by overfitted models, placing too much weight on observable predictors and underestimating the forces of mean reversion. I identify several such variables that explain forecasts well but are not predictors of actual growth. I show that, at long horizons, IMF forecasts are little better than a forecasting rule that uses no information other than the historical global sample average growth rate (i.e., a constant). Given the large noise component in forecasts, particularly at longer horizons, the paper calls into question the usefulness of judgment-based medium and long-run forecasts for policy analysis, including for debt sustainability assessments, and points to statistical methods to improve forecast accuracy by taking into account the risk of overfitting.




Strategic Foresight at the International Monetary Fund


Book Description

This note explains the value of strategic foresight and provides implementation advice based on the IMF’s experience with scenario planning and policy gaming. Section II provides an overview of strategic foresight and some of its tools. Scenario planning and policy gaming have been the Fund’s main foresight techniques so far, though other tools have been complementary. Accordingly, section III focuses on the scenario planning by illustrating applications before detailing the methods we have been using, while section IV describes policy gaming including the matrix policy gaming approach with which we have experimented so far. Section V summarizes the key points. In so doing, the note extends an invitation to those in the economics and finance fields (e.g., researchers, policymakers) to incorporate strategic foresight in their analysis and decision making.




Predicting Fiscal Crises: A Machine Learning Approach


Book Description

In this paper I assess the ability of econometric and machine learning techniques to predict fiscal crises out of sample. I show that the econometric approaches used in many policy applications cannot outperform a simple heuristic rule of thumb. Machine learning techniques (elastic net, random forest, gradient boosted trees) deliver significant improvements in accuracy. Performance of machine learning techniques improves further, particularly for developing countries, when I expand the set of potential predictors and make use of algorithmic selection techniques instead of relying on a small set of variables deemed important by the literature. There is considerable agreement across learning algorithms in the set of selected predictors: Results confirm the importance of external sector stock and flow variables found in the literature but also point to demographics and the quality of governance as important predictors of fiscal crises. Fiscal variables appear to have less predictive value, and public debt matters only to the extent that it is owed to external creditors.




Lasso Regressions and Forecasting Models in Applied Stress Testing


Book Description

Model selection and forecasting in stress tests can be facilitated using machine learning techniques. These techniques have proved robust in other fields for dealing with the curse of dimensionality, a situation often encountered in applied stress testing. Lasso regressions, in particular, are well suited for building forecasting models when the number of potential covariates is large, and the number of observations is small or roughly equal to the number of covariates. This paper presents a conceptual overview of lasso regressions, explains how they fit in applied stress tests, describes its advantages over other model selection methods, and illustrates their application by constructing forecasting models of sectoral probabilities of default in an advanced emerging market economy.




International Macroeconomics in the Wake of the Global Financial Crisis


Book Description

This book collects selected articles addressing several currently debated issues in the field of international macroeconomics. They focus on the role of the central banks in the debate on how to come to terms with the long-term decline in productivity growth, insufficient aggregate demand, high economic uncertainty and growing inequalities following the global financial crisis. Central banks are of considerable importance in this debate since understanding the sluggishness of the recovery process as well as its implications for the natural interest rate are key to assessing output gaps and the monetary policy stance. The authors argue that a more dynamic domestic and external aggregate demand helps to raise the inflation rate, easing the constraint deriving from the zero lower bound and allowing monetary policy to depart from its current ultra-accommodative position. Beyond macroeconomic factors, the book also discusses a supportive financial environment as a precondition for the rebound of global economic activity, stressing that understanding capital flows is a prerequisite for economic-policy decisions.




Powering the Digital Economy: Opportunities and Risks of Artificial Intelligence in Finance


Book Description

This paper discusses the impact of the rapid adoption of artificial intelligence (AI) and machine learning (ML) in the financial sector. It highlights the benefits these technologies bring in terms of financial deepening and efficiency, while raising concerns about its potential in widening the digital divide between advanced and developing economies. The paper advances the discussion on the impact of this technology by distilling and categorizing the unique risks that it could pose to the integrity and stability of the financial system, policy challenges, and potential regulatory approaches. The evolving nature of this technology and its application in finance means that the full extent of its strengths and weaknesses is yet to be fully understood. Given the risk of unexpected pitfalls, countries will need to strengthen prudential oversight.




On the Macroeconomic Consequences of Over-Optimism


Book Description

Is over-optimism about a country's future growth perspective good for an economy, or does over-optimism also come with costs? In this paper we provide evidence that recessions, fiscal problems, as well as Balance of Payment-difficulties are more likely to arise in countries where past growth expectations have been overly optimistic. To examine this question, we look at the medium-run effects of instances of over-optimism or caution in IMF forecasts. To isolate the causal effect of over-optimism we take an instrumental variables approach, where we exploit variation provided by the allocation of IMF Mission Chiefs across countries. As a necessary first step, we document that IMF Mission Chiefs tend to systematically differ in their individual degrees of forecast-optimism or caution. The mechanism that transforms over-optimism into a later recession seems to run through higher debt accumulation, both public and private. Our findings illustrate the potency of unjustified optimism and underline the importance of basing economic forecasts upon realistic medium-term prospects.




Completing the Market: Generating Shadow CDS Spreads by Machine Learning


Book Description

We compared the predictive performance of a series of machine learning and traditional methods for monthly CDS spreads, using firms’ accounting-based, market-based and macroeconomics variables for a time period of 2006 to 2016. We find that ensemble machine learning methods (Bagging, Gradient Boosting and Random Forest) strongly outperform other estimators, and Bagging particularly stands out in terms of accuracy. Traditional credit risk models using OLS techniques have the lowest out-of-sample prediction accuracy. The results suggest that the non-linear machine learning methods, especially the ensemble methods, add considerable value to existent credit risk prediction accuracy and enable CDS shadow pricing for companies missing those securities.




Global Financial Stability Report, October 2017


Book Description

The October 2017 Global Financial Stability Report finds that the global financial system continues to strengthen in response to extraordinary policy support, regulatory enhancements, and the cyclical upturn in growth. It also includes a chapter that examines the short- and medium-term implications for economic growth and financial stability of the past decades’ rise in household debt. It documents large differences in household debt-to-GDP ratios across countries but a common increasing trajectory that was moderated but not reversed by the global financial crisis. Another chapter develops a new macroeconomic measure of financial stability by linking financial conditions to the probability distribution of future GDP growth and applies it to a set of 20 major advanced and emerging market economies. The chapter shows that changes in financial conditions shift the whole distribution of future GDP growth.




Growth at Risk: Concept and Application in IMF Country Surveillance


Book Description

The growth-at-risk (GaR) framework links current macrofinancial conditions to the distribution of future growth. Its main strength is its ability to assess the entire distribution of future GDP growth (in contrast to point forecasts), quantify macrofinancial risks in terms of growth, and monitor the evolution of risks to economic activity over time. By using GaR analysis, policymakers can quantify the likelihood of risk scenarios, which would serve as a basis for preemptive action. This paper offers practical guidance on how to conduct GaR analysis and draws lessons from country case studies. It also discusses an Excel-based GaR tool developed to support the IMF’s bilateral surveillance efforts.