An Evaluation of Early Warning Models for Systemic Banking Crises: Does Machine Learning Improve Predictions?
Johannes Beutel, Sophia List, Gregor von Schweinitz
Abstract
This paper compares the out-of-sample predictive performance of different early warning models for systemic banking crises using a sample of advanced economies covering the past 45 years. We compare a benchmark logit approach to several machine learning approaches recently proposed in the literature. We find that while machine learning methods often attain a very high in-sample fit, they are outperformed by the logit approach in recursive out-of-sample evaluations. This result is robust to the choice of performance measure, crisis definition, preference parameter, and sample length, as well as to using different sets of variables and data transformations. Thus, our paper suggests that further enhancements to machine learning early warning models are needed before they are able to offer a substantial value-added for predicting systemic banking crises. Conventional logit models appear to use the available information already fairly effciently, and would for instance have been able to predict the 2007/2008 financial crisis out-of-sample for many countries. In line with economic intuition, these models identify credit expansions, asset price booms and external imbalances as key predictors of systemic banking crises.
Artikel Lesen
For How Long Do IMF Forecasts of World Economic Growth Stay Up-to-date?
Katja Heinisch, Axel Lindner
Applied Economics Letters,
Nr. 3,
2019
Abstract
This study analyses the performance of the International Monetary Fund (IMF) World Economic Outlook output forecasts for the world and for both the advanced economies and the emerging and developing economies. With a focus on the forecast for the current year and the next year, we examine the durability of IMF forecasts, looking at how much time has to pass so that IMF forecasts can be improved by using leading indicators with monthly updates. Using a real-time data set for GDP and for indicators, we find that some simple single-indicator forecasts on the basis of data that are available at higher frequency can significantly outperform the IMF forecasts as soon as the publication of the IMF’s Outlook is only a few months old. In particular, there is an obvious gain using leading indicators from January to March for the forecast of the current year.
Artikel Lesen
Expectation Formation, Financial Frictions, and Forecasting Performance of Dynamic Stochastic General Equilibrium Models
Oliver Holtemöller, Christoph Schult
Abstract
In this paper, we document the forecasting performance of estimated basic dynamic stochastic general equilibrium (DSGE) models and compare this to extended versions which consider alternative expectation formation assumptions and financial frictions. We also show how standard model features, such as price and wage rigidities, contribute to forecasting performance. It turns out that neither alternative expectation formation behaviour nor financial frictions can systematically increase the forecasting performance of basic DSGE models. Financial frictions improve forecasts only during periods of financial crises. However, traditional price and wage rigidities systematically help to increase the forecasting performance.
Artikel Lesen
Do Director Elections Matter?
Vyacheslav Fos, Kai Li, Margarita Tsoutsoura
Review of Financial Studies,
Nr. 4,
2018
Abstract
Using a hand-collected sample of election nominations for more than 30,000 directors over the period 2001–2010, we construct a novel measure of director proximity to elections called Years-to-election. We find that the closer directors of a board are to their next elections, the higher CEO turnover-performance sensitivity is. A series of tests, including one that exploits variation in Years-to-election that comes from other boards, supports a causal interpretation. Further analyses show that other governance mechanisms do not drive the relation between board Years-to-election and CEO turnover-performance sensitivity. We conclude that director elections have important implications for corporate governance.
Artikel Lesen
Bottom-up or Direct? Forecasting German GDP in a Data-rich Environment
Katja Heinisch, Rolf Scheufele
Empirical Economics,
Nr. 2,
2018
Abstract
In this paper, we investigate whether there are benefits in disaggregating GDP into its components when nowcasting GDP. To answer this question, we conduct a realistic out-of-sample experiment that deals with the most prominent problems in short-term forecasting: mixed frequencies, ragged-edge data, asynchronous data releases and a large set of potential information. We compare a direct leading indicator-based GDP forecast with two bottom-up procedures—that is, forecasting GDP components from the production side or from the demand side. Generally, we find that the direct forecast performs relatively well. Among the disaggregated procedures, the production side seems to be better suited than the demand side to form a disaggregated GDP nowcast.
Artikel Lesen
"The Good News about Bad News": Information about Past Organisational Failure and its Impact on Worker Productivity
Sabrina Jeworrek, Vanessa Mertins, Michael Vlassopoulos
Abstract
Failure in organisations is a very common phenomenon. Little is known about whether past failure affects workers’ subsequent performance. We conduct a field experiment in which we follow up a failed mail campaign to attract new volunteers with a phone campaign pursuing the same goal. We recruit temporary workers to carry out the phone campaign and randomly assign them to either receive or not receive information about the previous failure and measure their performance. We find that informed workers perform better – in terms of both numbers dialed (about 14% improvement) and completed interviews (about 20% improvement) – regardless of whether they had previously worked on the failed mail campaign. Evidence from a second experiment with student volunteers asked to support a campaign to reduce food waste suggests that the mechanism behind our finding relates to contextual inference: Informing workers/volunteers that they are pursuing a goal that is hard to attain seems to add meaning to the work involved, leading them to exert more effort.
Artikel Lesen
Predicting Earnings and Cash Flows: The Information Content of Losses and Tax Loss Carryforwards
Sandra Dreher, Sebastian Eichfelder, Felix Noth
Abstract
We analyse the relevance of losses, accounting information on tax loss carryforwards, and deferred taxes for the prediction of earnings and cash flows up to four years ahead. We use a unique hand-collected panel of German listed firms encompassing detailed information on tax loss carryforwards and deferred taxes from the tax footnote. Our out-of-sample predictions show that considering accounting information on tax loss carryforwards and deferred taxes does not enhance the accuracy of performance forecasts and can even worsen performance predictions. We find that common forecasting approaches that treat positive and negative performances equally or that use a dummy variable for negative performance can lead to biased performance forecasts, and we provide a simple empirical specification to account for that issue.
Artikel Lesen
Optimizing Policymakers' Loss Functions in Crisis Prediction: Before, Within or After?
Peter Sarlin, Gregor von Schweinitz
Abstract
Early-warning models most commonly optimize signaling thresholds on crisis probabilities. The expost threshold optimization is based upon a loss function accounting for preferences between forecast errors, but comes with two crucial drawbacks: unstable thresholds in recursive estimations and an in-sample overfit at the expense of out-of-sample performance. We propose two alternatives for threshold setting: (i) including preferences in the estimation itself and (ii) setting thresholds ex-ante according to preferences only. Given probabilistic model output, it is intuitive that a decision rule is independent of the data or model specification, as thresholds on probabilities represent a willingness to issue a false alarm vis-à-vis missing a crisis. We provide simulated and real-world evidence that this simplification results in stable thresholds and improves out-of-sample performance. Our solution is not restricted to binary-choice models, but directly transferable to the signaling approach and all probabilistic early-warning models.
Artikel Lesen