Optimizing Policymakers’ Loss Functions in Crisis Prediction: Before, Within or After?
Recurring financial instabilities have led policymakers to rely on early-warning models to signal financial vulnerabilities. These models rely on ex-post optimization of signaling thresholds on crisis probabilities accounting for preferences between forecast errors, but come with the crucial drawback of unstable thresholds in recursive estimations. We propose two alternatives for threshold setting with similar or better out-of-sample performance: (i) including preferences in the estimation itself and (ii) setting thresholds ex-ante according to preferences only. Given probabilistic model output, it is intuitive that a decision rule is independent of the data or model specification, as thresholds on probabilities represent a willingness to issue a false alarm vis-à-vis missing a crisis. We provide real-world and simulation evidence that this simplification results in stable thresholds, while keeping or improving on out-of-sample performance. Our solution is not restricted to binary-choice models, but directly transferable to the signaling approach and all probabilistic early-warning models.
An Evaluation of Early Warning Models for Systemic Banking Crises: Does Machine Learning Improve Predictions?
IWH Discussion Papers,
This paper compares the out-of-sample predictive performance of different early warning models for systemic banking crises using a sample of advanced economies covering the past 45 years. We compare a benchmark logit approach to several machine learning approaches recently proposed in the literature. We find that while machine learning methods often attain a very high in-sample fit, they are outperformed by the logit approach in recursive out-of-sample evaluations. This result is robust to the choice of performance measure, crisis definition, preference parameter, and sample length, as well as to using different sets of variables and data transformations. Thus, our paper suggests that further enhancements to machine learning early warning models are needed before they are able to offer a substantial value-added for predicting systemic banking crises. Conventional logit models appear to use the available information already fairly effciently, and would for instance have been able to predict the 2007/2008 financial crisis out-of-sample for many countries. In line with economic intuition, these models identify credit expansions, asset price booms and external imbalances as key predictors of systemic banking crises.
Speed Projects Hier finden Sie die Speed Projects chronologisch absteigend...
Reports des European Forecasting Network (EFN)
Reports des European Forecasting Network (EFN) Das European Forecasting Network...
Fiscal Policy and Fiscal Fragility: Empirical Evidence from the OECD ...
Does Machine Learning Help us Predict Banking Crises? ...
The Appropriateness of the Macroeconomic Imbalance Procedure for Central and Eastern European Countries
IWH Discussion Papers,
The experience of Central and Eastern European countries (CEEC) during the global financial crisis and in the resulting European debt crises has been largely different from that of other European countries. This paper looks at the specifics of the CEEC in recent history and focuses in particular on the appropriateness of the Macroeconomic Imbalances Procedure for this group of countries. In doing so, the macroeconomic situation in the CEEC is highlighted and macroeconomic problems faced by these countries are extracted. The findings are compared to the results of the Macroeconomic Imbalances Procedure of the European Commission. It is shown that while the Macroeconomic Imbalances Procedure correctly identifies some of the problems, it understates or overstates other problems. This is due to the specific construction of the broadened surveillance procedure, which largely disregarded the specifics of catching-up economies.