Optimizing Policymakers' Loss Functions in Crisis Prediction: Before, Within or After?
Peter Sarlin, Gregor von Schweinitz
Abstract
Early-warning models most commonly optimize signaling thresholds on crisis probabilities. The expost threshold optimization is based upon a loss function accounting for preferences between forecast errors, but comes with two crucial drawbacks: unstable thresholds in recursive estimations and an in-sample overfit at the expense of out-of-sample performance. We propose two alternatives for threshold setting: (i) including preferences in the estimation itself and (ii) setting thresholds ex-ante according to preferences only. Given probabilistic model output, it is intuitive that a decision rule is independent of the data or model specification, as thresholds on probabilities represent a willingness to issue a false alarm vis-à-vis missing a crisis. We provide simulated and real-world evidence that this simplification results in stable thresholds and improves out-of-sample performance. Our solution is not restricted to binary-choice models, but directly transferable to the signaling approach and all probabilistic early-warning models.
Artikel Lesen
Should Forecasters Use Real-time Data to Evaluate Leading Indicator Models for GDP Prediction? German Evidence
Katja Heinisch, Rolf Scheufele
Abstract
In this paper we investigate whether differences exist among forecasts using real-time or latest-available data to predict gross domestic product (GDP). We employ mixed-frequency models and real-time data to reassess the role of survey data relative to industrial production and orders in Germany. Although we find evidence that forecast characteristics based on real-time and final data releases differ, we also observe minimal impacts on the relative forecasting performance of indicator models. However, when obtaining the optimal combination of soft and hard data, the use of final release data may understate the role of survey information.
Artikel Lesen
Qual VAR Revisited: Good Forecast, Bad Story
Makram El-Shagi, Gregor von Schweinitz
Journal of Applied Economics,
Nr. 2,
2016
Abstract
Due to the recent financial crisis, the interest in econometric models that allow to incorporate binary variables (such as the occurrence of a crisis) experienced a huge surge. This paper evaluates the performance of the Qual VAR, originally proposed by Dueker (2005). The Qual VAR is a VAR model including a latent variable that governs the behavior of an observable binary variable. While we find that the Qual VAR performs reasonable well in forecasting (outperforming a probit benchmark), there are substantial identification problems even in a simple VAR specification. Typically, identification in economic applications is far more difficult than in our simple benchmark. Therefore, when the economic interpretation of the dynamic behavior of the latent variable and the chain of causality matter, use of the Qual VAR is inadvisable.
Artikel Lesen
Much Ado About Nothing: Sovereign Ratings and Government Bond Yields in the OECD
Makram El-Shagi
IWH Discussion Papers,
Nr. 22,
2016
Abstract
In this paper, we propose a new method to assess the impact of sovereign ratings on sovereign bond yields. We estimate the impulse response of the interest rate, following a change in the rating. Since ratings are ordinal and moreover extremely persistent, it proves difficult to estimate those impulse response functions using a VAR modeling ratings, yields and other macroeconomic indicators. However, given the highly stochastic nature of the precise timing of ratings, we can treat most rating adjustments as shocks. We thus no longer rely on a VAR for shock identification, making the estimation of the corresponding IRFs well suited for so called local projections – that is estimating impulse response functions through a series of separate direct forecasts over different horizons. Yet, the rare occurrence of ratings makes impulse response functions estimated through that procedure highly sensitive to individual observations, resulting in implausibly volatile impulse responses. We propose an augmentation to restrict jointly estimated local projections in a way that produces economically plausible impulse response functions.
Artikel Lesen
Asymmetric Investment Responses to Firm-specific Uncertainty
Julian Berner, Manuel Buchholz, Lena Tonzer
Abstract
This paper analyzes how firm-specific uncertainty affects firms’ propensity to invest. We measure firm-specific uncertainty as firms’ absolute forecast errors derived from survey data of German manufacturing firms over 2007–2011. In line with the literature, our empirical findings reveal a negative impact of firm-specific uncertainty on investment. However, further results show that the investment response is asymmetric, depending on the size and direction of the forecast error. The investment propensity declines significantly if the realized situation is worse than expected. However, firms do not adjust their investment if the realized situation is better than expected, which suggests that the uncertainty effect counteracts the positive effect due to unexpectedly favorable business conditions. This can be one explanation behind the phenomenon of slow recovery in the aftermath of financial crises. Additional results show that the forecast error is highly concurrent with an ex-ante measure of firm-specific uncertainty we obtain from the survey data. Furthermore, the effect of firm-specific uncertainty is enforced for firms that face a tighter financing situation.
Artikel Lesen
