Transparency and Forecasting: The Impact of Conditioning Assumptions on Forecast Accuracy
Katja Heinisch, Christoph Schult, Carola Stapper
Applied Economic Letters,
im Erscheinen
Abstract
This study investigates the impact of inaccurate assumptions on economic forecast precision. We construct a new dataset comprising an unbalanced panel of annual German GDP forecasts from various institutions, taking into account their underlying assumptions. We explicitly control for different forecast horizons to reflect the information available at the time of release. Our analysis reveals that approximately 75% of the variation in squared forecast errors can be attributed to the variation in squared errors of the initial assumptions. This finding emphasizes the importance of accurate assumptions in economic forecasting and suggests that forecasters should transparently disclose their assumptions to enhance the usefulness of their forecasts in shaping effective policy recommendations.
Artikel Lesen
Step by Step ‒ A Quarterly Evaluation of EU Commission's GDP Forecasts
Katja Heinisch
Journal of Forecasting,
Nr. 3,
2025
Abstract
The European Commission’s growth forecasts play a crucial role in shaping policies and provide a benchmark for many (national) forecasters. The annual forecasts are built on quarterly estimates, which do not receive much attention and are hardly known. Therefore, this paper provides a comprehensive analysis of multi-period ahead quarterly GDP growth forecasts for the European Union (EU), euro area, and several EU member states with respect to first-release and current-release data. Forecast revisions and forecast errors are analyzed, and the results show that the forecasts are not systematically biased. However, GDP forecasts for several member states tend to be overestimated at short-time horizons. Furthermore, the final forecast revision in the current quarter is generally downward biased for almost all countries. Overall, the differences in mean forecast errors are minor when using real-time data or pseudo-real-time data and these differences do not significantly impact the overall assessment of the forecasts’ quality. Additionally, the forecast performance varies across countries, with smaller countries and Central and Eastern European countries (CEECs) experiencing larger forecast errors. The paper provides evidence that there is still potential for improvement in forecasting techniques both for nowcasts but also forecasts up to eight quarters ahead. In the latter case, the performance of the mean forecast tends to be superior for many countries.
Artikel Lesen
12.03.2025 • 9/2025
IWH präsentiert neues Prognose-Dashboard zur deutschen Wirtschaft
Das Leibniz-Institut für Wirtschaftsforschung Halle (IWH) stellt ein umfassendes Daten-Tool bereit, das einen interaktiven Vergleich unterschiedlicher Prognosen für die Wirtschaftsentwicklung in Deutschland erlaubt. Entscheider aus Politik und Wirtschaft sowie Interessierte aus Medien, Wissenschaft und Öffentlichkeit können das IWH Forecasting Dashboard kostenfrei nutzen.
Oliver Holtemöller
Lesen
Forecasting Natural Gas Prices in Real Time
Christiane Baumeister, Florian Huber, Thomas K. Lee, Francesco Ravazzolo
NBER Working Paper,
Nr. 33156,
2024
Abstract
This paper provides a comprehensive analysis of the forecastability of the real price of natural gas in the United States at the monthly frequency considering a universe of models that differ in their complexity and economic content. Our key finding is that considerable reductions in mean-squared prediction error relative to a random walk benchmark can be achieved in real time for forecast horizons of up to two years. A particularly promising model is a six-variable Bayesian vector autoregressive model that includes the fundamental determinants of the supply and demand for natural gas. To capture real-time data constraints of these and other predictor variables, we assemble a rich database of historical vintages from multiple sources. We also compare our model-based forecasts to readily available model-free forecasts provided by experts and futures markets. Given that no single forecasting method dominates all others, we explore the usefulness of pooling forecasts and find that combining forecasts from individual models selected in real time based on their most recent performance delivers the most accurate forecasts.
Artikel Lesen
Forecast Combination and Interpretability Using Random Subspace
Boris Kozyrev
IWH Discussion Papers,
Nr. 21,
2024
Abstract
This paper investigates forecast aggregation via the random subspace regressions method (RSM) and explores the potential link between RSM and the Shapley value decomposition (SVD) using the US GDP growth rates. This technique combination enables handling high-dimensional data and reveals the relative importance of each individual forecast. First, it is possible to enhance forecasting performance in certain practical instances by randomly selecting smaller subsets of individual forecasts and obtaining a new set of predictions based on a regression-based weighting scheme. The optimal value of selected individual forecasts is also empirically studied. Then, a connection between RSM and SVD is proposed, enabling the examination of each individual forecast’s contribution to the final prediction, even when there is a large number of forecasts. This approach is model-agnostic (can be applied to any set of predictions) and facilitates understanding of how the aggregated prediction is obtained based on individual forecasts, which is crucial for decision-makers.
Artikel Lesen
Medienecho
Medienecho Mai 2025 Oliver Holtemöller: Wie Unternehmen von Bürokratie entlastet werden sollen (Bericht mit O-Ton ab Min 3:10) in: MDR SACHSEN-ANHALT HEUTE, 07.05.2025 Oliver…
Zur Seite
Risky Oil: It's All in the Tails
Christiane Baumeister, Florian Huber, Massimiliano Marcellino
NBER Working Paper,
Nr. 32524,
2024
Abstract
The substantial fluctuations in oil prices in the wake of the COVID-19 pandemic and the Russian invasion of Ukraine have highlighted the importance of tail events in the global market for crude oil which call for careful risk assessment. In this paper we focus on forecasting tail risks in the oil market by setting up a general empirical framework that allows for flexible predictive distributions of oil prices that can depart from normality. This model, based on Bayesian additive regression trees, remains agnostic on the functional form of the conditional mean relations and assumes that the shocks are driven by a stochastic volatility model. We show that our nonparametric approach improves in terms of tail forecasts upon three competing models: quantile regressions commonly used for studying tail events, the Bayesian VAR with stochastic volatility, and the simple random walk. We illustrate the practical relevance of our new approach by tracking the evolution of predictive densities during three recent economic and geopolitical crisis episodes, by developing consumer and producer distress indices that signal the build-up of upside and downside price risk, and by conducting a risk scenario analysis for 2024.
Artikel Lesen
Archiv
Medienecho-Archiv 2021 2020 2019 2018 2017 2016 Dezember 2021 IWH: Ausblick auf Wirtschaftsjahr 2022 in Sachsen mit Bezug auf IWH-Prognose zu Ostdeutschland: "Warum Sachsens…
Zur Seite
Forecasting Economic Activity Using a Neural Network in Uncertain Times: Monte Carlo Evidence and Application to the
German GDP
Oliver Holtemöller, Boris Kozyrev
IWH Discussion Papers,
Nr. 6,
2024
Abstract
In this study, we analyzed the forecasting and nowcasting performance of a generalized regression neural network (GRNN). We provide evidence from Monte Carlo simulations for the relative forecast performance of GRNN depending on the data-generating process. We show that GRNN outperforms an autoregressive benchmark model in many practically relevant cases. Then, we applied GRNN to forecast quarterly German GDP growth by extending univariate GRNN to multivariate and mixed-frequency settings. We could distinguish between “normal” times and situations where the time-series behavior is very different from “normal” times such as during the COVID-19 recession and recovery. GRNN was superior in terms of root mean forecast errors compared to an autoregressive model and to more sophisticated approaches such as dynamic factor models if applied appropriately.
Artikel Lesen