Media Response
Media Response November 2024 Steffen Müller: Firmaer er oftere i problemer in: Flensborg Avis, 22.11.2024 Steffen Müller: Zahl der Insolvenzen steigt in: Süddeutsche.de,…
See page
Optimizing Policymakers’ Loss Functions in Crisis Prediction: Before, Within or After?
Peter Sarlin, Gregor von Schweinitz
Macroeconomic Dynamics,
No. 1,
2021
Abstract
Recurring financial instabilities have led policymakers to rely on early-warning models to signal financial vulnerabilities. These models rely on ex-post optimization of signaling thresholds on crisis probabilities accounting for preferences between forecast errors, but come with the crucial drawback of unstable thresholds in recursive estimations. We propose two alternatives for threshold setting with similar or better out-of-sample performance: (i) including preferences in the estimation itself and (ii) setting thresholds ex-ante according to preferences only. Given probabilistic model output, it is intuitive that a decision rule is independent of the data or model specification, as thresholds on probabilities represent a willingness to issue a false alarm vis-à-vis missing a crisis. We provide real-world and simulation evidence that this simplification results in stable thresholds, while keeping or improving on out-of-sample performance. Our solution is not restricted to binary-choice models, but directly transferable to the signaling approach and all probabilistic early-warning models.
Read article
An Evaluation of Early Warning Models for Systemic Banking Crises: Does Machine Learning Improve Predictions?
Johannes Beutel, Sophia List, Gregor von Schweinitz
Abstract
This paper compares the out-of-sample predictive performance of different early warning models for systemic banking crises using a sample of advanced economies covering the past 45 years. We compare a benchmark logit approach to several machine learning approaches recently proposed in the literature. We find that while machine learning methods often attain a very high in-sample fit, they are outperformed by the logit approach in recursive out-of-sample evaluations. This result is robust to the choice of performance measure, crisis definition, preference parameter, and sample length, as well as to using different sets of variables and data transformations. Thus, our paper suggests that further enhancements to machine learning early warning models are needed before they are able to offer a substantial value-added for predicting systemic banking crises. Conventional logit models appear to use the available information already fairly effciently, and would for instance have been able to predict the 2007/2008 financial crisis out-of-sample for many countries. In line with economic intuition, these models identify credit expansions, asset price booms and external imbalances as key predictors of systemic banking crises.
Read article
The Joint Dynamics of Sovereign Ratings and Government Bond Yields
Makram El-Shagi, Gregor von Schweinitz
Journal of Banking and Finance,
2018
Abstract
Can a negative shock to sovereign ratings invoke a vicious cycle of increasing government bond yields and further downgrades, ultimately pushing a country toward default? The narratives of public and political discussions, as well as of some widely cited papers, suggest this possibility. In this paper, we will investigate the possible existence of such a vicious cycle. We find no evidence of a bad long-run equilibrium and cannot confirm a feedback loop leading into default as a transitory state for all but the very worst ratings. We use a bivariate semiparametric dynamic panel model to reproduce the joint dynamics of sovereign ratings and government bond yields. The individual equations resemble Pesaran-type cointegration models, which allow for valid interference regardless of whether the employed variables display unit-root behavior. To incorporate most of the empirical features previously documented (separately) in the literature, we allow for different long-run relationships in both equations, nonlinearities in the level effects of ratings, and asymmetric effects in changes of ratings and yields. Our finding of a single good equilibrium implies the slow convergence of ratings and yields toward this equilibrium. However, the persistence of ratings is sufficiently high that a rating shock can have substantial costs if it occurs at a highly speculative rating or lower. Rating shocks that drive the rating below this threshold can increase the interest rate sharply, and for a long time. Yet, simulation studies based on our estimations show that it is highly improbable that rating agencies can be made responsible for the most dramatic spikes in interest rates.
Read article
Optimizing Policymakers' Loss Functions in Crisis Prediction: Before, Within or After?
Peter Sarlin, Gregor von Schweinitz
Abstract
Early-warning models most commonly optimize signaling thresholds on crisis probabilities. The expost threshold optimization is based upon a loss function accounting for preferences between forecast errors, but comes with two crucial drawbacks: unstable thresholds in recursive estimations and an in-sample overfit at the expense of out-of-sample performance. We propose two alternatives for threshold setting: (i) including preferences in the estimation itself and (ii) setting thresholds ex-ante according to preferences only. Given probabilistic model output, it is intuitive that a decision rule is independent of the data or model specification, as thresholds on probabilities represent a willingness to issue a false alarm vis-à-vis missing a crisis. We provide simulated and real-world evidence that this simplification results in stable thresholds and improves out-of-sample performance. Our solution is not restricted to binary-choice models, but directly transferable to the signaling approach and all probabilistic early-warning models.
Read article
Qual VAR Revisited: Good Forecast, Bad Story
Makram El-Shagi, Gregor von Schweinitz
Journal of Applied Economics,
No. 2,
2016
Abstract
Due to the recent financial crisis, the interest in econometric models that allow to incorporate binary variables (such as the occurrence of a crisis) experienced a huge surge. This paper evaluates the performance of the Qual VAR, originally proposed by Dueker (2005). The Qual VAR is a VAR model including a latent variable that governs the behavior of an observable binary variable. While we find that the Qual VAR performs reasonable well in forecasting (outperforming a probit benchmark), there are substantial identification problems even in a simple VAR specification. Typically, identification in economic applications is far more difficult than in our simple benchmark. Therefore, when the economic interpretation of the dynamic behavior of the latent variable and the chain of causality matter, use of the Qual VAR is inadvisable.
Read article
Optimizing Policymakers' Loss Functions in Crisis Prediction: Before, Within or After?
Peter Sarlin, Gregor von Schweinitz
Abstract
Early-warning models most commonly optimize signaling thresholds on crisis probabilities. The ex-post threshold optimization is based upon a loss function accounting for preferences between forecast errors, but comes with two crucial drawbacks: unstable thresholds in recursive estimations and an in-sample overfit at the expense of out-of-sample performance. We propose two alternatives for threshold setting: (i) including preferences in the estimation itself and (ii) setting thresholds ex-ante according to preferences only. We provide simulated and real-world evidence that this simplification results in stable thresholds and improves out-of-sample performance. Our solution is not restricted to binary-choice models, but directly transferable to the signaling approach and all probabilistic early-warning models.
Read article
Linking Distress of Financial Institutions to Macrofinancial Shocks
Alexander Al-Haschimi, Stéphane Dées, Filippo di Mauro, Martina Jančoková
ECB Working Paper,
No. 1749,
2014
Abstract
This paper links granular data of financial institutions to global macroeconomic variables using an infinite-dimensional vector autoregressive (IVAR) model framework. The approach taken allows for an assessment of the two-way links between the financial system and the macroeconomy, while accounting for heterogeneity among financial institutions and the role of international linkages in the transmission of shocks. The model is estimated using macroeconomic data for 21 countries and default probability estimates for 35 euro area financial institutions. This framework is used to assess the impact of foreign macroeconomic shocks on default risks of euro area financial firms. In addition, spillover effects of firm-specific shocks are investigated. The model captures the important role of international linkages, showing that economic shocks in the US can generate a rise in the default probabilities of euro area firms that are of a significant magnitude compared to recent historical episodes such as the financial crisis. Moreover, the potential heterogeneity across financial firms.
Read article
Qual VAR Revisited: Good Forecast, Bad Story
Makram El-Shagi, Gregor von Schweinitz
Abstract
Due to the recent financial crisis, the interest in econometric models that allow to incorporate binary variables (such as the occurrence of a crisis) experienced a huge surge. This paper evaluates the performance of the Qual VAR, i.e. a VAR model including a latent variable that governs the behavior of an observable binary variable. While we find that the Qual VAR performs reasonably well in forecasting (outperforming a probit benchmark), there are substantial identification problems. Therefore, when the economic interpretation of the dynamic behavior of the latent variable and the chain of causality matter, the Qual VAR is inadvisable.
Read article
The Performance of Short-term Forecasts of the German Economy before and during the 2008/2009 Recession
Katja Drechsel, Rolf Scheufele
International Journal of Forecasting,
No. 2,
2012
Abstract
The paper analyzes the forecasting performance of leading indicators for industrial production in Germany. We focus on single and pooled leading indicator models both before and during the financial crisis. Pairwise and joint significant tests are used to evaluate single indicator models as well as forecast combination methods. In addition, we investigate the stability of forecasting models during the most recent financial crisis.
Read article
