Comparing Density Forecasts via Weighted Likelihood Ratio Tests: Asymptotic and Bootstrap Methods
This paper proposes tests for comparing the accuracy of density forecasts. The evaluation makes use of scoring rules, which are loss functions defined over the density forecast and the realizations of the variable. In particular, a logarithmic scoring rule leads to the development of asymptotic and bootstrap 'weighted likelihood ratio' tests. I conclude with an application to S&P500 daily returns, comparing the performance of density forecasts obtained from GARCH models with different distributional assumptions.
This paper proposes and analyzes tests that can be used to compare the accuracy of alternative conditional density forecasts of a variable. The tests are also valid in the broader context of model selection based on out-of-sample predictive ability. We restrict attention to the case of density forecasts derived from non-nested parametric models, with known or estimated parameters. The evaluation makes use of scoring rules, which are loss functions defined over the density forecast and the realizations of the variable. In particular, we consider the logarithmic scoring rule, which leads to the development of asymptotic and bootstrap 'weighted likelihood ratio' tests. The name comes from the fact that the tests compare weighted averages of the scores over the available sample, as a way to focus attention on different regions of the distribution of the variable. For a uniform weight function, the asymptotic test can be interpreted as an extension of Vuong (1989)' s likelihood ratio test for non-nested hypotheses to time series data and to an out-of-sample testing framework. A Monte Carlo simulation explores the size and power properties of this last test in finite samples. An application using S&P500 daily returns shows how the tests can be used to compare the performance of density forecasts obtained from GARCH models with different distributional assumptions.
density forecasting, scoring rules, predictive ability, forecast comparison,
In order to set up a list of libraries that you have access to,
you must first login
or sign up.
Then set up a personal list of libraries from your profile page by
clicking on your user name at the top right of any screen.