Comparing predictive performance
Forecasts are generally surrounded by uncertainty and being able to quantify this uncertainty is key to good decision making. Accordingly, probabilistic forecasts in the form of predictive probability distributions over future quantities or events have become popular over the last decades in various fields including meteorology, climate science, hydrology, seismology, economics, finance, demography, and political science.
In typical applications, many alternative statistical models and data sources can be used to produce probabilistic forecasts. Hence, evaluating and selecting among competing methods is an important task. The scoringRules package for R provides functionality for comparative evaluation of probabilistic models based on proper scoring rules, covering a wide range of situations in applied work.
The scoringRules package aims to be a comprehensive library for computing scoring rules. We offer implementations of several known (but not routinely applied) formulas and implement some closed-form expressions that were previously unavailable. Whenever more than one implementation variant exists, we offer statistically principled default choices. The package contains the continuous ranked probability score (CRPS) and the logarithmic score, as well as the multivariate energy score and variogram score. All of these scoring rules are proper, which means that forecasters have an incentive to state their true belief.
scoringRules was developed in the Computational Statistics group at HITS is available on CRAN, and developed on GitHub.
References:
Alexander Jordan, Fabian Krüger, Sebastian Lerch
Evaluating Probabilistic Forecasts with scoringRules
J. Stat. Softw. (2019) 90(12):1–37, DOI: 10.18637/jss.v090.i12
The Heidelberg Institute for Theoretical Studies (HITS) was established in 2010 by the physicist and SAP co-founder Klaus Tschira (1940-2015) and the Klaus Tschira Foundation as a private, non-profit research institute. HITS conducts basic research in the natural sciences, mathematics and computer science, with a focus on the processing, structuring, and analyzing of large amounts of complex data and the development of computational methods and software. The research fields range from molecular biology to astrophysics. The shareholders of HITS are the HITS-Stiftung, which is a subsidiary of the Klaus Tschira Foundation, Heidelberg University and the Karlsruhe Institute of Technology (KIT). HITS also cooperates with other universities and research institutes and with industrial partners. The base funding of HITS is provided by the HITS Stiftung with funds received from the Klaus Tschira Foundation. The primary external funding agencies are the Federal Ministry of Education and Research (BMBF), the German Research Foundation (DFG), and the European Union.
This page is only available in English
We use cookies on our website. Some of them are essential, while others help us improve this site and your experience.
Here you will find an overview of all cookies used. You can give your consent to entire categories or have further information displayed and thus select only certain cookies.
Essential cookies enable basic functions and are necessary for the proper functioning of the website.
Name | |
---|---|
Provider | Eigentümer dieser Website |
Purpose | Speichert die Einstellungen der Besucher, die in der Cookie Box von Borlabs Cookie ausgewählt wurden. |
Cookie Name | borlabs-cookie |
Cookie Expiry | 1 Jahr |
Statistics Cookies collect information anonymously. This information helps us to understand how our visitors use our website.
Accept | |
---|---|
Name | |
Provider | HITS gGmbH |
Purpose | Cookie von Matomo für Website-Analysen. Erzeugt statistische Daten darüber, wie der Besucher die Website nutzt. |
Cookie Name | _pk_*.* |
Cookie Expiry | 13 Monate |
Content from video platforms and social media platforms is blocked by default. If cookies from external media are accepted, access to this content no longer requires manual consent.
Accept | |
---|---|
Name | |
Provider | |
Purpose | Wird verwendet, um Facebook-Inhalte zu entsperren. |
Privacy Policy | https://www.facebook.com/privacy/explanation |
Host(s) | .facebook.com |
Accept | |
---|---|
Name | |
Provider | |
Purpose | Wird zum Entsperren von Google Maps-Inhalten verwendet. |
Privacy Policy | https://policies.google.com/privacy |
Host(s) | .google.com |
Cookie Name | NID |
Cookie Expiry | 6 Monate |
Accept | |
---|---|
Name | |
Provider | |
Purpose | Wird verwendet, um Instagram-Inhalte zu entsperren. |
Privacy Policy | https://www.instagram.com/legal/privacy/ |
Host(s) | .instagram.com |
Cookie Name | pigeon_state |
Cookie Expiry | Sitzung |
Accept | |
---|---|
Name | |
Provider | OpenStreetMap Foundation |
Purpose | Wird verwendet, um OpenStreetMap-Inhalte zu entsperren. |
Privacy Policy | https://wiki.osmfoundation.org/wiki/Privacy_Policy |
Host(s) | .openstreetmap.org |
Cookie Name | _osm_location, _osm_session, _osm_totp_token, _osm_welcome, _pk_id., _pk_ref., _pk_ses., qos_token |
Cookie Expiry | 1-10 Jahre |
Accept | |
---|---|
Name | |
Provider | |
Purpose | Wird verwendet, um Twitter-Inhalte zu entsperren. |
Privacy Policy | https://twitter.com/privacy |
Host(s) | .twimg.com, .twitter.com |
Cookie Name | __widgetsettings, local_storage_support_test |
Cookie Expiry | Unbegrenzt |
Accept | |
---|---|
Name | |
Provider | Vimeo |
Purpose | Wird verwendet, um Vimeo-Inhalte zu entsperren. |
Privacy Policy | https://vimeo.com/privacy |
Host(s) | player.vimeo.com |
Cookie Name | vuid |
Cookie Expiry | 2 Jahre |
Accept | |
---|---|
Name | |
Provider | YouTube |
Purpose | Wird verwendet, um YouTube-Inhalte zu entsperren. |
Privacy Policy | https://policies.google.com/privacy |
Host(s) | google.com |
Cookie Name | NID |
Cookie Expiry | 6 Monate |