Measures for Combining Prediction Intervals Uncertainty and Reliability in Forecasting

• Type: Article in International Conference Proceedings Book
• Date: 2016

Authors

Almeida, V (Author) Other; João Gama (Author) FEP

Conference proceedings International

Title: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON COMPUTER RECOGNITION SYSTEMS, CORES 2015

Pages: 147-157

9th International Conference on Computer Recognition Systems (CORES)

Wroclaw, POLAND, MAY 25-27, 2015

Indexing

ISI Web of Knowledge - 0 Citations

Scopus - 0 Citations

Other information

Authenticus ID: P-00K-9G4

DOI: 10.1007/978-3-319-26227-7_14

Abstract (EN): In this paper we propose a new methodology for evaluating prediction intervals (PIs). Typically, PIs are evaluated with reference to confidence values. However, other metrics should be considered, since high values are associated to too wide intervals that convey little information and are of no use for decision-making. We propose to compare the error distribution (predictions out of the interval) and the maximum mean absolute error (MAE) allowed by the confidence limits. Along this paper PIs based on neural networks for short-term load forecast are compared using two different strategies: (1) dual perturb and combine (DPC) algorithm and (2) conformal prediction. We demonstrated that depending on the real scenario (e.g., time of day) different algorithms perform better. The main contribution is the identification of high uncertainty levels in forecast that can guide the decision-makers to avoid the selection of risky actions under uncertain conditions. Small errors mean that decisions can be made more confidently with less chance of confronting a future unexpected condition.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 11