Enhancing data stream predictions with reliability estimators and explanation

• Type: Article in International Scientific Journal
• Date: 2014

Authors

Zoran Bosnic (Author) Other; Jaka Demsar (Author) Other; Grega Kespret (Author) Other; Pedro Pereira Rodrigues (Author) FMUP; Joao Gama (Author) FEP; Igor Kononenko (Author) Other

Journal

Title: Engineering Applications of Artificial Intelligence

Vol. 34

Pages: 178-192

ISSN: 0952-1976

Publisher: Elsevier

Indexing

ISI Web of Knowledge - 13 Citations

Scopus - 12 Citations

Scientific classification

FOS: Engineering and technology > Electrical engineering, Electronic engineering, Information engineering

Other information

Authenticus ID: P-009-PMJ

DOI: 10.1016/j.engappai.2014.06.001

Abstract (EN): Incremental learning from data streams is increasingly attracting research focus due to many real streaming problems (such as learning from transactions, sensors or other sequential observations) that require processing and forecasting in the real time. In this paper we deal with two issues related to incremental learning - prediction accuracy and prediction explanation - and demonstrate their applicability on several streaming problems for predicting electricity load in the future. For improving prediction accuracy we propose and evaluate the use of two reliability estimators that allow us to estimate prediction error and correct predictions. For improving interpretability of the incremental model and its predictions we propose an adaptation of the existing prediction explanation methodology, which was originally developed for batch learning from stationary data. The explanation methodology is combined with a state-of-the-art concept drift detector and a visualization technique to enhance the explanation in dynamic streaming settings. The results show that the proposed approaches can improve prediction accuracy and allow transparent insight into the modeled concept.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 15