Concept Neurons - Handling Drift Issues for Real-Time Industrial Data Mining

• Type: Article in International Conference Proceedings Book
• Date: 2016

Authors

Luís Moreira-Matias (Author) Other; João Gama (Author) FEP; João Mendes-Moreira (Author) FEUP

Conference proceedings International

Title: MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2016, PT III

Pages: 96-111

European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECMLPKDD)

Riva del Garda, ITALY, SEP 19-23, 2016

Indexing

ISI Web of Knowledge - 13 Citations

Scopus - 12 Citations

Other information

Authenticus ID: P-00K-THA

DOI: 10.1007/978-3-319-46131-1_18

Abstract (EN): Learning from data streams is a challenge faced by data science professionals from multiple industries. Most of them struggle hardly on applying traditional Machine Learning algorithms to solve these problems. It happens so due to their high availability on ready-to-use software libraries on big data technologies (e.g. SparkML). Nevertheless, most of them cannot cope with the key characteristics of this type of data such as high arrival rate and/or non-stationary distributions. In this paper, we introduce a generic and yet simplistic framework to fill this gap denominated Concept Neurons. It leverages on a combination of continuous inspection schemas and residual-based updates over the model parameters and/or the model output. Such framework can empower the resistance of most of induction learning algorithms to concept drifts. Two distinct and hence closely related flavors are introduced to handle different drift types. Experimental results on successful distinct applications on different domains along transportation industry are presented to uncover the hidden potential of this methodology.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 16