Novelty detection with application to data streams

• Type: Article in International Scientific Journal
• Date: 2009

Authors

Eduardo Spinosa (Author) Other; João Gama (Author) FEP; Andre Carvalho (Author) Other

Journal

Title: Intelligent Data Analysis

Vol. 13 No. 1

Pages: 405-422

ISSN: 1088-467X

Publisher: IOS PRESS

Indexing

ISI Web of Knowledge - 42 Citations

ISI Web of Science

Scopus - 45 Citations

Scientific classification

FOS: Natural sciences > Computer and information sciences

Other information

Authenticus ID: P-003-QK0

DOI: 10.3233/ida-2009-0373

Abstract (EN): This paper presents and evaluates an approach to novelty detection that addresses it as the problem of identifying novel concepts in a continuous learning scenario, as an extension to a single-class classification problem. OLINDDA, an OnLIne Novelty and Drift Detection Algorithm that implements this approach, uses efficient standard clustering algorithms to continuously generate candidate clusters among examples that were not explained by the current known concepts. Clusters complying with a validation criterion that takes cohesiveness and representativeness into account are initially identified as concepts. By merging similar concepts, OLINDDA may enhance the representation of some concepts as it advances toward its final goal of describing novel emerging concepts in an unsupervised way. The proposed approach is experimentally evaluated by the use of several measures taken throughout the learning process. Results show that it is capable of identifying novel concepts that are pure and correspond to real classes, disregarding unrepresentative clusters and outliers.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 18