Distributed generative data mining

• Type: Article in International Conference Proceedings Book
• Date: 2007

Authors

Ruy Ramos (Author) FEUP; Rui Camacho (Author) FEUP

Conference proceedings International

Title: 7th Industrial Conference on Data Mining (ICDM 2007)

Pages: 307-317

7th Industrial Conference on Data Mining (ICDM 2007)

Leipzig, Alemanha, Julho 14-18 de 2007

Indexing

ISI Web of Science

Scopus

INSPEC

Scientific classification

FOS: Engineering and technology > Electrical engineering, Electronic engineering, Information engineering

CORDIS: Technological sciences > Engineering > Computer engineering

Other information

DOI: 10.1007/978-3-540-73435-2_24

Abstract (EN): A process of Knowledge Discovery in Databases (KDD) involving large amounts of data requires a considerable amount of computational power. The process may be done on a dedicated and expensive machinery or, for some tasks, one can use distributed computing techniques on a network of affordable machines. In either approach it is usual the user to specify the workflow of the sub-tasks composing the whole KDD process before execution starts. In this paper we propose a technique that we call Distributed Generative Data Mining. The generative feature of the technique is due to its capability of generating new sub-tasks of the Data Mining analysis process at execution time. The workflow of sub-tasks of the DM is, therefore, dynamic. To deploy the proposed technique we extended the Distributed Data Mining system HARVARD and adapted an Inductive Logic Programming system (IndLog) used in a Relational Data Ming task. As a proof-of-concept, the extended system was used to analyse an artificial dataset of a credit scoring problem with eighty million records.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 11