Dataset Morphing to Analyze the Performance of Collaborative Filtering

• Type: Article in International Conference Proceedings Book
• Date: 2019

Authors

André Correia (Author) Other; Carlos Soares (Author) FEUP; Alípio Jorge (Author) FCUP

Conference proceedings International

Title: Discovery Science - 22nd International Conference, DS 2019, Split, Croatia, October 28-30, 2019, Proceedings

Pages: 29-39

22nd International Conference on Discovery Science, DS 2019

28 October 2019 through 30 October 2019

Indexing

Scopus - 4 Citations

Other information

Authenticus ID: P-00R-FAJ

DOI: 10.1007/978-3-030-33778-0_3

Abstract (EN): Machine Learning algorithms are often too complex to be studied from a purely analytical point of view. Alternatively, with a reasonably large number of datasets one can empirically observe the behavior of a given algorithm in different conditions and hypothesize some general characteristics. This knowledge about algorithms can be used to choose the most appropriate one given a new dataset. This very hard problem can be approached using metalearning. Unfortunately, the number of datasets available may not be sufficient to obtain reliable meta-knowledge. Additionally, datasets may change with time, by growing, shrinking and editing, due to natural actions like people buying in a e-commerce site. In this paper we propose dataset morphing as the basis of a novel methodology that can help overcome these drawbacks and can be used to better understand ML algorithms. It consists of manipulating real datasets through the iterative application of gradual transformations (morphing) and by observing the changes in the behavior of learning algorithms while relating these changes with changes in the meta features of the morphed datasets. Although dataset morphing can be envisaged in a much wider framework, we focus on one very specific instance: the study of collaborative filtering algorithms on binary data. Results show that the proposed approach is feasible and that it can be used to identify useful metafeatures to predict the best collaborative filtering algorithm for a given dataset. © Springer Nature Switzerland AG 2019.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 11