Text documents streams with improved incremental similarity

• Type: Article in International Scientific Journal
• Date: 2021

Authors

Sarmento, RP (Author) Other; Cardoso, DO (Author) Other; Dearo, K (Author) Other; Brazdil, P (Author) Other; João Gama (Author) FEP

Journal

Title: Social Network Analysis and Mining

Vol. 11 No. 1

Initial page: 113

ISSN: 1869-5450

Publisher: Springer Nature

Indexing

ISI Web of Knowledge - 2 Citations

Scopus - 2 Citations

Other information

Authenticus ID: P-00V-N65

DOI: 10.1007/s13278-021-00826-z

Abstract (EN): There has been a significant effort by the research community to address the problem of providing methods to organize documentation, with the help of Information Retrieval methods. In this paper, we present several experiments with stream analysis methods to explore streams of text documents. This paper also presents possible architectures of the Text Document Stream Organization, with the use of incremental algorithms like Incremental Sparse TF-IDF and Incremental Similarity. Our results show that with this architecture, significant improvements are achieved, regarding efficiency in grouping of similar documents. These improvements are important since it is of general knowledge that great amounts of text analysis are a high dimensional and complex subject of study, in the data analysis area.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 9