Topic Extraction: BERTopic's Insight into the 117th Congress's Twitterverse

• Type: Article in International Scientific Journal
• Date: 2024

Authors

Mendonça, M (Author) Other; Figueira, A (Author) FCUP

Journal

Title: Informatics

Vol. 11

Final page: 8

ISSN: 2227-9709

Publisher: MDPI

Indexing

ISI Web of Knowledge - 4 Citations

Scopus - 5 Citations

Other information

Authenticus ID: P-00Z-ZEH

DOI: 10.3390/informatics11010008

Abstract (EN): As social media (SM) becomes increasingly prevalent, its impact on society is expected to grow accordingly. While SM has brought positive transformations, it has also amplified pre-existing issues such as misinformation, echo chambers, manipulation, and propaganda. A thorough comprehension of this impact, aided by state-of-the-art analytical tools and by an awareness of societal biases and complexities, enables us to anticipate and mitigate the potential negative effects. One such tool is BERTopic, a novel deep-learning algorithm developed for Topic Mining, which has been shown to offer significant advantages over traditional methods like Latent Dirichlet Allocation (LDA), particularly in terms of its high modularity, which allows for extensive personalization at each stage of the topic modeling process. In this study, we hypothesize that BERTopic, when optimized for Twitter data, can provide a more coherent and stable topic modeling. We began by conducting a review of the literature on topic-mining approaches for short-text data. Using this knowledge, we explored the potential for optimizing BERTopic and analyzed its effectiveness. Our focus was on Twitter data spanning the two years of the 117th US Congress. We evaluated BERTopic's performance using coherence, perplexity, diversity, and stability scores, finding significant improvements over traditional methods and the default parameters for this tool. We discovered that improvements are possible in BERTopic's coherence and stability. We also identified the major topics of this Congress, which include abortion, student debt, and Judge Ketanji Brown Jackson. Additionally, we describe a simple application we developed for a better visualization of Congress topics.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 34