用大模型重写推文,让疫情推文主题建模更清晰
Improving Topic Modeling of Social Media Short Texts with Rephrasing: A Case Study of COVID-19 Related Tweets
- 先用大模型把口语化推文改写成正式语言,再做主题建模
- 改写后主题一致性、多样性提升,冗余话题减少
- 尤其对LDA算法效果显著,适合公共卫生舆情分析
Twitter等社交平台在危机时期提供丰富公众讨论数据,但短文本的简略、非正式和噪声问题常导致传统主题建模产生难以理解的重复或混乱主题。为此,我们提出一种与模型无关的框架TM-Rephrase,利用大语言模型(LLMs)将原始推文重写为更标准、正式的语言,再进行主题建模。基于25,027条新冠相关推文的数据集,我们评估了通用及口语转正式两种重写策略对多种主题建模方法的影响。结果表明,TM-Rephrase在三个指标上均提升:主题一致性、主题唯一性和主题多样性,同时降低多数算法的主题冗余。其中,口语转正式策略效果最佳,尤其显著改善了隐含狄利克雷分配(LDA)算法的表现。本研究为公共卫生相关社交媒体分析中的主题建模提供了通用增强方法,具有广泛的应用前景。
原文摘要 · Abstract (English)
Social media platforms such as Twitter (now X) provide rich data for analyzing public discourse, especially during crises such as the COVID-19 pandemic. However, the brevity, informality, and noise of social media short texts often hinder the effectiveness of traditional topic modeling, producing incoherent or redundant topics that are often difficult to interpret. To address these challenges, we have developed \emph{TM-Rephrase}, a model-agnostic framework that leverages large language models (LLMs) to rephrase raw tweets into more standardized and formal language prior to topic modeling. Using a dataset of 25,027 COVID-19-related Twitter posts, we investigate the effects of two rephrasing strategies, general- and colloquial-to-formal-rephrasing, on multiple topic modeling methods. Results demonstrate that \emph{TM-Rephrase} improves three metrics measuring topic modeling performance (i.e., topic coherence, topic uniqueness, and topic diversity) while reducing topic redundancy of most topic modeling algorithms, with the colloquial-to-formal strategy yielding the greatest performance gains and especially for the Latent Dirichlet Allocation (LDA) algorithm. This study contributes to a model-agnostic approach to enhancing topic modeling in public health related social media analysis, with broad implications for improved understanding of public discourse in health crisis as well as other important domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。