用凸非负矩阵分解分析学术期刊主题演化,提升主题稳定性和可解释性。
Dynamic Topic Analysis in Academic Journals using Convex Non-negative Matrix Factorization Method
- 两阶段框架:先用双层NMF提取年度主题,再用凸优化精炼动态结构。
- 在0.4~0.9稀疏度下,主题排序稳定性提升24.5%至56.6%。
- 适合关注科研趋势、主题演化分析的研究者使用。
随着大语言模型的快速发展,学术主题识别与演化分析对提升AI理解能力至关重要。动态主题分析为捕捉大规模数据集中主题的时间演变提供了有效方法。本文提出一种两阶段动态主题分析框架,结合凸优化以增强主题一致性、稀疏性与可解释性。第一阶段采用双层非负矩阵分解(NMF)模型提取年度主题并识别关键术语;第二阶段利用凸非负矩阵分解(cNMF)模型优化动态主题结构,进一步提升主题整合与稳定性。将该方法应用于2004至2022年IEEE期刊摘要,有效识别并量化了新冠疫情、数字孪生等新兴研究主题。通过优化传统与新兴主题在聚类特征空间中的稀疏差异,框架深化了对主题演化与排名的理解。NMF-cNMF模型在稀疏度为0.4、0.6和0.9时,主题排名稳定性分别提升24.51%、56.60%和36.93%。源代码(待发表后公开)见https://github.com/meetyangyang/CDNMF。
原文摘要 · Abstract (English)
With the rapid advancement of large language models, academic topic identification and topic evolution analysis are crucial for enhancing AI's understanding capabilities. Dynamic topic analysis provides a powerful approach to capturing and understanding the temporal evolution of topics in large-scale datasets. This paper presents a two-stage dynamic topic analysis framework that incorporates convex optimization to improve topic consistency, sparsity, and interpretability. In Stage 1, a two-layer non-negative matrix factorization (NMF) model is employed to extract annual topics and identify key terms. In Stage 2, a convex optimization algorithm refines the dynamic topic structure using the convex NMF (cNMF) model, further enhancing topic integration and stability. Applying the proposed method to IEEE journal abstracts from 2004 to 2022 effectively identifies and quantifies emerging research topics, such as COVID-19 and digital twins. By optimizing sparsity differences in the clustering feature space between traditional and emerging research topics, the framework provides deeper insights into topic evolution and ranking analysis. Moreover, the NMF-cNMF model demonstrates superior stability in topic consistency. At sparsity levels of 0.4, 0.6, and 0.9, the proposed approach improves topic ranking stability by 24.51%, 56.60%, and 36.93%, respectively. The source code (to be open after publication) is available at https://github.com/meetyangyang/CDNMF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。