通过1140次运行评估主题模型，揭示参数优化的权衡与使用风险。
Holistic Evaluations of Topic Models
- 基于1140次BERTopic运行，从数据库视角评估主题模型性能
- 发现参数调整在主题质量与可解释性间存在显著权衡
- 提醒研究者警惕黑箱输出，倡导负责任的主题建模实践
主题模型因其总结海量非结构化文本的能力，正获得越来越多的学术与商业关注。作为无监督机器学习方法，它们帮助研究人员探索数据，辅助普通用户理解大规模文本集合中的核心主题。然而，这些模型可能沦为‘黑箱’：用户输入数据后直接接受输出作为准确摘要，缺乏批判性审视。本文基于1140次BERTopic模型运行，从数据库视角评估主题模型，旨在识别模型参数优化中的权衡，并反思这些发现对主题模型解读与负责任使用的意义。
原文摘要 · Abstract (English)
Topic models are gaining increasing commercial and academic interest for their ability to summarize large volumes of unstructured text. As unsupervised machine learning methods, they enable researchers to explore data and help general users understand key themes in large text collections. However, they risk becoming a 'black box', where users input data and accept the output as an accurate summary without scrutiny. This article evaluates topic models from a database perspective, drawing insights from 1140 BERTopic model runs. The goal is to identify trade-offs in optimizing model parameters and to reflect on what these findings mean for the interpretation and responsible use of topic models
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。