arXiv:2503.02741stat.MEcs.CL2025-03被引 3

用关键词引导主题模型,让机器更懂人类预设的分类逻辑。

Seeded Poisson Factorization: leveraging domain knowledge to fit topic models

  • 通过种子词修改词频先验,将领域知识融入主题发现过程。
  • 在亚马逊评论数据上,分类准确率和计算效率均优于对比模型。
  • 即使种子词不完美,仍能自适应平衡先验知识与数据特征。

主题模型广泛用于从大规模文本中挖掘潜在主题结构,但传统无监督方法常难以对齐预定义的概念领域。本文提出种子泊松分解(SPF),在泊松分解(PF)框架基础上引入种子词以融合领域知识。SPF通过调整特定主题下词语出现频率的先验分布,为预定义种子词赋予更高的初始发生率。采用变分推断结合随机梯度优化进行模型估计,保障了在大规模数据上的可扩展性。在亚马逊客户反馈数据集上的实验表明,利用预定义的产品类别作为引导结构,SPF在计算效率和分类性能上均优于其他有指导的概率主题模型。稳健性分析显示,即使种子词选择存在偏差,SPF仍能自适应地平衡领域知识与数据驱动的主题发现。此外,在四个不同规模与主题数量的基准数据集上的应用进一步验证了其相较于未加种子的PF模型具有更优的分类表现。

原文摘要 · Abstract (English)

Topic models are widely used for discovering latent thematic structures in large text corpora, yet traditional unsupervised methods often struggle to align with pre-defined conceptual domains. This paper introduces seeded Poisson Factorization (SPF), a novel approach that extends the Poisson Factorization (PF) framework by incorporating domain knowledge through seed words. SPF enables a structured topic discovery by modifying the prior distribution of topic-specific term intensities, assigning higher initial rates to pre-defined seed words. The model is estimated using variational inference with stochastic gradient optimization, ensuring scalability to large datasets. We present in detail the results of applying SPF to an Amazon customer feedback dataset, leveraging pre-defined product categories as guiding structures. SPF achieves superior performance compared to alternative guided probabilistic topic models in terms of computational efficiency and classification performance. Robustness checks highlight SPF's ability to adaptively balance domain knowledge and data-driven topic discovery, even in case of imperfect seed word selection. Further applications of SPF to four additional benchmark datasets, where the corpus varies in size and the number of topics differs, demonstrate its general superior classification performance compared to the unseeded PF model.

主题模型领域知识泊松分解种子词

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。