通过双向主题匹配量化文本集合间的主题重叠与差异。
Bidirectional Topic Matching: Quantifying Thematic Overlap Between Corpora Through Topic Modelling
- 构建双向模型,分别训练各语料主题并互相对照。
- 可识别共现主题与独特主题,准确揭示语义关联。
- 适合政治话语、跨学科研究等主题对比场景。
本文提出双向主题匹配(BTM),一种用于跨语料库主题建模的新方法,可量化不同语料库之间的主题重叠与差异。BTM 是一个灵活框架,兼容 BERTopic、Top2Vec 及 LDA 等多种主题模型。其采用双模型策略,分别为每个语料库独立训练主题模型,并将它们相互应用于对方,实现全面的跨语料比较。该方法能有效识别共享主题与独有主题,提供对主题关系的细致洞察。在与余弦相似度方法的对比中,BTM 展现出强一致性与在处理异常主题方面的优势。以气候新闻文章为案例,验证了其在揭示气候变化与气候行动相关语料间显著主题重叠与区别的能力。其灵活性与精度使其适用于政治话语分析、跨学科研究等多种场景。通过融合共现与独特主题分析,BTM 提供了一个全面探索主题关系的框架,未来可扩展至多语言和动态数据集。本研究展示了 BTM 的方法论贡献及其在多个领域推进话语分析的潜力。
原文摘要 · Abstract (English)
This study introduces Bidirectional Topic Matching (BTM), a novel method for cross-corpus topic modeling that quantifies thematic overlap and divergence between corpora. BTM is a flexible framework that can incorporate various topic modeling approaches, including BERTopic, Top2Vec, and Latent Dirichlet Allocation (LDA). BTM employs a dual-model approach, training separate topic models for each corpus and applying them reciprocally to enable comprehensive cross-corpus comparisons. This methodology facilitates the identification of shared themes and unique topics, providing nuanced insights into thematic relationships. Validation against cosine similarity-based methods demonstrates the robustness of BTM, with strong agreement metrics and distinct advantages in handling outlier topics. A case study on climate news articles showcases BTM's utility, revealing significant thematic overlaps and distinctions between corpora focused on climate change and climate action. BTM's flexibility and precision make it a valuable tool for diverse applications, from political discourse analysis to interdisciplinary studies. By integrating shared and unique topic analyses, BTM offers a comprehensive framework for exploring thematic relationships, with potential extensions to multilingual and dynamic datasets. This work highlights BTM's methodological contributions and its capacity to advance discourse analysis across various domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。