用图模型给文本主题打标签,速度快且效果不输大模型。
Efficient Topic Extraction via Graph-Based Labeling: A Lightweight Alternative to Deep Models
- 构建词语关系图,通过语义连接扩展并提炼主题词
- 在两个数据集上比传统方法更准,接近ChatGPT-3.5水平
- 适合资源有限但需可解释主题提取的场景
从文本中提取主题已成为重要任务,尤其面对海量非结构化数据。现有方法多依赖高计算成本的深度模型。本文认为概率与统计方法(如主题建模)可作为高效替代方案。主题建模虽能自动发现无标签文本中的主题,但输出为词语分布,可解释性差。本文目标是为这些词集赋予有意义的主题标签。为此提出一种轻量级图基标注方法,不仅通过语义关联扩展主题词,还挖掘词间关系以推导准确标签。在两个数据集上与ChatGPT-3.5等基准对比,本方法在BERTScore和余弦相似度上优于传统方法,结果接近ChatGPT-3.5,同时保持高计算效率。最后讨论未来方向,强调提升可解释性与自动化潜力。
原文摘要 · Abstract (English)
Extracting topics from text has become an essential task, especially with the rapid growth of unstructured textual data. Most existing works rely on highly computational methods to address this challenge. In this paper, we argue that probabilistic and statistical approaches, such as topic modeling (TM), can offer effective alternatives that require fewer computational resources. TM is a statistical method that automatically discovers topics in large collections of unlabeled text; however, it produces topics as distributions of representative words, which often lack clear interpretability. Our objective is to perform topic labeling by assigning meaningful labels to these sets of words. To achieve this without relying on computationally expensive models, we propose a graph-based approach that not only enriches topic words with semantically related terms but also explores the relationships among them. By analyzing these connections within the graph, we derive suitable labels that accurately capture each topic's meaning. We present a comparative study between our proposed method and several benchmarks, including ChatGPT-3.5, across two different datasets. Our method achieved consistently better results than traditional benchmarks in terms of BERTScore and cosine similarity and produced results comparable to ChatGPT-3.5, while remaining computationally efficient. Finally, we discuss future directions for topic labeling and highlight potential research avenues for enhancing interpretability and automation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。