arXiv:2504.15640cs.CLcs.AI2025-04被引 3

用少次调用大模型实现高效文本聚类,省钱又准确。

Cequel: Cost-Effective Querying of Large Language Models for Text Clustering

  • 仅对关键文本对/三元组调用大模型,生成约束条件。
  • 在相同调用次数下,聚类效果优于现有方法。
  • 适合预算有限但需高质量聚类的场景。

文本聚类旨在基于语言特征自动将文档集合划分为语义一致的组。现有方法通常基于预训练文本嵌入的度量聚类,或依赖大模型提供的成对相似性构建图聚类。大语言模型(LLM)的进展显著提升了嵌入质量和语义相似性估计的准确性,但大规模使用导致高昂的计算和财务成本。为此,我们提出Cequel框架,在有限的LLM调用预算下实现高精度文本聚类。Cequel通过其提出的EdgeLLM和TriangleLLM算法,智能筛选并查询具有信息量的文本对或三元组,生成必须链接和不能链接约束。这些约束被用于加权约束聚类算法,生成高质量聚类结果。EdgeLLM和TriangleLLM采用精心设计的贪心策略与提示技术,高效识别并提取有效约束。在多个基准数据集上的实验表明,Cequel在相同查询预算下始终优于现有方法。

原文摘要 · Abstract (English)

Text clustering aims to automatically partition a collection of documents into coherent groups based on their linguistic features. In the literature, this task is formulated either as metric clustering over pre-trained text embeddings or as graph clustering based on pairwise similarities derived from an oracle, e.g., a large machine learning model. Recent advances in large language models (LLMs) have significantly improved this field by providing high-quality contextualized embeddings and accurate semantic similarity estimates. However, leveraging LLMs at scale introduces substantial computational and financial costs due to the large number of required API queries or inference calls. To address this issue, we propose Cequel, a cost-effective framework that achieves accurate text clustering under a limited budget of LLM queries. At its core, Cequel constructs must-link and cannot-link constraints by selectively querying LLMs on informative text pairs or triplets, identified via our proposed algorithms, EdgeLLM and TriangleLLM. These constraints are then utilized in a weighted constrained clustering algorithm to form high-quality clusters. Specifically, EdgeLLM and TriangleLLM employ carefully designed greedy selection strategies and prompting techniques to identify and extract informative constraints efficiently. Experiments on multiple benchmark datasets demonstrate that Cequel consistently outperforms existing methods in unsupervised text clustering under the same query budget.

文本聚类大模型优化约束聚类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。