arXiv:2510.06747cs.CLcs.AI2025-10ACL被引 2

用大模型直接生成文本聚类表示,无需调优嵌入模型或标签。

LLMs Enable Bag-of-Texts Representations for Short-Text Clustering

  • 将大模型的语义判断转化为无距离假设的文本袋表示
  • 在多个数据集上达到或超越现有方法性能,无需优化嵌入
  • 适用于任意嵌入模型、小规模大模型和大规模数据

本文提出一种无需训练的无监督短文本聚类方法,减少对嵌入模型精细选择的依赖。在面向客户聊天机器人场景中,企业需对大量用户语句按意图聚类,但通常无标签数据且簇数未知。现有方法利用大语言模型(LLM)优化已有嵌入表示,但其语义相似性未必反映在稠密向量空间的距离中,因受原始嵌入影响。为此,我们提出一种直接将LLM判断转换为文本袋表示的方法,初始时文本间等距,不预设任何距离关系。实验表明,该方法在多种数据集及小型LLM下表现相当或更优,无需嵌入优化,也不依赖簇数或标签信息。方法具备模型无关性,可适配任意嵌入模型、不同聚类算法,并支持大规模数据处理,显著降低LLM使用计算开销。灵活性与可扩展性使其更贴合真实无训练场景。

原文摘要 · Abstract (English)

In this paper, we propose a training-free method for unsupervised short text clustering that relies less on careful selection of embedders than other methods. In customer-facing chatbots, companies are dealing with large amounts of user utterances that need to be clustered according to their intent. In these settings, no labeled data is typically available, and the number of clusters is not known. Recent approaches to short-text clustering in label-free settings incorporate LLM output to refine existing embeddings. While LLMs can identify similar texts effectively, the resulting similarities may not be directly represented by distances in the dense vector space, as they depend on the original embedding. We therefore propose a method for transforming LLM judgments directly into a bag-of-texts representation in which texts are initialized to be equidistant, without assuming any prior distance relationships. Our method achieves comparable or superior results to state-of-the-art methods, but without embeddings optimization or assuming prior knowledge of clusters or labels. Experiments on diverse datasets and smaller LLMs show that our method is model agnostic and can be applied to any embedder, with relatively small LLMs, and different clustering methods. We also show how our method scales to large datasets, reducing the computational cost of the LLM use. The flexibility and scalability of our method make it more aligned with real-world training-free scenarios than existing clustering methods.

短文本聚类大模型应用无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。