用大模型生成约束集,大幅减少查询次数仍保持高聚类精度
Optimized Algorithms for Text Clustering with LLM-Generated Constraints
- 改用约束集替代传统成对约束,降低资源消耗
- 在5个数据集上实现与顶尖方法相当的聚类准确率
- 引入置信度阈值和惩罚机制,提升不准确约束的鲁棒性
聚类是文本分析等众多应用中的基础工具。为提升聚类准确性,研究者常引入背景知识,如必须共现(must-link)和不能共现(cannot-link)约束。随着大语言模型(LLM)的发展,利用其自动生成约束成为新方向。本文提出一种新型约束生成方法,通过生成约束集而非传统成对约束,显著降低资源消耗。该方法在查询效率和约束准确性上均优于现有最优方法。我们还设计了适配LLM生成约束特性的聚类算法,引入置信度阈值与惩罚机制,以应对潜在错误约束。在五个文本数据集上的实验表明,本方法在聚类性能接近最先进水平的同时,将LLM查询次数减少超过20倍。
原文摘要 · Abstract (English)
Clustering is a fundamental tool that has garnered significant interest across a wide range of applications including text analysis. To improve clustering accuracy, many researchers have incorporated background knowledge, typically in the form of must-link and cannot-link constraints, to guide the clustering process. With the recent advent of large language models (LLMs), there is growing interest in improving clustering quality through LLM-based automatic constraint generation. In this paper, we propose a novel constraint-generation approach that reduces resource consumption by generating constraint sets rather than using traditional pairwise constraints. This approach improves both query efficiency and constraint accuracy compared to state-of-the-art methods. We further introduce a constrained clustering algorithm tailored to the characteristics of LLM-generated constraints. Our method incorporates a confidence threshold and a penalty mechanism to address potentially inaccurate constraints. We evaluate our approach on five text datasets, considering both the cost of constraint generation and the overall clustering performance. The results show that our method achieves clustering accuracy comparable to the state-of-the-art algorithms while reducing the number of LLM queries by more than 20 times.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。