用大模型迭代优化聚类,提升对话系统中新意图发现效果
NILC: Discovering New Intents with LLM-assisted Clustering
- 通过大模型动态更新聚类中心和模糊语句的嵌入表示
- 在6个不同领域的数据集上显著优于现有方法
- 适合需要持续学习新用户意图的对话系统开发者
新意图发现(NID)旨在从无标注用户语句中识别出已知和未知意图,广泛应用于实际对话系统。现有方法多采用级联架构:先编码语句为文本嵌入,再通过K-Means等聚类算法分组。然而,这种流程无法实现两阶段间的反馈协同,且仅依赖嵌入进行聚类会忽略细微语义,导致性能不佳。为此,本文提出NILC框架,专为高效NID设计。该框架采用迭代流程:借助大语言模型(LLMs)精炼聚类中心与不确定语句的嵌入表示。具体地,首先利用LLM生成更具上下文语义的聚类中心,增强传统欧氏中心;其次,对聚类中识别出的难样本(模糊或简短语句)进行重写以增强表征,用于后续聚类修正;此外,在半监督设置下引入非平凡的种子和软必须链接来注入监督信号。大量实验表明,在六个跨领域基准数据集上,无论在无监督还是半监督设置下,NILC均显著优于多个近期基线方法。
原文摘要 · Abstract (English)
New intent discovery (NID) seeks to recognize both new and known intents from unlabeled user utterances, which finds prevalent use in practical dialogue systems. Existing works towards NID mainly adopt a cascaded architecture, wherein the first stage focuses on encoding the utterances into informative text embeddings beforehand, while the latter is to group similar embeddings into clusters (i.e., intents), typically by K-Means. However, such a cascaded pipeline fails to leverage the feedback from both steps for mutual refinement, and, meanwhile, the embedding-only clustering overlooks nuanced textual semantics, leading to suboptimal performance. To bridge this gap, this paper proposes NILC, a novel clustering framework specially catered for effective NID. Particularly, NILC follows an iterative workflow, in which clustering assignments are judiciously updated by carefully refining cluster centroids and text embeddings of uncertain utterances with the aid of large language models (LLMs). Specifically, NILC first taps into LLMs to create additional semantic centroids for clusters, thereby enriching the contextual semantics of the Euclidean centroids of embeddings. Moreover, LLMs are then harnessed to augment hard samples (ambiguous or terse utterances) identified from clusters via rewriting for subsequent cluster correction. Further, we inject supervision signals through non-trivial techniques seeding and soft must links for more accurate NID in the semi-supervised setting. Extensive experiments comparing NILC against multiple recent baselines under both unsupervised and semi-supervised settings showcase that NILC can achieve significant performance improvements over six benchmark datasets of diverse domains consistently.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。