arXiv:2503.23740cs.CLcs.AI2025-03被引 4

用大模型指导小模型,高效发现对话系统中的新意图。

LANID: LLM-assisted New Intent Discovery

  • 用聚类和近邻筛选语句对,让大模型判断其语义关系。
  • 小模型通过对比学习训练,在三个数据集上超越现有方法。
  • 适合需要快速适应新意图的轻量级对话系统部署。

任务导向型对话系统常面临新意图出现的挑战。新意图发现(NID)旨在识别这些新意图,同时保持对已有意图的识别能力。以往方法在语义表征不足或依赖外部知识方面存在局限,难以扩展。最近大语言模型(LLMs)展现出强大的零样本能力,但其规模限制了实际应用中处理大量查询的可行性。为克服现有NID方法的不足,我们提出LANID框架,利用LLM指导轻量级编码器的语义表示。具体而言,该框架采用K近邻与基于密度的聚类(DBSCAN)从训练集中筛选有代表性的语句对,并通过调用LLM判断其语义关系。由此生成的数据用于设计对比微调任务,再以对比三元组损失训练小型编码器。实验结果表明,该方法在三个不同NID数据集上均有效,在无监督和半监督设置下均优于强基线。代码已公开于https://github.com/floatSDSDS/LANID。

原文摘要 · Abstract (English)

Task-oriented Dialogue Systems (TODS) often face the challenge of encountering new intents. New Intent Discovery (NID) is a crucial task that aims to identify these novel intents while maintaining the capability to recognize existing ones. Previous efforts to adapt TODS to new intents have struggled with inadequate semantic representation or have depended on external knowledge, which is often not scalable or flexible. Recently, Large Language Models (LLMs) have demonstrated strong zero-shot capabilities; however, their scale can be impractical for real-world applications that involve extensive queries. To address the limitations of existing NID methods by leveraging LLMs, we propose LANID, a framework that enhances the semantic representation of lightweight NID encoders with the guidance of LLMs. Specifically, LANID employs the $K$-nearest neighbors and Density-Based Spatial Clustering of Applications with Noise (DBSCAN) algorithms to sample selective utterance pairs from the training set. It then queries an LLM to ascertain the relationships between these pairs. The data produced from this process is utilized to design a contrastive fine-tuning task, which is then used to train a small encoder with a contrastive triplet loss. Our experimental results demonstrate the efficacy of the proposed method across three distinct NID datasets, surpassing strong baselines in both unsupervised and semi-supervised settings. Our code is available at https://github.com/floatSDSDS/LANID.

新意图发现大模型对话系统对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。