arXiv:2411.10670cs.CL2024-11被引 18

用大模型零样本发现新用户意图,省去大量标注和训练。

IntentGPT: Few-shot Intent Discovery with Large Language Models

  • 通过提示工程自动生成上下文提示,激活大模型的少样本学习能力。
  • 在CLINC、BANKING等数据集上超越需大量微调的方法,准确率提升显著。
  • 适合快速部署对话系统,尤其适用于意图频繁变化的场景。

在数字化驱动的世界中,对话系统在客户服务到虚拟助手等场景中至关重要。准确识别用户目标是快速响应需求的关键,这需要有效的意图检测模型。然而,用户意图多样且动态变化,难以维持固定的预定义意图集。因此,更实际的方法是开发能随新意图出现而自动识别的模型。本文提出IntentGPT,一种无需训练的新型方法,利用GPT-4等大语言模型,在极少标注数据下发现新意图。该方法包含:上下文提示生成器,用于生成有效提示;意图预测器,用于分类与发现用户意图;以及语义少样本采样器,从已知意图和相关示例中选取并注入提示。实验表明,相比需大量领域数据与微调的旧方法,IntentGPT在CLINC、BANKING等多个基准上表现更优。

原文摘要 · Abstract (English)

In today's digitally driven world, dialogue systems play a pivotal role in enhancing user interactions, from customer service to virtual assistants. In these dialogues, it is important to identify user's goals automatically to resolve their needs promptly. This has necessitated the integration of models that perform Intent Detection. However, users' intents are diverse and dynamic, making it challenging to maintain a fixed set of predefined intents. As a result, a more practical approach is to develop a model capable of identifying new intents as they emerge. We address the challenge of Intent Discovery, an area that has drawn significant attention in recent research efforts. Existing methods need to train on a substantial amount of data for correctly identifying new intents, demanding significant human effort. To overcome this, we introduce IntentGPT, a novel training-free method that effectively prompts Large Language Models (LLMs) such as GPT-4 to discover new intents with minimal labeled data. IntentGPT comprises an \textit{In-Context Prompt Generator}, which generates informative prompts for In-Context Learning, an \textit{Intent Predictor} for classifying and discovering user intents from utterances, and a \textit{Semantic Few-Shot Sampler} that selects relevant few-shot examples and a set of known intents to be injected into the prompt. Our experiments show that IntentGPT outperforms previous methods that require extensive domain-specific data and fine-tuning, in popular benchmarks, including CLINC and BANKING, among others.

意图识别大模型少样本对话系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。