arXiv:2509.05635cs.CLcs.IR2025-09被引 1

通过关系感知提示学习,提升少样本意图识别准确率

Few-Shot Query Intent Detection via Relation-Aware Prompt Learning

  • 融合文本与对话结构关系信息进行统一预训练
  • 在两个真实数据集上显著超越现有最先进方法
  • 适合需要少样本高效训练的对话系统开发者

意图识别是现代对话系统的关键组件,准确识别用户初始意图对生成有效回复至关重要。现有研究多聚焦于少样本场景,主要利用大规模未标注对话语料预训练语言模型,再用极少标注数据微调。尽管取得进展,但多数方法仅关注文本信息,忽视了对话系统中重要的结构特征,如查询-查询关系和查询-回答关系。为此,我们提出SAID框架,首次在统一架构中整合文本与关系结构信息用于模型预训练。在此基础上,进一步设计查询自适应注意力网络(QueryAdapt),通过显式生成与意图相关的关联标记,实现更细粒度的知识迁移。在两个真实数据集上的大量实验表明,SAID显著优于当前最优方法。

原文摘要 · Abstract (English)

Intent detection is a crucial component of modern conversational systems, since accurately identifying user intent at the beginning of a conversation is essential for generating effective responses. Recent efforts have focused on studying this problem under a challenging few-shot scenario. These approaches primarily leverage large-scale unlabeled dialogue text corpora to pretrain language models through various pretext tasks, followed by fine-tuning for intent detection with very limited annotations. Despite the improvements achieved, existing methods have predominantly focused on textual data, neglecting to effectively capture the crucial structural information inherent in conversational systems, such as the query-query relation and query-answer relation. To address this gap, we propose SAID, a novel framework that integrates both textual and relational structure information in a unified manner for model pretraining for the first time. Building on this framework, we further propose a novel mechanism, the query-adaptive attention network (QueryAdapt), which operates at the relation token level by generating intent-specific relation tokens from well-learned query-query and query-answer relations explicitly, enabling more fine-grained knowledge transfer. Extensive experimental results on two real-world datasets demonstrate that SAID significantly outperforms state-of-the-art methods.

意图识别少样本学习对话系统关系建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。