通过关系传播提升少样本多意图识别准确率
Instance Relation Learning Network with Label Knowledge Propagation for Few-shot Multi-label Intent Detection
- 构建实例关系网络,通过标签知识在支持集与查询集间传播
- 1次学习场景下AUC提升9.54%,宏平均F1提升11.19%
- 适合低资源对话系统中的多意图识别任务
少样本多意图检测(Few-shot Multi-label Intent Detection, MID)对对话系统至关重要,旨在低资源对话领域中识别语句的多个意图。以往方法采用两阶段流程:先学习多标签语句表征,再用阈值策略确定多标签结果。但此类方法依赖表征分类,忽视实例间关系,导致误差传播。为此,本文提出一种端到端的多标签联合学习方法,构建带有标签知识传播的实例关系学习网络,以消除误差传播。具体而言,通过引入类别信息学习实例间的交互关系,实现少量标注(支持集)与无标注(查询集)实例间的标签知识传递。借助标签知识传播,实例间关系强度可直接反映两个语句是否属于同一意图,用于多标签预测。此外,设计双层次关系增强损失函数,优化支持集与查询集层级的关系强度以提升性能。实验表明,在1次学习场景下,本方法相较强基线平均提升9.54% AUC与11.19%宏平均F1。
原文摘要 · Abstract (English)
Few-shot Multi-label Intent Detection (MID) is crucial for dialogue systems, aiming to detect multiple intents of utterances in low-resource dialogue domains. Previous studies focus on a two-stage pipeline. They first learn representations of utterances with multiple labels and then use a threshold-based strategy to identify multi-label results. However, these methods rely on representation classification and ignore instance relations, leading to error propagation. To solve the above issues, we propose a multi-label joint learning method for few-shot MID in an end-to-end manner, which constructs an instance relation learning network with label knowledge propagation to eliminate error propagation. Concretely, we learn the interaction relations between instances with class information to propagate label knowledge between a few labeled (support set) and unlabeled (query set) instances. With label knowledge propagation, the relation strength between instances directly indicates whether two utterances belong to the same intent for multi-label prediction. Besides, a dual relation-enhanced loss is developed to optimize support- and query-level relation strength to improve performance. Experiments show that we outperform strong baselines by an average of 9.54% AUC and 11.19% Macro-F1 in 1-shot scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。