提出GPAM框架,提升少样本关系抽取中未知类别的识别准确率。
Few-shot Open Relation Extraction with Gaussian Prototype and Adaptive Margin
- 用高斯原型和自适应边界增强分类边界学习
- 在FewRel数据集上达到当前最优性能
- 适合处理少样本下未知类别关系抽取任务
少样本关系抽取中的无类别选项(FsRE with NOTA)旨在未知类别存在的情况下进行标签预测,挑战性高于传统少样本关系抽取,因未知类边界复杂难学。现有基于元学习的原型方法受限于少样本过拟合与NOTA边界混淆,导致已知与未知类别误分。为此,本文提出基于高斯原型与自适应边距的GPAM框架,包含三个模块:半事实表征、GMM原型度量学习与决策边界学习。前两个模块通过去偏信息增强与高斯空间距离测量获得更优表示;第三模块通过自适应边距与负采样学习更精确的分类边界与原型。训练中采用对比学习损失,综合考虑范围与边距对已知与未知类别的影响,提升模型稳定性和鲁棒性。在FewRel数据集上的充分实验与消融分析表明,GPAM超越此前原型方法,达到最新技术水平。
原文摘要 · Abstract (English)
Few-shot relation extraction with none-of-the-above (FsRE with NOTA) aims at predicting labels in few-shot scenarios with unknown classes. FsRE with NOTA is more challenging than the conventional few-shot relation extraction task, since the boundaries of unknown classes are complex and difficult to learn. Meta-learning based methods, especially prototype-based methods, are the mainstream solutions to this task. They obtain the classification boundary by learning the sample distribution of each class. However, their performance is limited because few-shot overfitting and NOTA boundary confusion lead to misclassification between known and unknown classes. To this end, we propose a novel framework based on Gaussian prototype and adaptive margin named GPAM for FsRE with NOTA, which includes three modules, semi-factual representation, GMM-prototype metric learning and decision boundary learning. The first two modules obtain better representations to solve the few-shot problem through debiased information enhancement and Gaussian space distance measurement. The third module learns more accurate classification boundaries and prototypes through adaptive margin and negative sampling. In the training procedure of GPAM, we use contrastive learning loss to comprehensively consider the effects of range and margin on the classification of known and unknown classes to ensure the model's stability and robustness. Sufficient experiments and ablations on the FewRel dataset show that GPAM surpasses previous prototype methods and achieves state-of-the-art performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。