arXiv:2606.18893cs.CL2026-06

提升多模态情感因果配对的置信度鲁棒性,让正确配对更明显、更稳定。

Learning Robust Pair Confidence for Multimodal Emotion-Cause Pair Extraction

论文配图:Learning Robust Pair Confidence for Multimodal Emotion-Cause Pair Extraction
图 1 · 摘自论文原文
  • 通过置信度差值约束分离正确配对与困难负例
  • 在三数据集上提升平均配对F1 2.58~2.83个百分点
  • 适合需要高可靠性配对结果的研究与应用

多模态情感-原因配对抽取(MECPE)需要可靠的目标配对置信度。现有配对评分器通常对有效候选对使用逐对交叉熵,将链接视为独立处理,导致竞争性原因之间的置信度关系缺乏约束,使真实配对可能靠近困难负例或依赖偶然的非真实上下文。我们将其称为配对置信度脆弱性,并提出仅训练阶段使用的RPCL(鲁棒配对置信度学习)框架。RPCL使配对置信度具备判别力和稳定性:通过置信度差值边界约束,将真实配对与行内困难负例分离;同时,在部分破坏上下文表示的扰动视图下,使干净预测与扰动预测保持一致。推理时沿用原始评分器和解码流程。在ECF、MECAD和MEC4数据集上,RPCL在全模态(文本-音频-视频)设置下,相较基线模型提升三组种子的平均配对F1 2.58至2.83个百分点,且所有数据集上均提升平均配对AUPRC。诊断分析显示真实配对与负例间置信度差距更大,违反边界的程度更低。结果表明,显式塑造配对置信度是提升MECPE的有效训练策略。

原文摘要 · Abstract (English)

Multimodal emotion-cause pair extraction (MECPE) requires reliable pair confidence over candidate pairs. Existing pair scorers commonly use pair-level cross entropy over valid candidates, which treats links mostly independently. This leaves the relative confidence geometry among competing causes under-constrained, allowing gold pairs to stay close to hard negatives or rely on incidental non-gold context. We study this vulnerability as pair-confidence brittleness and propose RPCL (Robust Pair Confidence Learning), a training-only framework for pair-confidence learning. RPCL encourages pair confidence to be both discriminative and stable: gold pairs are separated from row-wise hard negatives through a confidence-difference margin constraint, and clean pair predictions are aligned with predictions from a corrupted view where non-gold contextual utterance representations are partially corrupted. The original clean pair scorer and decoding pipeline are used unchanged at inference time. On ECF, MECAD, and MEC4, RPCL improves the three-seed mean Pair F1 over a matched base model by 2.58 to 2.83 percentage points in the full text-audio-video setting, and improves mean Pair AUPRC on all three datasets. Diagnostic analysis further shows larger gold-negative confidence gaps and lower margin-violation severity. These results suggest that explicitly shaping pair confidence is an effective training strategy for MECPE.

情感分析多模态配对抽取置信度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。