提出分阶段排序校准框架,提升多模态情感分析的稳定性和准确性。
GRCF: Two-Stage Groupwise Ranking and Calibration Framework for Multimodal Sentiment Analysis
- 分两阶段:先动态调整排名间隔,再校准预测值大小
- 在CMU-MOSEI等数据集上提升排名准确率12.3%,相关性更高
- 适合需要精确排序和抗噪声的多模态情感任务
现有多模态情感分析大多采用点对点回归,易受标签噪声影响,忽略样本间相对正向程度,导致预测不稳定、相关性差。成对序数学习虽能捕捉相对顺序,但存在两个问题:一是所有比较赋予相同重要性,无法聚焦难分样本;二是固定排名间隔,无法反映不同情感组间的语义距离差异。为此,本文提出两阶段分组排序与校准框架(GRCF),借鉴分组相对策略优化(GRPO)思想。第一阶段引入优势加权动态边际排序损失,构建细粒度序数结构;第二阶段采用MAE驱动目标,对齐预测值幅度。为验证泛化能力,将GRCF扩展至多模态幽默检测与反讽检测任务。实验表明,GRCF在核心回归基准上达到当前最优性能,且在分类任务中也表现优异。
原文摘要 · Abstract (English)
Most Multimodal Sentiment Analysis research has focused on point-wise regression. While straightforward, this approach is sensitive to label noise and neglects whether one sample is more positive than another, resulting in unstable predictions and poor correlation alignment. Pairwise ordinal learning frameworks emerged to address this gap, capturing relative order by learning from comparisons. Yet, they introduce two new trade-offs: First, they assign uniform importance to all comparisons, failing to adaptively focus on hard-to-rank samples. Second, they employ static ranking margins, which fail to reflect the varying semantic distances between sentiment groups. To address this, we propose a Two-Stage Group-wise Ranking and Calibration Framework (GRCF) that adapts the philosophy of Group Relative Policy Optimization (GRPO). Our framework resolves these trade-offs by simultaneously preserving relative ordinal structure, ensuring absolute score calibration, and adaptively focusing on difficult samples. Specifically, Stage 1 introduces a GRPO-inspired Advantage-Weighted Dynamic Margin Ranking Loss to build a fine-grained ordinal structure. Stage 2 then employs an MAE-driven objective to align prediction magnitudes. To validate its generalizability, we extend GRCF to classification tasks, including multimodal humor detection and sarcasm detection. GRCF achieves state-of-the-art performance on core regression benchmarks, while also showing strong generalizability in classification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。