通过正则化特征表示,提升模型在少数群体上的鲁棒性。
Spurious Correlation-Aware Embedding Regularization for Worst-Group Robustness
- 从嵌入空间出发,抑制模型对虚假相关性的依赖。
- 在多个视觉与语言任务中,最差组准确率显著超越现有方法。
- 适合关注公平性与分布外泛化的研究者使用。
深度学习模型在多个领域表现优异,但常依赖虚假相关性,在子群体分布偏移场景下尤其脆弱。现有方法虽有进展,但受限于缺乏连接嵌入表示与最差组误差的理论框架。为此,本文提出针对最差组鲁棒性的虚假相关性感知嵌入正则化(SCER),直接在嵌入层面正则化特征表示,以抑制虚假线索。理论上证明,最差组误差受分类器对虚假方向与核心方向依赖强度的影响,该强度可通过跨域和类别的组内均值嵌入差异识别。通过在嵌入层施加理论约束,SCER促使模型聚焦核心特征,降低对虚假模式的敏感性。在多个视觉与语言任务上的系统评估显示,SCER在最差组准确率上优于先前最先进方法。代码已公开。
原文摘要 · Abstract (English)
Deep learning models achieve strong performance across various domains but often rely on spurious correlations, making them vulnerable to distribution shifts. This issue is particularly severe in subpopulation shift scenarios, where models struggle in underrepresented groups. While existing methods have made progress in mitigating this issue, their performance gains are still constrained. They lack a rigorous theoretical framework connecting the embedding space representations with worst-group error. To address this limitation, we propose Spurious Correlation-Aware Embedding Regularization for Worst-Group Robustness (SCER), a novel approach that directly regularizes feature representations to suppress spurious cues. We show theoretically that worst-group error is influenced by how strongly the classifier relies on spurious versus core directions, identified from differences in group-wise mean embeddings across domains and classes. By imposing theoretical constraints at the embedding level, SCER encourages models to focus on core features while reducing sensitivity to spurious patterns. Through systematic evaluation on multiple vision and language, we show that SCER outperforms prior state-of-the-art studies in worst-group accuracy. Our code is available at \href{https://github.com/MLAI-Yonsei/SCER}{https://github.com/MLAI-Yonsei/SCER}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。