arXiv:2412.15311cs.LG2024-12

通过自适应类别缩放,平衡模型鲁棒性与平均准确率的权衡。

Re-evaluating Group Robustness via Adaptive Class-Specific Scaling

  • 提出基于类别特性的动态缩放策略,无需额外训练。
  • 在多个数据集上实现鲁棒准确率与平均准确率双提升。
  • 适用于视觉与文本任务,为去偏方法提供新评估视角。

群体分布鲁棒优化旨在提升最差组准确率和无偏准确率,以缓解伪相关和数据集偏差问题。尽管现有方法在鲁棒准确率上有改进,但常以牺牲平均准确率为代价,存在固有权衡。为此,我们提出一种简单的类别特定缩放策略,可直接应用于现有去偏算法且无需额外训练。进一步设计了实例级自适应缩放技术,有效缓解该权衡,甚至实现鲁棒准确率与平均准确率双双提升。我们的方法表明,仅通过采用类别缩放,朴素的ERM基线即可达到或超过近期去偏方法的表现。此外,引入一种新型统一指标,将两类准确率间的权衡量化为标量值,支持对现有算法的全面评估。在计算机视觉与自然语言处理领域的多个数据集上验证了框架的有效性,为超越鲁棒准确率的鲁棒性技术提供了深刻洞见。

原文摘要 · Abstract (English)

Group distributionally robust optimization, which aims to improve robust accuracies -- worst-group and unbiased accuracies -- is a prominent algorithm used to mitigate spurious correlations and address dataset bias. Although existing approaches have reported improvements in robust accuracies, these gains often come at the cost of average accuracy due to inherent trade-offs. To control this trade-off flexibly and efficiently, we propose a simple class-specific scaling strategy, directly applicable to existing debiasing algorithms with no additional training. We further develop an instance-wise adaptive scaling technique to alleviate this trade-off, even leading to improvements in both robust and average accuracies. Our approach reveals that a naïve ERM baseline matches or even outperforms the recent debiasing methods by simply adopting the class-specific scaling technique. Additionally, we introduce a novel unified metric that quantifies the trade-off between the two accuracies as a scalar value, allowing for a comprehensive evaluation of existing algorithms. By tackling the inherent trade-off and offering a performance landscape, our approach provides valuable insights into robust techniques beyond just robust accuracy. We validate the effectiveness of our framework through experiments across datasets in computer vision and natural language processing domains.

分布鲁棒去偏准确率权衡自适应缩放

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。