arXiv:2507.20284cs.CVcs.LG2025-07ICCV被引 1

通过可调控的特征去相关,无需调参即可有效缓解模型偏差。

Controllable Feature Whitening for Hyperparameter-Free Bias Mitigation

  • 用协方差矩阵量化目标与偏见特征的线性相关,通过去白化模块消除。
  • 在四个基准数据集上优于现有方法,同时保持模型性能。
  • 无需正则化或对抗训练,适合追求公平性又怕调参的场景。

随着人工智能应用的快速扩展,构建可信AI变得尤为重要。然而,研究表明深度神经网络容易学习数据中的虚假关联。为提升可靠性,我们提出一种简单而有效的框架——可控特征去白化。通过协方差矩阵量化目标特征与偏见特征之间的线性相关性,并利用去白化模块予以消除。系统性实验表明,去除最后一层线性分类器输入特征间的线性相关性,能显著缓解偏差,且无需建模难以处理的高阶依赖关系。该方法的一大优势在于不依赖正则化项或对抗学习,避免了实际优化中的不稳定问题。此外,我们证明了通过加权协方差矩阵的去白化可有效处理两种公平性标准:人口均等性和等几率判决。因此,通过调节权重系数,可控制算法在效用与公平性之间的权衡。最后,我们在四个基准数据集(Corrupted CIFAR-10、Biased FFHQ、WaterBirds、Celeb-A)上验证了该方法优于现有方法。

原文摘要 · Abstract (English)

As the use of artificial intelligence rapidly increases, the development of trustworthy artificial intelligence has become important. However, recent studies have shown that deep neural networks are susceptible to learn spurious correlations present in datasets. To improve the reliability, we propose a simple yet effective framework called controllable feature whitening. We quantify the linear correlation between the target and bias features by the covariance matrix, and eliminate it through the whitening module. Our results systemically demonstrate that removing the linear correlations between features fed into the last linear classifier significantly mitigates the bias, while avoiding the need to model intractable higher-order dependencies. A particular advantage of the proposed method is that it does not require regularization terms or adversarial learning, which often leads to unstable optimization in practice. Furthermore, we show that two fairness criteria, demographic parity and equalized odds, can be effectively handled by whitening with the re-weighted covariance matrix. Consequently, our method controls the trade-off between the utility and fairness of algorithms by adjusting the weighting coefficient. Finally, we validate that our method outperforms existing approaches on four benchmark datasets: Corrupted CIFAR-10, Biased FFHQ, WaterBirds, and Celeb-A.

偏差缓解特征去相关公平性无超参

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。