通过可控遗忘提升视觉模型公平性,无需重训练即可大幅降低偏差。
Bias-Aware Machine Unlearning: Towards Fairer Vision Models via Controllable Forgetting
- 针对视觉模型偏差,提出选择性遗忘受污染样本或特征表示的方法。
- 在三个数据集上,性别、姿态、合成补丁等偏差分别降低97.37%、94.86%、30.28%。
- 方法兼顾公平性与性能,适合部署后修正模型偏差的场景。
深度神经网络常依赖训练数据中的伪相关性,导致医疗、自动驾驶等安全关键领域出现不公平预测。传统偏差缓解需从头重训或重构数据流程,而近期机器遗忘技术为事后修正提供了新路径。本文研究‘偏见感知机器遗忘’,通过选择性移除有偏差的样本或特征表示,以缓解多种视觉模型偏差。基于隐私保护遗忘技术,评估了梯度上升、LoRA及教师-学生蒸馏等多种策略。在CUB-200-2011(姿态偏差)、CIFAR-10(合成补丁偏差)和CelebA(微笑检测性别偏差)三个基准数据集上实证表明,事后遗忘可显著降低子群体差异,使人口均等性提升最高达94.86%(CUB-200)、30.28%(CIFAR-10)和97.37%(CelebA)。该过程仅带来轻微精度损失,且在实用性、公平性、质量与隐私联合评估中平均得分0.62。结果确立机器遗忘作为无需重训即可提升部署视觉系统公平性的可行框架。
原文摘要 · Abstract (English)
Deep neural networks often rely on spurious correlations in training data, leading to biased or unfair predictions in safety-critical domains such as medicine and autonomous driving. While conventional bias mitigation typically requires retraining from scratch or redesigning data pipelines, recent advances in machine unlearning provide a promising alternative for post-hoc model correction. In this work, we investigate \textit{Bias-Aware Machine Unlearning}, a paradigm that selectively removes biased samples or feature representations to mitigate diverse forms of bias in vision models. Building on privacy-preserving unlearning techniques, we evaluate various strategies including Gradient Ascent, LoRA, and Teacher-Student distillation. Through empirical analysis on three benchmark datasets, CUB-200-2011 (pose bias), CIFAR-10 (synthetic patch bias), and CelebA (gender bias in smile detection), we demonstrate that post-hoc unlearning can substantially reduce subgroup disparities, with improvements in demographic parity of up to \textbf{94.86\%} on CUB-200, \textbf{30.28\%} on CIFAR-10, and \textbf{97.37\%} on CelebA. These gains are achieved with minimal accuracy loss and with methods scoring an average of 0.62 across the 3 settings on the joint evaluation of utility, fairness, quality, and privacy. Our findings establish machine unlearning as a practical framework for enhancing fairness in deployed vision systems without necessitating full retraining.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。