arXiv:2411.11939cs.CV2024-11被引 5

用有偏教师模型教学生模型,实现医疗影像公平性与准确性的双赢

Fair Distillation: Teaching Fairness from Biased Teachers in Medical Imaging

  • 用多个针对不同群体优化的有偏教师模型指导学生训练
  • 在多个医疗数据集上同时提升整体和群体准确率,降低组间差异
  • 适用于分类与分割任务,适合关注医疗公平性的研究者

深度学习在图像分类与分割任务中取得显著进展,但模型常因偏见对种族、性别或年龄等敏感属性定义的人群产生不公平影响。现有缓解偏见的方法如子组重平衡、对抗训练和领域泛化,往往难以兼顾整体准确率、群体准确率与公平性,因三者目标存在冲突。本文提出公平蒸馏(FairDi)方法,通过分解这些目标,利用为特定人群优化的有偏‘教师’模型,指导统一‘学生’模型训练。学生模型从教师中蒸馏知识,以最大化整体与群体准确率,同时最小化组间差异。在多个医疗影像数据集上的实验表明,相比现有方法,FairDi 在整体与群体准确率及公平性方面均有显著提升。该方法可适配多种医疗任务,如分类与分割,为实现模型性能公平性提供有效方案。

原文摘要 · Abstract (English)

Deep learning has achieved remarkable success in image classification and segmentation tasks. However, fairness concerns persist, as models often exhibit biases that disproportionately affect demographic groups defined by sensitive attributes such as race, gender, or age. Existing bias-mitigation techniques, including Subgroup Re-balancing, Adversarial Training, and Domain Generalization, aim to balance accuracy across demographic groups, but often fail to simultaneously improve overall accuracy, group-specific accuracy, and fairness due to conflicts among these interdependent objectives. We propose the Fair Distillation (FairDi) method, a novel fairness approach that decomposes these objectives by leveraging biased ``teacher'' models, each optimized for a specific demographic group. These teacher models then guide the training of a unified ``student'' model, which distills their knowledge to maximize overall and group-specific accuracies, while minimizing inter-group disparities. Experiments on medical imaging datasets show that FairDi achieves significant gains in both overall and group-specific accuracy, along with improved fairness, compared to existing methods. FairDi is adaptable to various medical tasks, such as classification and segmentation, and provides an effective solution for equitable model performance.

医疗影像公平性知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。