提出公平性感知的深度伪造检测框架,降低不同人群误判差异。
FairReL: Deepfake Detection using Fairness-Aware Representation Learning

- 分离空间特征与微调残差特征,针对性施加公平性监督。
- 在多个数据集上提升未见数据集AUC 3.9%,减少子群体误报差异10.2%。
- 适合关注模型公平性、需降低种族/性别偏见的检测应用。
尽管当前深度伪造检测器整体准确率高,但错误在不同人口统计子群体间分布不均,某些群体的真实人脸更常被误判为伪造。现有公平性感知检测器通常对整个特征表示进行正则化,未能识别并控制导致不公平预测的具体组件。这种粗粒度干预可能过度抑制有用伪造线索,同时保留组件特异性子空间中的身份结构。为此,我们识别出两个子群体敏感组件:多尺度空间特征(编码局部面部与伪造模式)和微调引入的残差特征(使主干网络适应不公平训练分布)。本文提出 FairReL,一种公平性感知表征学习框架,针对这两个组件分别施加专门的人口统计监督。FairReL 使用 SVD 分解的骨干模型分离微调残差表征,并引入两种互补损失:组条件小波去相关(GCWD)抑制空间小波子带间子群体不平衡结构,子空间局部均值对齐(SLMA)在残差表征中对齐各类别内的子群体均值。在 FF++、Celeb-DF、DFD 和 DFDC 上的实验表明,相比最先进的公平性感知检测器,FairReL 在未见数据集上提升 AUC 3.9%,同时将子群体假阳性率差异降低 10.2%。代码已开源:https://github.com/xiaoman89/FairReL。
原文摘要 · Abstract (English)
Although recent deepfake detectors achieve high overall accuracy, their errors remain unevenly distributed across demographic subgroups, with real faces from certain groups more often misclassified as fake. Existing fairness-aware detectors typically regularise the entire feature representation, without identifying or controlling the specific components that drive unfair predictions. Such coarse intervention can over-suppress useful forgery cues while leaving demographic structure in component-specific subspaces. To address this, we identify two subgroup-sensitive components: multi-scale spatial features, which encode local facial and forgery patterns, and fine-tuning-induced residual features, which adapt the backbone to the unfair training distribution. We propose FairReL, a fairness-aware representation-learning framework that targets both components with dedicated demographic supervision. FairReL uses an SVD-decomposed foundation-model backbone to isolate the fine-tuning-induced residual representation, and introduces two complementary losses. Group-Conditional Wavelet Decorrelation (GCWD) suppresses subgroup-imbalanced structure across spatial wavelet sub-bands, while Subspace-Localised Mean Alignment (SLMA) aligns subgroup means within each real/fake class in the residual representation. Experiments on FF++, Celeb-DF, DFD and DFDC show that, against the state-of-the-art fairness-aware detector, FairReL improves unseen-dataset AUC by 3.9% while reducing subgroup FPR disparity by 10.2%. Code is available at https://github.com/xiaoman89/FairReL .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。