通过物理合成伪造特征提升人脸识别反欺骗模型跨域泛化能力
Towards Data-Centric Face Anti-Spoofing: Improving Cross-domain Generalization via Physics-based Data Synthesis

- 基于物理成像过程合成打印噪点、色彩失真等伪造特征,增强数据多样性
- 提出风险均衡机制,避免模型依赖特定伪造痕迹,提升跨域性能
- 结合视觉变换器架构,在多个跨域测试中达到顶尖水平
人脸识别反欺骗(FAS)研究面临跨域问题,即训练与测试数据存在域差异。现有工作多聚焦模型改进,而忽视数据质量与数量对泛化能力的影响。本文从数据角度出发,提出任务特异性FAS数据增强(FAS-Aug),通过模拟打印噪点、色彩失真、摩尔纹等伪造特征,提升数据多样性。实验表明,使用FAS-Aug可显著优于传统图像增强方法,提升跨域性能。然而,我们发现模型可能过度依赖这些人工生成的伪造特征,导致环境不变性下降。为此,提出伪造攻击风险均衡(SARE)机制,防止模型对特定伪造痕迹产生依赖,进一步提升泛化能力。结合最新视觉变换器骨干网络,所提方法在多个标准跨域评估协议上达到当前最优性能。代码已开源:https://github.com/RizhaoCai/FAS_Aug。
原文摘要 · Abstract (English)
Face Anti-Spoofing (FAS) research is challenged by the cross-domain problem, where there is a domain gap between the training and testing data. While recent FAS works are mainly model-centric, focusing on developing domain generalization algorithms for improving cross-domain performance, data-centric research for face anti-spoofing, improving generalization from data quality and quantity, is largely ignored. Therefore, our work starts with data-centric FAS by conducting a comprehensive investigation from the data perspective for improving cross-domain generalization of FAS models. More specifically, at first, based on physical procedures of capturing and recapturing, we propose task-specific FAS data augmentation (FAS-Aug), which increases data diversity by synthesizing data of artifacts, such as printing noise, color distortion, moiré pattern, \textit{etc}. Our experiments show that using our FAS augmentation can surpass traditional image augmentation in training FAS models to achieve better cross-domain performance. Nevertheless, we observe that models may rely on the augmented artifacts, which are not environment-invariant, and using FAS-Aug may have a negative effect. As such, we propose Spoofing Attack Risk Equalization (SARE) to prevent models from relying on certain types of artifacts and improve the generalization performance. Last but not least, our proposed FAS-Aug and SARE with recent Vision Transformer backbones can achieve state-of-the-art performance on the FAS cross-domain generalization protocols. The implementation is available at https://github.com/RizhaoCai/FAS_Aug.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。