无需共享数据,用少量样本即可自适应提升人脸反欺骗模型性能
Optimal Transport-Guided Source-Free Adaptation for Face Anti-Spoofing
- 基于原型与最优传输设计自适应模块,支持无训练或轻量训练
- 跨域跨攻击场景下HTER降低19.17%,AUC提升8.58%
- 适合隐私敏感场景下的实时模型更新,如移动端生物识别
由于训练数据与终端用户测试数据之间存在领域差异,构建满足全球客户安全要求的人脸反欺骗模型极具挑战。同时,出于安全与隐私考虑,客户端不宜向服务方共享大量人脸数据。本文提出一种新方法,使客户端仅需少量样本即可在测试时自适应地调整人脸反欺骗模型,且不暴露模型参数和训练数据。具体而言,我们设计了基于原型的基模型与最优传输引导的适配器,支持轻量训练或免训练的自适应方式,且不更新基模型参数。此外,提出测地线混合(geodesic mixup),一种基于最优传输的数据合成方法,沿源原型与目标数据分布之间的测地线路径生成增强数据。这使得轻量级分类器能有效适应目标域特征,同时保留源域学习的关键知识。在跨域与跨攻击设置下,相比近期方法,本方法在HTER上平均相对提升19.17%,在AUC上提升8.58%。
原文摘要 · Abstract (English)
Developing a face anti-spoofing model that meets the security requirements of clients worldwide is challenging due to the domain gap between training datasets and diverse end-user test data. Moreover, for security and privacy reasons, it is undesirable for clients to share a large amount of their face data with service providers. In this work, we introduce a novel method in which the face anti-spoofing model can be adapted by the client itself to a target domain at test time using only a small sample of data while keeping model parameters and training data inaccessible to the client. Specifically, we develop a prototype-based base model and an optimal transport-guided adaptor that enables adaptation in either a lightweight training or training-free fashion, without updating base model's parameters. Furthermore, we propose geodesic mixup, an optimal transport-based synthesis method that generates augmented training data along the geodesic path between source prototypes and target data distribution. This allows training a lightweight classifier to effectively adapt to target-specific characteristics while retaining essential knowledge learned from the source domain. In cross-domain and cross-attack settings, compared with recent methods, our method achieves average relative improvements of 19.17% in HTER and 8.58% in AUC, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。