用流信息训练轻量模型,推理时无需算光流,实时防人脸欺骗
Flow Augmentation and Knowledge Distillation for Lightweight Face Presentation Attack Detection

- 训练时用光流增强运动特征,推理时只靠RGB图像
- 在多个数据集上达到0.0%~5.65%的低误报率,最高达52帧/秒
- 适合移动端和嵌入式设备部署,兼顾精度与效率
人脸伪造攻击检测(FacePAD)在面对2D打印、重放、3D面具、化妆伪装及物理遮挡等多样伪造方式,以及不同采集条件下仍具挑战性。运动线索对检测极具判别力,但传统光流估计计算开销大,难用于实时场景。本文提出双分支教师模型,融合RGB帧外观特征与彩色编码光流的运动特征,有效建模微运动与时间一致性。为实现高效部署,设计知识蒸馏框架,通过软标签将教师模型的运动感知知识迁移至仅依赖RGB的轻量学生模型。学生模型在推理时无需显式光流计算或额外特征提取模块,却能隐式学习运动敏感表征。大量实验表明,该方法在多基准测试中表现优异:Replay-Attack与Replay-Mobile上达到0.0% HTER,ROSE-Youtu为0.94%,SiW-Mv2为5.65%,OULU-NPU为0.42% ACER。蒸馏后的学生模型性能媲美甚至优于教师模型,参数与浮点运算量显著降低,在NVIDIA Jetson Orin Nano上实现52 FPS,具备实时与资源受限环境下的部署潜力。
原文摘要 · Abstract (English)
Face presentation attack detection (FacePAD) remains challenging under diverse spoofing representation, including 2D print and replay, 3D mask-based spoofing, makeup-induced appearance manipulation, and physical occlusions, as well as under varying capture conditions. Motion cues are highly discriminative for FacePAD but typically require explicit optical flow estimation, which introduces substantial computational overhead and limits real-time deployment. In this work, we leverage optical flow to enhance motion representation during training while eliminating the need for flow computation at inference. We propose a dual-branch teacher model that fuses appearance cues from RGB frames with motion cues derived from colorwheel-encoded optical flow, enabling effective modeling of micro-motions and temporal consistency. To enable efficient deployment, we introduce a knowledge distillation framework that transfers motion-aware knowledge from the flow-augmented teacher to a lightweight RGB-only student via logit distillation. As a result, the student implicitly learns motion-sensitive representations without requiring explicit flow estimation or additional feature extraction blocks at inference. Extensive experiments demonstrate strong performance across multiple benchmarks, achieving 0.0% HTER on Replay-Attack and Replay-Mobile, 0.94% HTER on ROSE-Youtu, 5.65% HTER on SiW-Mv2, and 0.42% ACER on OULU-NPU. The distilled student achieves performance comparable to or better than the teacher while significantly reducing parameters and FLOPs, achieving 52 FPS on an NVIDIA Jetson Orin Nano, indicating its suitability for real-time and resource-constrained FacePAD deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。