用统一方法测试24个预训练模型在活体检测中的表现
Foundation Models for Face Presentation Attack Detection: A Unified Linear-Probing Benchmark

- 固定主干网络,只训练轻量线性分类器,评估预训练模型的迁移能力
- 大模型表现更好,但跨数据集效果不稳定,说明仍需适应域偏移
- 适合研究跨数据集鲁棒性的学者和实际部署中需要高效推理的场景
人脸活体攻击检测(PAD)在跨数据集评估下仍具挑战性,因领域偏移会降低单数据集训练模型的性能。由于大规模标注数据稀缺,采用预训练视觉模型而非从零训练专用架构成为趋势,这引出一个核心问题:通用视觉基础模型是否包含可经少量任务微调即可提取的PAD相关信息?为此,我们系统评估了24个冻结编码器,包括自监督视觉变压器、视觉语言编码器和监督CNN,在MCIO基准(MSU-MFSD、CASIA-FASD、Replay-Attack、OULU-NPU)上使用统一线性探针协议。主干网络保持不变,仅训练轻量级线性头以隔离预训练表示中已存在的PAD信息。结果表明,冻结的基础模型表示可在单一数据集上支持强性能,但跨数据集迁移不可靠。模型规模在若干家族中带来收益,但非单调,且受架构和预训练方式强烈影响。InternViT-6B在所有数据集上达到最低平均错误率,而CLIP ViT-B/32在跨数据集迁移与计算成本之间提供最优权衡。这些发现表明,尽管预训练表示包含相关特征,但显式适应仍是应对领域偏移的必要步骤。
原文摘要 · Abstract (English)
Face presentation attack detection (PAD) remains challenging under cross-dataset evaluation, where domain shift degrades models trained on a single dataset. The scarcity of large-scale labeled data motivates adapting pretrained vision models rather than training task-specific architectures from scratch, raising a fundamental question: do general-purpose vision foundation models encode PAD-relevant information accessible with minimal task-specific training? To investigate, we systematically evaluate 24 frozen encoders, including self-supervised vision transformers, vision-language encoders, and supervised CNNs, using a unified linear-probing protocol on the MCIO benchmark (MSU-MFSD, CASIA-FASD, Replay-Attack, OULU-NPU). The backbone remains fixed, and only a lightweight linear head is trained to isolate the PAD information already present in the pretrained representation. Results show that frozen foundation-model representations can support strong intra-dataset PAD performance with only a linear classifier, but this performance does not reliably transfer across datasets. Model scale is beneficial within several families, although the effect is not monotonic and is strongly mediated by architecture and pretraining. InternViT-6B achieves the lowest mean intra-dataset error, whereas CLIP ViT-B/32 offers the most favorable cross-dataset transfer-compute trade-off among the evaluated probes. These findings suggest that while pretrained representations contain PAD-relevant information, explicit adaptation remains necessary to address domain shift.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。