统一推理的多任务模型,提升人脸反欺诈的准确性与可解释性
FAS-R1: A Unified Multi-Task MLLM for Reasoning Face Anti-Spoofing

- 采用两阶段训练框架,结合长思维链数据与自适应强化学习
- 在真实场景下实现98.75%真伪识别准确率,攻击类型识别达93.33%
- 特别优化细微伪装和遮挡攻击,适合需要高可信决策的安防应用
人脸反欺诈(FAS)不仅需要判断真假,还需提供攻击类型与视觉证据供人工核查。现有方法多依赖标签驱动,基于多模态大模型的方法虽能生成结构化输出,但主要通过监督微调,导致推理模板化且对复杂攻击优化不足。本文提出FAS-R1,一个面向统一任务的多任务推理型多模态大模型框架,涵盖真实性分类、攻击类型识别与伪造区域定位。首先使用高质量长思维链数据集FAS-R1-23K进行冷启动微调,再通过特定于FAS的GRPO后训练。引入退化模拟增强(DSA)以保持不同画质下的线索推理稳定性,设计难度感知的GRPO(DA-GRPO)缓解简单样本主导问题,使细微或模糊攻击如化妆、口罩攻击等得到更好优化。主模型FAS-R1(3B)在域内达到98.75%真伪准确率、93.33%攻击类型准确率,以及AP@40/AP@50为96.30/94.73。跨域泛化性能优于对比系统,答案与推理质量更优。不同基座模型实验显示良好的可扩展性。代码即将开源。
原文摘要 · Abstract (English)
Face anti-spoofing (FAS) is increasingly expected to provide not only bona fide/spoof decisions, but also attack semantics and image-grounded evidence for human inspection. Existing discriminative FAS models remain largely label-centric, while recent MLLM-based methods offer structured outputs but still rely mainly on supervised fine-tuning, often producing template-like rationales and weak optimization for difficult attacks. We propose FAS-R1, a two-stage reasoning-oriented MLLM framework for unified FAS prediction, covering authenticity classification, attack-type recognition and spoof-region localization. FAS-R1 first uses FAS-R1-23K, a high-quality long-CoT dataset, for cold-start supervised fine-tuning, and then performs FAS-specific GRPO post-training. Degradation-Simulated Augmentation (DSA) encourages stable spoof-cue reasoning across visual-quality shifts, while Difficulty-Aware GRPO (DA-GRPO) mitigates easy-sample dominance that may leave difficult task--attack groups under-optimized, especially for subtle or ambiguous attacks such as makeup and mask attacks. The main 3B FAS-R1 model achieves 98.75\% authenticity accuracy, 93.33\% attack-type accuracy, and 96.30/94.73\% AP@40/AP@50 in-domain. It also outperforms the compared systems in cross-domain authenticity generalization and answer-and-rationale quality. Experiments with different base models further show favorable scaling behavior. The code will be released soon.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。