arXiv:2511.14157cs.CV2025-11

提出新框架提升跨域多模态人脸反欺骗能力

Learning Representation and Synergy Invariances: A Povable Framework for Generalized Multimodal Face Anti-Spoofing

  • 用非对称不变风险最小化学习径向不变边界
  • 通过自监督混合解耦增强跨域通用特征
  • 解决多模态融合中表征与协同的泛化难题

多模态人脸反欺骗方法在未见领域部署时性能下降更严重,主要源于两个被忽视的风险:一是模态表征不变性风险,即表征在域偏移下是否保持泛化能力;二是模态协同不变性风险,即模型过拟合于特定域的跨模态相关性。本文理论证明,人脸反欺骗任务中真实样本紧凑而伪造样本多样(类不对称),这一特性放大了泛化误差上界,且在多模态设置下加剧。为此,提出可证明的框架RiSe,针对表征风险,引入非对称不变风险最小化(AsyIRM),在径向空间学习不变球面决策边界以适应不对称分布,同时保留角空间域线索;针对协同风险,设计多模态协同解耦(MMSD)自监督任务,通过跨样本混合与解耦强化内在、可泛化的模态特征。理论分析与实验证明,RiSe实现最先进的跨域性能。

原文摘要 · Abstract (English)

Multimodal Face Anti-Spoofing (FAS) methods, which integrate multiple visual modalities, often suffer even more severe performance degradation than unimodal FAS when deployed in unseen domains. This is mainly due to two overlooked risks that affect cross-domain multimodal generalization. The first is the modal representation invariant risk, i.e., whether representations remain generalizable under domain shift. We theoretically show that the inherent class asymmetry in FAS (diverse spoofs vs. compact reals) enlarges the upper bound of generalization error, and this effect is further amplified in multimodal settings. The second is the modal synergy invariant risk, where models overfit to domain-specific inter-modal correlations. Such spurious synergy cannot generalize to unseen attacks in target domains, leading to performance drops. To solve these issues, we propose a provable framework, namely Multimodal Representation and Synergy Invariance Learning (RiSe). For representation risk, RiSe introduces Asymmetric Invariant Risk Minimization (AsyIRM), which learns an invariant spherical decision boundary in radial space to fit asymmetric distributions, while preserving domain cues in angular space. For synergy risk, RiSe employs Multimodal Synergy Disentanglement (MMSD), a self-supervised task enhancing intrinsic, generalizable modal features via cross-sample mixing and disentanglement. Theoretical analysis and experiments verify RiSe, which achieves state-of-the-art cross-domain performance.

人脸反欺骗多模态域泛化不变学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。