构建首个跨环境多模态掌纹攻击检测数据集,推动系统性评估。
GBU-Palm: A Multimodal Video Dataset and Benchmark for Palm Presentation Attack Detection

- 构建含21,326视频的多模态数据集,覆盖六种环境与三类攻击
- 发现模型在环境变化下性能显著下降,且红外融合不总优于单模态
- 提供细粒度分析工具,揭示不同模型的失败模式与特征利用差异
现有掌纹活体检测(PAD)数据集常受限于静态图像、采集条件单一或缺乏多模态视频数据,难以实现跨环境、多模态与多攻击类型的系统评估。本文提出GBU-Palm,一个大规模多模态视频数据集与基准,包含105名受试者、210个掌纹的21,326段视频,覆盖六个采集环境,涵盖真实、打印和重放三类呈现攻击,其中6,310段为同步的RGB-NIR样本。我们设计了泄漏控制协议,分离掌纹身份与攻击来源,并在环境匹配与持保留环境设置下对四种代表性视频架构进行基准测试。结果表明,模型在环境迁移下存在显著性能退化,且RGB-NIR融合并非始终优于仅使用RGB输入。通过真接受(TA)、真拒绝(TR)、假接受(FA)、假拒绝(FR)分解,以及频谱掩码、时序干预与冻结主干红外探测等分析,揭示了不同架构在失败模式与特征利用上的差异。GBU-Palm为跨环境条件下鲁棒多模态掌纹PAD方法的开发与评估提供了统一且具有挑战性的基准。
原文摘要 · Abstract (English)
Existing palm presentation attack detection (PAD) datasets are often limited by static imagery, restricted acquisition conditions, or insufficient multimodal video data, hindering systematic evaluation across environments, modalities, and attack types. We present GBU-Palm, a large-scale multimodal video dataset and benchmark containing 21,326 videos from 105 subjects and 210 palms across six acquisition environments, including bona fide, Print, and Replay presentations, with 6,310 synchronized RGB-NIR samples. We construct leakage-controlled protocols that separate palm identity and attack lineage and benchmark four representative video architectures under environment-matched and held-out-environment settings. Results reveal substantial architecture-dependent degradation under environmental shift and show that RGB-NIR fusion does not consistently outperform RGB-only input. We further analyze model behavior through true accept (TA), true reject (TR), false accept (FA), and false reject (FR) decomposition, spectral masking, temporal-order intervention, and frozen-backbone NIR probing, revealing distinct failure patterns and evidence utilization across architectures. GBU-Palm provides a unified and challenging benchmark for developing and evaluating robust multimodal palm PAD methods under cross-environment conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。