用隐式神经渲染提升3D指纹识别,避免重建损失与硬件依赖。
Improving 3D Finger Traits Recognition via Generalizable Neural Rendering
- 采用神经辐射场隐式建模,跳过传统3D重建流程。
- 在三个数据集上分别达到2.90%、4.37%、8.12%的等错误率。
- 引入指纹/静脉特征引导,解决几何-辐射混淆问题。
基于3D指部生物特征的识别技术成为新趋势,在身份验证与防伪方面表现优异。现有方法依赖显式3D重建流程,存在重建过程中的信息丢失及算法与硬件强耦合的问题。本文提出一种通用的隐式神经渲染框架FingerNeRF,以神经辐射场(NeRF)为基础,避免显式3D重建。为解决形状-辐射混淆导致的几何错误,引入指纹或指静脉等二值特征作为几何先验。提出特质引导变压器(TGT)模块增强特征对应关系,并设计深度蒸馏损失与特质引导渲染损失施加额外几何约束。构建两个新数据集:包含指部图像的SCUT-Finger-3D,以及含指静脉图像的SCUT-FingerVein-3D;同时使用UNSW-3D数据集进行评估。实验表明,FingerNeRF在三组数据集上分别取得2.90%、4.37%、8.12%的等错误率(EER),验证了隐式方法在3D指部生物识别中的优越性。
原文摘要 · Abstract (English)
3D biometric techniques on finger traits have become a new trend and have demonstrated a powerful ability for recognition and anti-counterfeiting. Existing methods follow an explicit 3D pipeline that reconstructs the models first and then extracts features from 3D models. However, these explicit 3D methods suffer from the following problems: 1) Inevitable information dropping during 3D reconstruction; 2) Tight coupling between specific hardware and algorithm for 3D reconstruction. It leads us to a question: Is it indispensable to reconstruct 3D information explicitly in recognition tasks? Hence, we consider this problem in an implicit manner, leaving the nerve-wracking 3D reconstruction problem for learnable neural networks with the help of neural radiance fields (NeRFs). We propose FingerNeRF, a novel generalizable NeRF for 3D finger biometrics. To handle the shape-radiance ambiguity problem that may result in incorrect 3D geometry, we aim to involve extra geometric priors based on the correspondence of binary finger traits like fingerprints or finger veins. First, we propose a novel Trait Guided Transformer (TGT) module to enhance the feature correspondence with the guidance of finger traits. Second, we involve extra geometric constraints on the volume rendering loss with the proposed Depth Distillation Loss and Trait Guided Rendering Loss. To evaluate the performance of the proposed method on different modalities, we collect two new datasets: SCUT-Finger-3D with finger images and SCUT-FingerVein-3D with finger vein images. Moreover, we also utilize the UNSW-3D dataset with fingerprint images for evaluation. In experiments, our FingerNeRF can achieve 4.37% EER on SCUT-Finger-3D dataset, 8.12% EER on SCUT-FingerVein-3D dataset, and 2.90% EER on UNSW-3D dataset, showing the superiority of the proposed implicit method in 3D finger biometrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。