用多项式模拟掌纹,生成逼真且可调控差异的合成掌纹数据。
Diff-Palm: Realistic Palmprint Generation with Polynomial Creases and Intra-Class Variation Controllable Diffusion Models
- 用多项式替代贝塞尔曲线建模掌纹,更贴近真实分布。
- 合成数据训练的识别模型无需微调,性能超过真实数据训练。
- 支持大规模生成,身份一致性高,适合数据稀缺场景。
掌纹识别因缺乏大规模公开数据集而受限。以往方法采用贝塞尔曲线模拟掌纹,输入条件生成对抗网络生成图像,但缺乏真实数据微调时,识别模型性能急剧下降,表明合成与真实掌纹间存在显著差距。这主要源于掌纹表征不准确,以及类内差异与身份一致性的平衡难题。为此,我们提出基于多项式的掌纹表示,实现更贴近真实分布的掌纹生成机制;并设计掌纹条件扩散模型,引入新型类内差异控制方法。通过提出的K步噪声共享采样策略,可生成具有大类内差异和高身份一致性的掌纹数据集。实验表明,首次实现仅使用合成数据训练的识别模型,无需微调即可超越真实数据训练的模型性能;且随着生成身份数量增加,识别性能持续提升。
原文摘要 · Abstract (English)
Palmprint recognition is significantly limited by the lack of large-scale publicly available datasets. Previous methods have adopted Bézier curves to simulate the palm creases, which then serve as input for conditional GANs to generate realistic palmprints. However, without employing real data fine-tuning, the performance of the recognition model trained on these synthetic datasets would drastically decline, indicating a large gap between generated and real palmprints. This is primarily due to the utilization of an inaccurate palm crease representation and challenges in balancing intra-class variation with identity consistency. To address this, we introduce a polynomial-based palm crease representation that provides a new palm crease generation mechanism more closely aligned with the real distribution. We also propose the palm creases conditioned diffusion model with a novel intra-class variation control method. By applying our proposed $K$-step noise-sharing sampling, we are able to synthesize palmprint datasets with large intra-class variation and high identity consistency. Experimental results show that, for the first time, recognition models trained solely on our synthetic datasets, without any fine-tuning, outperform those trained on real datasets. Furthermore, our approach achieves superior recognition performance as the number of generated identities increases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。