通过梯度引导生成模型潜空间,实现可控虹膜图像增强。
Gradient-Guided Exploration of Generative Model's Latent Space for Controlled Iris Image Augmentations
- 用特定特征梯度引导潜空间遍历,控制虹膜属性变化。
- 可保持身份一致,同时调整清晰度、瞳孔大小等属性。
- 适用于真实或生成虹膜图像,支持攻击检测数据增强。
构建可靠的虹膜识别与活体攻击检测系统需多样化的数据集,涵盖虹膜特征的真实变异和广泛异常。由于虹膜图像纹理丰富且包含多种空间频率,合成同身份虹膜图像并精确控制特定属性仍具挑战。本文提出一种新方法:在生成模型的潜空间中,沿特定几何、纹理或质量相关特征(如清晰度、瞳孔大小、虹膜大小、瞳孔-虹膜比)的梯度方向遍历,获得具有目标属性但身份不变的样本。该策略可扩展至任意可微损失函数定义的属性。此外,方法可使用预训练GAN生成图像或真实虹膜图像,并通过GAN反演将任意虹膜图像映射至潜空间获取对应编码。
原文摘要 · Abstract (English)
Developing reliable iris recognition and presentation attack detection methods requires diverse datasets that capture realistic variations in iris features and a wide spectrum of anomalies. Because of the rich texture of iris images, which spans a wide range of spatial frequencies, synthesizing same-identity iris images while controlling specific attributes remains challenging. In this work, we introduce a new iris image augmentation strategy by traversing a generative model's latent space toward latent codes that represent same-identity samples but with some desired iris image properties manipulated. The latent space traversal is guided by a gradient of specific geometrical, textural, or quality-related iris image features (e.g., sharpness, pupil size, iris size, or pupil-to-iris ratio) and preserves the identity represented by the image being manipulated. The proposed approach can be easily extended to manipulate any attribute for which a differentiable loss term can be formulated. Additionally, our approach can use either randomly generated images using either a pre-train GAN model or real-world iris images. We can utilize GAN inversion to project any given iris image into the latent space and obtain its corresponding latent code.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。