不依赖参考图,精准转换人脸种族特征且保留个人特质。
RaceGAN: A Framework for Preserving Individuality while Converting Racial Information for Image-to-Image Translation
- 通过多域风格编码映射实现种族特征转换
- 在芝加哥人脸数据集上准确转化亚裔、白人、黑人特征
- 无需额外参考图,保持个体身份和高层语义
生成对抗网络(GAN)近年来在无配对图像到图像翻译中取得显著进展。CycleGAN率先实现双域转换,但受限于仅支持两域;StarGAN突破此限制,可跨多域转换,但难以捕捉深层低级风格变化。StarGANv2与StyleGAN的创新使参考引导图像合成成为可能,但需额外参考图像且无法维持个体性。本研究提出RaceGAN,一种新型框架,可在种族属性转换中对多个域进行风格码映射,同时保持个体特征与高层语义,无需参考图像。在芝加哥人脸数据集上,RaceGAN在亚裔、白人、黑人特征转换上优于其他模型。我们采用基于InceptionReNetv2的分类方法进行定量评估,验证其有效性,并分析模型在潜空间中对各族裔人脸的聚类划分能力。
原文摘要 · Abstract (English)
Generative adversarial networks (GANs) have demonstrated significant progress in unpaired image-to-image translation in recent years for several applications. CycleGAN was the first to lead the way, although it was restricted to a pair of domains. StarGAN overcame this constraint by tackling image-to-image translation across various domains, although it was not able to map in-depth low-level style changes for these domains. Style mapping via reference-guided image synthesis has been made possible by the innovations of StarGANv2 and StyleGAN. However, these models do not maintain individuality and need an extra reference image in addition to the input. Our study aims to translate racial traits by means of multi-domain image-to-image translation. We present RaceGAN, a novel framework capable of mapping style codes over several domains during racial attribute translation while maintaining individuality and high level semantics without relying on a reference image. RaceGAN outperforms other models in translating racial features (i.e., Asian, White, and Black) when tested on Chicago Face Dataset. We also give quantitative findings utilizing InceptionReNetv2-based classification to demonstrate the effectiveness of our racial translation. Moreover, we investigate how well the model partitions the latent space into distinct clusters of faces for each ethnic group.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。