arXiv:2607.11885cs.CVcs.GR2026-07

无需训练,通过调整人脸潜空间实现精准身份编辑。

Latent-Identity Tuning in Text-to-Image Personalization Models

论文配图:Latent-Identity Tuning in Text-to-Image Personalization Models
图 1 · 摘自论文原文
  • 利用冻结编码器的潜空间,定位人脸关键特征的语义方向。
  • 支持局部精细修改,生成图像保持身份一致性。
  • 适合需要高精度人脸生成与编辑的研究者使用。

生成和编辑人脸需极高精度,微小改动可能显著改变身份感知。现有基于通用文生图模型的个性化与编辑方法往往缺乏细粒度控制能力。本文提出一种无需训练的细粒度身份调优方法,通过探索预训练冻结编码器的潜空间,发现可表征人脸不同特征的潜变量。这些潜变量对应特定面部区域或语义信息,可识别出有意义的语义方向,并在选定子空间中实现局部、精细且语义一致的编辑。定性和定量实验验证了该方法在保持跨图像身份一致性的同时,支持多样化的局部人脸修改。项目主页:https://garibida.github.io/IdentityTuning/

原文摘要 · Abstract (English)

Generating and editing a person's face demands high precision, as even minor modifications can significantly alter a subject's perceived identity. Current personalization and editing methods built on general-purpose text-to-image models, however, often lack the precision required for fine-grained facial edits. We present a method for fine-grained identity tuning in text-to-image personalization models. Unlike standard image editing, which operates on a given image, identity tuning modifies the latent representation of a specific identity, enabling the generation of diverse images that consistently depict the same edited identity. To enable fine-grained latent identity tuning, we explore the latent space of a pre-trained, frozen encoder for text-to-image personalization. Our approach requires no additional training. Instead, it leverages the existing architecture of a frozen encoder to uncover latent semantic directions. This space consists of a set of latent tokens that play distinct roles in capturing different aspects of an identity and often correspond to specific spatial or semantic facial regions. We show that meaningful directions can be identified within this space and within subspaces defined by selected tokens, enabling localized, fine-grained, and semantically coherent edits. We validate our approach through qualitative and quantitative experiments that demonstrate diverse localized facial edits while preserving cross-image identity consistency. Project page at: https://garibida.github.io/IdentityTuning/

人脸生成潜空间编辑身份一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。