arXiv:2506.22833cs.CV2025-06被引 1

在生成辐射场中实现面部语义精准编辑,保持其他区域不变。

SemFaceEdit: Semantic Face Editing on Generative Radiance Manifolds

  • 在生成辐射场中构建语义场,分离人脸几何与外观特征。
  • 通过条件隐变量控制,实现特定面部语义的局部编辑。
  • 适用于需要精细控制人脸外观的生成与编辑场景。

尽管3D感知GAN技术提供了多视角一致性,但生成图像往往缺乏局部编辑能力。为此,生成辐射场作为一种高效方法,可在体素内进行受限采样,有效降低计算开销并学习细节。本文提出SemFaceEdit,通过在生成辐射场中生成语义场,简化外观与几何编辑流程。利用隐编码,该方法有效解耦生成图像中不同面部语义对应的几何与外观特征。相比现有方法仅能改变整个辐射场外观,本方法可精确编辑特定面部语义,同时保持其他区域完整。网络包含两个核心模块:几何模块生成语义辐射场和占据场,外观模块预测RGB辐射值。两者在对抗设置下联合训练,学习语义感知的几何与外观描述符。外观描述符由外观模块根据对应语义隐码条件化,促进解耦与增强控制。实验表明,SemFaceEdit在基于语义场的编辑任务中表现优异,尤其在提升辐射场解耦能力方面显著优于基线。

原文摘要 · Abstract (English)

Despite multiple view consistency offered by 3D-aware GAN techniques, the resulting images often lack the capacity for localized editing. In response, generative radiance manifolds emerge as an efficient approach for constrained point sampling within volumes, effectively reducing computational demands and enabling the learning of fine details. This work introduces SemFaceEdit, a novel method that streamlines the appearance and geometric editing process by generating semantic fields on generative radiance manifolds. Utilizing latent codes, our method effectively disentangles the geometry and appearance associated with different facial semantics within the generated image. In contrast to existing methods that can change the appearance of the entire radiance field, our method enables the precise editing of particular facial semantics while preserving the integrity of other regions. Our network comprises two key modules: the Geometry module, which generates semantic radiance and occupancy fields, and the Appearance module, which is responsible for predicting RGB radiance. We jointly train both modules in adversarial settings to learn semantic-aware geometry and appearance descriptors. The appearance descriptors are then conditioned on their respective semantic latent codes by the Appearance Module, facilitating disentanglement and enhanced control. Our experiments highlight SemFaceEdit's superior performance in semantic field-based editing, particularly in achieving improved radiance field disentanglement.

面部编辑生成辐射场语义解耦

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。