通过因果感知适配器实现高保真局部人脸属性编辑。
CA-Edit: Causality-Aware Condition Adapter for High-Fidelity Local Facial Attribute Editing
- 构建属性-文本-图像三元组数据集,提升条件建模能力。
- 保留原始皮肤细节,避免文本条件与图像特征冲突。
- 适合需要精准局部人脸编辑的研究者与应用开发。
为实现高效且高保真的局部人脸属性编辑,现有方法或需针对不同编辑效果额外微调,或易影响编辑区域外的图像内容。虽然修复类方法可在保持外部区域的同时编辑目标区域,但当前方法仍存在生成结果与属性描述不一致及面部皮肤细节丢失的问题。为此,本文提出:(i) 从数据驱动角度构建包含属性-文本-图像三元组的训练数据集;(ii) 设计因果感知条件适配器(CA-Edit),增强特定细节的上下文因果建模能力,编码原始图像中的皮肤细节,同时防止其与文本条件产生冲突。此外,引入皮肤过渡频率引导机制,通过低频对齐采样指导局部上下文因果建模。大量定量与定性实验表明,该方法显著提升了局部编辑的保真度与可编辑性。代码已开源:https://github.com/connorxian/CA-Edit。
原文摘要 · Abstract (English)
For efficient and high-fidelity local facial attribute editing, most existing editing methods either require additional fine-tuning for different editing effects or tend to affect beyond the editing regions. Alternatively, inpainting methods can edit the target image region while preserving external areas. However, current inpainting methods still suffer from the generation misalignment with facial attributes description and the loss of facial skin details. To address these challenges, (i) a novel data utilization strategy is introduced to construct datasets consisting of attribute-text-image triples from a data-driven perspective, (ii) a Causality-Aware Condition Adapter is proposed to enhance the contextual causality modeling of specific details, which encodes the skin details from the original image while preventing conflicts between these cues and textual conditions. In addition, a Skin Transition Frequency Guidance technique is introduced for the local modeling of contextual causality via sampling guidance driven by low-frequency alignment. Extensive quantitative and qualitative experiments demonstrate the effectiveness of our method in boosting both fidelity and editability for localized attribute editing. The code is available at https://github.com/connorxian/CA-Edit.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。