arXiv:2508.20640cs.CV2025-08被引 1

用AI生成保留人脸特征的涂鸦艺术,让风格与身份共存。

CraftGraffiti: Exploring Human Identity with Custom Graffiti Art via Facial-Preserving Diffusion Models

  • 先风格后保脸:先转换涂鸦风格,再用身份嵌入强化人脸一致性
  • 人脸特征保持率超90%,美学评分达顶尖水平
  • 适合艺术家、设计师做个性化涂鸦创作

在生成艺术中,极端风格化下保持人脸身份识别仍是难题。在高对比度、抽象的涂鸦艺术中,眼鼻口的微小扭曲就可能使人物失去辨识度,损害个人与文化真实性。我们提出CraftGraffiti,一个以人脸特征保真为核心目标的端到端文本引导涂鸦生成框架。给定输入图像和风格姿态描述提示,系统先通过LoRA微调的预训练扩散变换器进行涂鸦风格迁移,再通过引入显式身份嵌入的面部一致自注意力机制,在注意力层增强身份忠实性。姿态定制不依赖关键点,而是利用CLIP引导提示扩展实现动态重置姿态,同时保持人脸连贯性。我们形式化并实证验证了“先风格、后身份”的范式,表明其相比反序更有效减少属性漂移。定量结果表明,人脸特征一致性表现优异,美学与人类偏好评分达到当前最优水平;定性分析及在Cruilla音乐节的现场部署进一步凸显其真实创作影响力。CraftGraffiti推动了尊重身份的AI辅助艺术发展,为创意应用中风格自由与可识别性的融合提供了可靠路径。

原文摘要 · Abstract (English)

Preserving facial identity under extreme stylistic transformation remains a major challenge in generative art. In graffiti, a high-contrast, abstract medium, subtle distortions to the eyes, nose, or mouth can erase the subject's recognizability, undermining both personal and cultural authenticity. We present CraftGraffiti, an end-to-end text-guided graffiti generation framework designed with facial feature preservation as a primary objective. Given an input image and a style and pose descriptive prompt, CraftGraffiti first applies graffiti style transfer via LoRA-fine-tuned pretrained diffusion transformer, then enforces identity fidelity through a face-consistent self-attention mechanism that augments attention layers with explicit identity embeddings. Pose customization is achieved without keypoints, using CLIP-guided prompt extension to enable dynamic re-posing while retaining facial coherence. We formally justify and empirically validate the "style-first, identity-after" paradigm, showing it reduces attribute drift compared to the reverse order. Quantitative results demonstrate competitive facial feature consistency and state-of-the-art aesthetic and human preference scores, while qualitative analyses and a live deployment at the Cruilla Festival highlight the system's real-world creative impact. CraftGraffiti advances the goal of identity-respectful AI-assisted artistry, offering a principled approach for blending stylistic freedom with recognizability in creative AI applications.

涂鸦生成人脸保真扩散模型风格迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。