arXiv:2606.12562cs.CVcs.GR2026-06中稿 · SIGGRAPH

实现跨视角大姿态的3D-aware发型迁移,支持真实感合成。

HairPort: In-context 3D-aware Hair Import and Transfer for Images

论文配图:HairPort: In-context 3D-aware Hair Import and Transfer for Images
图 1 · 摘自论文原文
  • 分离去发与迁移步骤,结合3D重建保证几何一致
  • 在6000对数据上训练出逼真光头图像生成器
  • 适合虚拟试妆、AR换发等需要大视角变化的场景

发型迁移是计算机图形学、计算机视觉和视觉特效中的重要但具有挑战性的任务,可让用户在不改变实际头发的情况下探索新造型,应用于虚拟试穿系统、增强现实和娱乐。现有方法在小姿态差异下表现良好,但在大视角和尺度差异下难以处理缺失发丝的合成问题。本文提出HairPort,一种3D感知的发型迁移框架,通过显式分离去发与迁移,并在合成前强制几何一致性来解决这些问题。我们引入Bald Converter,基于LoRA的上下文自适应方法,在FLUX.1 Kontext基础上生成真实感光头图像。为训练该模块,我们构建了包含6000对配对图像的新数据集Baldy,覆盖多样身份与条件。同时采用3D感知迁移流程,在目标视角下重建并重渲染参考发型后与源图像融合。由于具备3D感知能力,本方法可处理源与目标间的大姿态和尺度差异。最后,一个条件流匹配生成器从光头源图与对齐的参考几何引导中合成最终结果。整体方法实现了准确、姿态一致且身份保留的发型迁移,在定性和定量评估中均优于现有方法。

原文摘要 · Abstract (English)

Transferring hairstyles between images is an important but challenging task in computer graphics, computer vision, and visual effects. It enables users to explore new looks without physically altering their hair, with applications in virtual try-on systems, augmented reality, and entertainment. Most prior works operate best under small pose gaps, and they fall short under large viewpoint and scale differences, where missing hair content must be synthesized rather than transferred. We propose HairPort, a 3D-aware hairstyle transfer framework that attempts to solve these issues by explicitly separating hair removal from transfer and enforcing geometric consistency before synthesis. We introduce a Bald Converter, which produces realistic bald versions of faces through LoRA-based in-context adaptation of FLUX.1 Kontext. To train our Bald Converter, we introduce a new dataset, Baldy, containing 6,000 paired bald and original images across diverse identities and conditions. We also use a 3D-Aware Transfer Pipeline that reconstructs and re-renders the reference hairstyle from the target viewpoint before compositing it onto the source image. Being 3D aware, our method supports large pose and scale discrepancies between the source and target. Finally, a conditional flow-matching generator synthesizes the transferred result from the bald source and geometry-aligned reference guidance. Together, our method enables accurate, pose-consistent, and identity-preserving hairstyle transfer, outperforming existing methods both qualitatively and quantitatively.

发型迁移3D感知图像生成虚拟试妆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。