arXiv:2409.14430cs.CVcs.AI2024-09

Pomo3D可自由为3D人像添加多个配饰,且不改变原身份。

Pomo3D: 3D-Aware Portrait Accessorizing and More

  • 分解重组人像与配饰,实现多配件自由搭配
  • 支持从手绘草图生成3D配饰,无需复杂建模
  • 能避免数据偏差,适合虚拟形象个性化创作

我们提出Pomo3D,一种3D人像编辑框架,通过分解与重组人像和配饰,实现自由添加多个配饰。该方法使虚拟角色能够呈现同时佩戴多个配饰的分布外(OOD)外观,而现有方法要么无法生成新增物体,要么在生成配饰时导致人像身份改变。本工作解决了这一关键难题。我们引入Scribble2Accessories模块,可从用户绘制的配饰草图生成3D配饰。此外,设计了偏差感知映射器以缓解真实数据集中的偏见问题。除物体级编辑外,Pomo3D还支持对人像几何与纹理进行全局或局部编辑,以及角色风格化,将神经3D人像编辑提升至更全面的层次。

原文摘要 · Abstract (English)

We propose Pomo3D, a 3D portrait manipulation framework that allows free accessorizing by decomposing and recomposing portraits and accessories. It enables the avatars to attain out-of-distribution (OOD) appearances of simultaneously wearing multiple accessories. Existing methods still struggle to offer such explicit and fine-grained editing; they either fail to generate additional objects on given portraits or cause alterations to portraits (e.g., identity shift) when generating accessories. This restriction presents a noteworthy obstacle as people typically seek to create charming appearances with diverse and fashionable accessories in the virtual universe. Our approach provides an effective solution to this less-addressed issue. We further introduce the Scribble2Accessories module, enabling Pomo3D to create 3D accessories from user-drawn accessory scribble maps. Moreover, we design a bias-conscious mapper to mitigate biased associations present in real-world datasets. In addition to object-level manipulation above, Pomo3D also offers extensive editing options on portraits, including global or local editing of geometry and texture and avatar stylization, elevating 3D editing of neural portraits to a more comprehensive level.

3D生成人像编辑配饰生成神经渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。