arXiv:2603.19121cs.CVcs.AI2026-03中稿 · CVPR被引 1

用参考图精准生成高保真3D室内纹理,支持逐对象定制。

CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customization

  • 通过双蒸馏机制分离语义控制与像素增强,实现精细调节。
  • 相比顶尖方法,纹理更清晰、伪影更少、阴影更自然。
  • 适合需要高质量、可定制3D场景外观编辑的设计师和开发者。

高保真、可定制的3D室内场景纹理生成仍是重大挑战。虽然文本驱动方法具有灵活性,但缺乏细粒度实例级控制能力,常产生质量不足、含伪影且带有固化阴影的纹理。为此,我们提出CustomTex,一种基于参考图像的实例级高保真场景纹理生成框架。该方法接收一个无纹理3D场景及一组指定每个物体实例期望外观的参考图像,生成统一的高分辨率纹理图。核心在于双蒸馏策略:语义级蒸馏结合实例交叉注意力,确保语义合理性与参考图-实例对齐;像素级蒸馏强化视觉保真度。两者统一于变分分数蒸馏(VSD)优化框架中。实验表明,CustomTex在参考图像一致性、纹理锐度、伪影减少及固化阴影抑制方面均优于当前最优方法。本工作为高质量、可定制3D场景外观编辑提供了更直接、友好的路径。

原文摘要 · Abstract (English)

The creation of high-fidelity, customizable 3D indoor scene textures remains a significant challenge. While text-driven methods offer flexibility, they lack the precision for fine-grained, instance-level control, and often produce textures with insufficient quality, artifacts, and baked-in shading. To overcome these limitations, we introduce CustomTex, a novel framework for instance-level, high-fidelity scene texturing driven by reference images. CustomTex takes an untextured 3D scene and a set of reference images specifying the desired appearance for each object instance, and generates a unified, high-resolution texture map. The core of our method is a dual-distillation approach that separates semantic control from pixel-level enhancement. We employ semantic-level distillation, equipped with an instance cross-attention, to ensure semantic plausibility and ``reference-instance'' alignment, and pixel-level distillation to enforce high visual fidelity. Both are unified within a Variational Score Distillation (VSD) optimization framework. Experiments demonstrate that CustomTex achieves precise instance-level consistency with reference images and produces textures with superior sharpness, reduced artifacts, and minimal baked-in shading compared to state-of-the-art methods. Our work establishes a more direct and user-friendly path to high-quality, customizable 3D scene appearance editing.

3D纹理图像生成实例级控制高保真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。