arXiv:2510.10152cs.CV2025-10被引 2

用单视图颜色模型实现3D场景可控、一致的彩色化,支持动态与静态场景。

Color3D: Controllable and Consistent 3D Colorization with Personalized Colorizer

  • 仅需彩色化一个关键视图,通过个性化颜色器传播至其他视角和时间帧。
  • 在保持色彩丰富性的同时,实现跨视角和跨时间的一致性,优于平均融合方法。
  • 可集成任意图像着色模型,适合需要精细控制的3D内容创作用户。

本文提出Color3D,一种从灰度输入中对静态和动态3D场景进行高度可定制化着色的框架,生成视觉多样且色彩鲜艳的重建结果,并支持灵活的用户引导控制。与现有仅关注静态场景、通过平均颜色变化来强制多视角一致性的方法不同,我们的方法在保留色彩多样性与可控性的前提下,实现了跨视角和跨时间的一致性。核心思路是仅对一个关键视图进行着色,然后微调一个个性化颜色器,将其颜色传播至新视角和时间步。通过个性化训练,颜色器学习到参考视图背后的场景特定确定性颜色映射,利用其内在归纳偏置,一致地将对应颜色投影到新视角和视频帧的内容中。训练完成后,该个性化颜色器可用于推断所有其他图像的一致色度信息,从而通过专用的Lab颜色空间高斯泼溅表示直接重建彩色3D场景。该框架巧妙地将复杂的3D着色问题转化为更易处理的单图像范式,允许无缝集成任意图像着色模型,提升灵活性与可控性。在多个静态和动态3D着色基准上的大量实验表明,本方法能生成更具一致性与色彩丰富的渲染结果,并具备精确的用户控制能力。

原文摘要 · Abstract (English)

In this work, we present Color3D, a highly adaptable framework for colorizing both static and dynamic 3D scenes from monochromatic inputs, delivering visually diverse and chromatically vibrant reconstructions with flexible user-guided control. In contrast to existing methods that focus solely on static scenarios and enforce multi-view consistency by averaging color variations which inevitably sacrifice both chromatic richness and controllability, our approach is able to preserve color diversity and steerability while ensuring cross-view and cross-time consistency. In particular, the core insight of our method is to colorize only a single key view and then fine-tune a personalized colorizer to propagate its color to novel views and time steps. Through personalization, the colorizer learns a scene-specific deterministic color mapping underlying the reference view, enabling it to consistently project corresponding colors to the content in novel views and video frames via its inherent inductive bias. Once trained, the personalized colorizer can be applied to infer consistent chrominance for all other images, enabling direct reconstruction of colorful 3D scenes with a dedicated Lab color space Gaussian splatting representation. The proposed framework ingeniously recasts complicated 3D colorization as a more tractable single image paradigm, allowing seamless integration of arbitrary image colorization models with enhanced flexibility and controllability. Extensive experiments across diverse static and dynamic 3D colorization benchmarks substantiate that our method can deliver more consistent and chromatically rich renderings with precise user control. Project Page https://yecongwan.github.io/Color3D/.

3D着色可控生成个性化模型高斯泼溅

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。