arXiv:2505.21060cs.CV2025-05NeurIPS被引 8

一秒完成任意场景与风格的3D风格化,保持多视角一致。

Styl3R: Instant 3D Stylized Reconstruction for Arbitrary Scenes and Styles

  • 分枝结构分离结构建模与外观着色,防止风格扭曲场景。
  • 仅需稀疏无姿态图像,1秒内完成3D风格化重建。
  • 支持任意风格迁移,适合快速创意设计与数字内容生成。

在保持多视角一致性并忠实还原风格图像的前提下,实现3D场景的即时风格化仍是重大挑战。现有先进方法通常依赖计算量大的测试时优化,且需密集带姿态输入图像。本文提出一种新方法,利用前馈重建模型,仅需稀疏无姿态场景图像和任意风格图,在不到1秒内完成直接3D风格化。为解决重建与风格化之间的固有解耦问题,引入分枝架构,分离结构建模与外观着色,有效防止风格迁移扭曲3D结构。此外,通过新颖视图合成任务,采用身份损失进行预训练,使模型在微调风格化的同时保留原始重建能力。综合评估表明,该方法在域内与域外数据集上均生成高质量风格化3D内容,兼具风格与场景外观的优越融合,且在多视角一致性和效率方面优于现有方法。

原文摘要 · Abstract (English)

Stylizing 3D scenes instantly while maintaining multi-view consistency and faithfully resembling a style image remains a significant challenge. Current state-of-the-art 3D stylization methods typically involve computationally intensive test-time optimization to transfer artistic features into a pretrained 3D representation, often requiring dense posed input images. In contrast, leveraging recent advances in feed-forward reconstruction models, we demonstrate a novel approach to achieve direct 3D stylization in less than a second using unposed sparse-view scene images and an arbitrary style image. To address the inherent decoupling between reconstruction and stylization, we introduce a branched architecture that separates structure modeling and appearance shading, effectively preventing stylistic transfer from distorting the underlying 3D scene structure. Furthermore, we adapt an identity loss to facilitate pre-training our stylization model through the novel view synthesis task. This strategy also allows our model to retain its original reconstruction capabilities while being fine-tuned for stylization. Comprehensive evaluations, using both in-domain and out-of-domain datasets, demonstrate that our approach produces high-quality stylized 3D content that achieve a superior blend of style and scene appearance, while also outperforming existing methods in terms of multi-view consistency and efficiency.

3D风格化即时重建分枝架构前馈模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。