单图生成复杂3D场景,速度提升3倍且精度更高
Flash Sculptor: Modular 3D Worlds from Objects

- 分而治之策略分解物体重建任务
- 旋转用粗到精方案,平移用去噪算法一步到位
- 适合需要快速构建3D场景的研究与开发
现有文本到3D和图像到3D模型在多物体复杂场景中表现不佳。尽管近期已有尝试探索组合场景,但仍需对整个布局进行大量优化,过程繁琐甚至不可行。为此,本文提出Flash Sculptor,一种从单张图像实现组合3D场景/物体重建的简洁高效框架。其核心是分而治之策略,将组合场景重建拆解为多个子任务:分别处理每个实例的外观、旋转、缩放和位移。针对旋转,引入粗到精方案,在效率与精度间取得平衡;针对位移,设计基于异常值剔除的算法,单步完成稳健精准参数估计,无需迭代优化。大量实验表明,Flash Sculptor相比现有方法至少提速3倍,同时在组合3D重建性能上树立新基准。代码已开源:https://github.com/YujiaHu1109/Flash-Sculptor。
原文摘要 · Abstract (English)
Existing text-to-3D and image-to-3D models often struggle with complex scenes involving multiple objects and intricate interactions. Although some recent attempts have explored such compositional scenarios, they still require an extensive process of optimizing the entire layout, which is highly cumbersome if not infeasible at all. To overcome these challenges, we propose Flash Sculptor in this paper, a simple yet effective framework for compositional 3D scene/object reconstruction from a single image. At the heart of Flash Sculptor lies a divide-and-conquer strategy, which decouples compositional scene reconstruction into a sequence of sub-tasks, including handling the appearance, rotation, scale, and translation of each individual instance. Specifically, for rotation, we introduce a coarse-to-fine scheme that brings the best of both worlds--efficiency and accuracy--while for translation, we develop an outlier-removal-based algorithm that ensures robust and precise parameters in a single step, without any iterative optimization. Extensive experiments demonstrate that Flash Sculptor achieves at least a 3 times speedup over existing compositional 3D methods, while setting new benchmarks in compositional 3D reconstruction performance. Codes are available at https://github.com/YujiaHu1109/Flash-Sculptor.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。