用流模型引导重建,兼顾生成先验与真实观测的一致性。
FlowObject: Flow Steering for Bridging Generative Priors and Reconstruction Fidelity

- 通过双空间引导控制流模型的微分方程轨迹,实现生成先验与观测数据协同。
- 在严重遮挡下仍保持几何完整性与视点依赖外观保真度,优于现有方法。
- 适合需要高保真3D重建且关注未见区域补全的应用场景。
从少量随意拍摄的图像恢复物体的完整3D表示仍是重大挑战。基于流匹配(Flow-Matching, FM)的最新3D生成模型能合成高质量纹理资产,但常受“合成偏差”影响,使学习到的先验覆盖实际观测证据,且与具体观测实例对齐不足。而基于优化的方法如3D高斯泼溅(3DGS)虽能在可见表面提供高保真度,却难以推断未观测几何。本文提出FlowObject,将稀疏视角3D重建重构为无训练、可引导的逆问题。方法采用双空间引导策略,操控流匹配模型的常微分方程(ODE)轨迹,利用学习到的生成先验完成未见区域补全,同时严格保持与真实观测的一致性。通过集成3DGS精修阶段,进一步弥合生成输出与真实感重建间的差距。在合成与真实世界数据集上的综合基准测试表明,当前最先进方法常无法同时实现几何完整性和观测一致性,尤其在严重遮挡下。相比之下,本方法在几何完整性与视点依赖外观保真度上显著超越现有生成模型与优化框架。
原文摘要 · Abstract (English)
Recovering complete 3D representations of objects from few casual image captures remains a significant challenge. Recent 3D generative models, particularly those based on Flow-Matching (FM), can synthesize high-quality textured assets; however, they often suffer from ''synthetic bias'' where learned priors override observational evidence, alongside a lack of alignment with the observed instance. Conversely, optimization-based methods like 3D Gaussian Splatting (3DGS) provide high fidelity on visible surfaces but fail to reason about unobserved geometry. In this paper, we present FlowObject, a framework that reformulates sparse-view 3D reconstruction as a training-free, guided inverse problem. Our approach applies a dual-space guidance strategy to steer the Ordinary Differential Equation (ODE) trajectory of a flow-matching model, enabling the completion of unseen regions through learned generative priors while enforcing strict consistency with real-world observations. By integrating a 3DGS refinement stage, FlowObject further bridges the gap between ''synthetic-looking'' generative outputs and photorealistic reconstructions. Comprehensive benchmarks on synthetic and real-world datasets demonstrate that current state-of-the-art methods often struggle to achieve geometric completeness and observational consistency simultaneously, especially under severe occlusions. In contrast, our method significantly outperforms state-of-the-art generative models and optimization-based frameworks in both geometric completeness and view-dependent appearance fidelity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。