arXiv:2605.21121cs.CVcs.GR2026-05

让单视图3D生成模型轻松支持任意视角输入,提升生成质量。

ROAR-3D: Routing Arbitrary Views for High-Fidelity 3D Generation

论文配图:ROAR-3D: Routing Arbitrary Views for High-Fidelity 3D Generation
图 1 · 摘自论文原文
  • 用令牌级视角路由机制,自动分配每个3D部分对应的最佳视角。
  • 在不改变主视角行为前提下,通过双流注意力增强几何细节,性能超越现有方法。
  • 轻量设计仅增加少量参数,可灵活支持1到12个以上视角输入。

单视图3D生成模型已能产出高质量几何结构,但仅依赖单一视角会带来未见区域的模糊性。多视角输入可缓解此问题,但现有方法或需固定标准视角,或依赖外部重建模块,训练成本高且限制生成质量。我们发现预训练单视图模型已具备强大的2D到3D对齐能力,可复用于多视角条件生成。然而分析表明,其条件机制将朝向控制与几何传递耦合,导致不同视角图像直接拼接时产生冲突。为此,我们提出ROAR-3D,一种轻量级方法,将预训练单视图模型升级为支持任意数量无姿态图像输入。基于令牌级视角路由,将每个3D潜在令牌分配至最相关视角,隐式建立2D到3D对应关系,无需显式姿态信息。采用双流注意力设计,保留主视角行为的同时,通过独立路径注入辅助视角的几何信息。结合朝向扰动策略,确保辅助路径学习与朝向无关的几何迁移。该方法仅引入极少可训练参数,推理开销几乎可忽略。ROAR-3D在多视角3D生成上达到当前最优表现,并支持测试阶段从1到12+视角的动态扩展,性能持续提升。

原文摘要 · Abstract (English)

Single-image-to-3D generative models can now produce high-quality geometry, yet conditioning on a single view inevitably introduces ambiguity about unseen regions. Multi-view conditioning can reduce this ambiguity, but existing methods either require fixed canonical viewpoints or rely on external reconstruction modules that impose heavy training costs and limit generation quality. We observe that pretrained single-view models already possess strong 2D-to-3D grounding that can be reused for multi-view conditioning. However, a closer analysis reveals that their conditioning mechanism entangles orientation control with geometry transfer, two functions that conflict when images from different viewpoints are naively combined. Based on this analysis, we propose ROAR-3D, a lightweight method that upgrades a pretrained single-view model to accept an arbitrary number of unposed images. A token-wise view router assigns each 3D latent token to its most relevant view, implicitly establishing 2D-to-3D correspondences without explicit pose input. A dual-stream attention design preserves the pretrained primary-view behavior while routing auxiliary views through a separate path dedicated to geometric enrichment. An orientation perturbation strategy ensures the auxiliary path learns orientation-independent geometry transfer. These components introduce minimal trainable parameters and add negligible inference overhead relative to the single-view baseline. ROAR-3D achieves state-of-the-art multi-view 3D generation quality and supports test-time view scaling from 1 to 12+ views with consistent improvements.

3D生成多视角轻量模型扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。