arXiv:2607.01885cs.CV2026-07中稿 · ECCV

通过视图多样性分组,让VGGT在大量视角下仍保持高效准确

Diversity-aware View Partitioning for Scalable VGGT

论文配图:Diversity-aware View Partitioning for Scalable VGGT
图 1 · 摘自论文原文
  • 用视觉差异和空间分布构建视图分组,减少冗余信息干扰
  • 在相机位姿估计等任务中提升精度,同时降低内存与延迟
  • 无需训练、即插即用,适合大规模多视角重建场景

几何变换器如VGGT通过全局注意力联合推理多个视角取得优异性能,但其注意力机制的二次计算复杂度使其难以扩展至大规模视图集合。我们实证发现,VGGT的重建质量对视角分布敏感:仅增加视图数量而不保证多样性反而会因高度相似的视图引入冗余令牌,稀释几何信号。为此,我们提出一种无需训练、可即插即用的VGGT推理框架,基于视觉差异与空间分散性,通过组合图划分将视图组织为多样性感知的均衡块。该策略使变压器聚焦于几何信息丰富的视图,减少冗余注意力交互。为避免完整姿态估计,我们利用少量种子帧的视觉相似性,通过软姿态传播近似空间关系。大量实验表明,该方法在相机位姿估计、多视角深度预测和3D重建任务中均实现性能提升,同时显著降低内存占用与推理延迟。该框架还可兼容现有VGGT变体,实现高保真度的可扩展多视角重建。

原文摘要 · Abstract (English)

Geometry transformers such as VGGT achieve strong performance by jointly reasoning over multiple views with global attention. However, scaling them to large view collections remains challenging due to the quadratic cost of attention. Moreover, our empirical analysis reveals that the reconstruction quality in VGGT is sensitive to the distribution of viewpoints. Simply increasing the number of views without sufficient viewpoint diversity can even degrade performance, as redundant views introduce highly similar tokens that dilute informative geometric signals in the attention mechanism. Motivated by this observation, we propose a training-free and plug-and-play VGGT inference framework that organizes views into diversity-aware balanced chunks. The chunks are constructed through combinatorial graph partitioning over visual dissimilarity and spatial dispersion. This view organization allows the transformer to focus attention on geometrically informative views while reducing redundant attention interactions. To estimate spatial dispersion without full pose estimation, we approximate spatial relationships via a soft pose propagation strategy based on visual similarity from a small set of seed frames. Extensive experiments demonstrate improved performance in camera pose estimation, multi-view depth prediction, and 3D reconstruction while reducing memory usage and inference latency. Our framework also complements existing VGGT variants, enabling scalable multi-view reconstruction without sacrificing geometric fidelity.

多视角重建几何变换器视图分组高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。