arXiv:2605.14315cs.CV2026-05

用自适应注意力提升3D重建速度与质量,兼顾效率与精度。

TurboVGGT: Fast Visual Geometry Reconstruction with Adaptive Alternating Attention

论文配图:TurboVGGT: Fast Visual Geometry Reconstruction with Adaptive Alternating Attention
图 1 · 摘自论文原文
  • 通过自适应稀疏全局注意力,动态选择关键特征点建模全局结构。
  • 在多个基准上实现更快重建速度,精度媲美顶尖方法。
  • 适合需要实时或高效3D重建的工业与科研场景。

近期的前馈式3D重建方法(如视觉几何变换器)通过单次前向传播实现多视角重建,突破了传统逐场景优化范式。然而,多数方法难以平衡重建质量与计算效率,限制了其可扩展性。尽管已有部分高效视觉几何变换器出现,但通常在各层和帧间使用固定稀疏率,缺乏自适应机制来学习代表性标记以捕捉全局关系,导致性能不足。本文提出TurboVGGT,一种基于自适应交替注意力的高效视觉几何变换器,用于快速多视角3D重建。该方法采用端到端可训练框架,结合自适应稀疏全局注意力与帧内注意力:前者根据帧间差异、层级抽象程度及结构信息区域,动态学习不同稀疏度的关键标记;后者聚合每帧内的局部细节。在多个3D重建基准上的大量实验表明,TurboVGGT在保持与最先进方法相当重建质量的同时,实现了显著更快的重建速度。项目页面:https://turbovggt.github.io/。

原文摘要 · Abstract (English)

Recent feed-forward 3D reconstruction methods, such as visual geometry transformers, have substantially advanced the traditional per-scene optimization paradigm by enabling effective multi-view reconstruction in a single forward pass. However, most existing methods struggle to achieve a balance between reconstruction quality and computational efficiency, which limits their scalability and efficiency. Although some efficient visual geometry transformers have recently emerged, they typically use the same sparsity ratio across layers and frames and lack mechanisms to adaptively learn representative tokens to capture global relationships, leading to suboptimal performance. In this work, we propose TurboVGGT, a novel approach that employs an efficient visual geometry transformer with adaptive alternating attention for fast multi-view 3D reconstruction. Specifically, TurboVGGT employs an end-to-end trainable framework with adaptive sparse global attention guided by adaptive sparsity selection to capture global relationships across frames and frame attention to aggregate local details within each frame. In the adaptive sparse global attention, TurboVGGT adaptively learns representative tokens with varying sparsity levels for global geometry modeling, considering that token importance varies across frames, attention layers operate tokens at different levels of abstraction, and global dependencies rely on structurally informative regions. Extensive experiments on multiple 3D reconstruction benchmarks demonstrate that TurboVGGT achieves fast multi-view reconstruction while maintaining competitive reconstruction quality compared with state-of-the-art methods. Project page: https://turbovggt.github.io/.

3D重建视觉几何注意力机制高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。