arXiv:2608.27529cs.CV2026-08

用前11帧局部上下文实现长序列3D重建,误差降40%

Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction

论文配图:Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction
图 1 · 摘自论文原文
  • 仅缓存前11帧的KV特征,保持时序状态严格局部
  • 在牛津斯普雷兹数据集上绝对轨迹误差仅4.35米,旋转误差0.12度
  • 适合资源受限场景下的实时长序列3D重建

从极长视频流中进行在线3D重建需在有限内存和计算条件下估计相机运动与场景几何。早期方法通过有限上下文缓冲或紧凑循环状态实现因果且成本可控的推断,但随序列增长估计性能下降。近期方法通过结合短程上下文与持久或多层次长程记忆提升长期稳定性。本文另辟蹊径:保持学习到的时序状态严格局部,并使预测目标独立于序列长度。提出ABot-Recon模型,仅缓存前11帧的键值(KV)特征,预测当前相机坐标系下的点云图及相邻帧间相对位姿。该预测在参考系变换下保持等变性,全局位姿与几何通过逐次组合恢复。为减少累积漂移,引入轻量级时序修正器,利用近期视觉与运动上下文优化相对旋转,同时采用组合感知位姿损失监督多步位姿组合。在多个挑战性长序列基准上的广泛评估表明,局部上下文方法具有更优的长期性能。在牛津斯普雷兹数据集上,ABot-Recon实现4.35米的绝对轨迹误差(ATE)和0.12°的旋转位置误差(RPE-R),较最优先前结果降低约40%。

原文摘要 · Abstract (English)

Streaming 3D reconstruction from extremely long videos requires estimating camera motion and scene geometry online under bounded memory and computation. Early streaming models achieve causal, bounded-cost inference using finite context buffers or compact recurrent states, yet their estimates often deteriorate as sequences grow. Recent methods improve long-horizon stability by coupling short-range context with persistent or multi-level long-range memory. We pursue a different route: we keep the learned temporal state strictly local and formulate predictions whose targets remain independent of sequence length. We present ABot-Recon, a simple streaming model that caches KV features from only the preceding 11 frames. It predicts a point map in the current camera coordinate system together with an adjacent-frame relative pose. These predictions remain equivariant under changes of reference frame, and global poses and geometry are recovered through sequential composition. To reduce accumulated drift, a lightweight temporal refiner improves relative rotations using recent visual and motion context, while a composition-aware pose loss supervises multi-step pose composition. Extensive evaluations on challenging long-sequence benchmarks demonstrate the superior long-horizon performance of our local-context approach. On Oxford Spires, ABot-Recon achieves an ATE of 4.35 m and an RPE-R of $0.12^\circ$, reducing both errors by approximately 40\% relative to the best prior results.

3D重建流式处理局部上下文姿态估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。