arXiv:2601.22615cs.CV2026-01被引 8

无需训练的时空自适应机制,提升长时间3D重建稳定性

TTSA3R: Training-Free Temporal-Spatial Adaptive Persistent State for Streaming 3D Reconstruction

  • 通过分析时序演化与空间观测质量,动态调节状态更新
  • 序列从50到250帧时误差仅增1.33倍,远优于现有方法
  • 适合需要长期稳定3D重建的应用场景,如自动驾驶

流式递归模型通过维持持久状态表示实现高效3D重建,但长序列下因历史信息与新观测的平衡问题易出现灾难性遗忘。现有方法虽从注意力角度引入自适应信号,却仅考虑单一维度,缺乏时空一致性。为此,我们提出无需训练的TTSA3R框架,同时利用时序状态演化和空间观测质量进行自适应状态更新。具体地,时序自适应更新模块通过分析时序演化模式调节更新强度;空间上下文更新模块则通过观测-状态对齐与场景动态定位需更新的空间区域。二者互补信号融合后决定更新策略。大量实验表明,TTSA3R在标准短序列基准上表现优异,在扩展序列中更具鲁棒性:在NRGBD数据集上,序列从50帧增至250帧时,其误差仅增长1.33倍,而CUT3R超过4倍退化,凸显时空自适应更新对长期重建稳定性的重要价值。代码已开源。

原文摘要 · Abstract (English)

Streaming recurrent models enable efficient 3D reconstruction by maintaining persistent state representations. However, they suffer from catastrophic forgetting over long sequences due to balancing historical information with new observations. Recent methods alleviate this by deriving adaptive signals from the attention perspective, but they operate on single dimensions without considering temporal and spatial consistency. To this end, we propose a training-free framework termed TTSA3R that leverages both temporal state evolution and spatial observation quality for adaptive state updates in 3D reconstruction. In particular, we devise a Temporal Adaptive Update Module that regulates update magnitude by analyzing temporal state evolution patterns. Then, a Spatial Contextual Update Module is introduced to localize spatial regions that require updates through observation-state alignment and scene dynamics. These complementary signals are finally fused to determine the state updating strategies. Extensive experiments show that TTSA3R achieves competitive performance on standard short-sequence benchmarks and provides substantially stronger robustness on extended sequences. On NRGBD, as sequences extend from 50 to 250 frames, TTSA3R exhibits only a 1.33x error increase, compared with over 4x degradation for CUT3R. This highlights the practical value of temporal-spatial adaptive updates for long-term reconstruction stability. Our code is available at https://github.com/anonus2357/ttsa3r.

3D重建流式建模自适应更新持久状态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。