arXiv:2510.23928cs.ROcs.CV2025-10中稿 · ROBOVIS 2026被引 4

动态环境3D重建中自适应选关键帧,提升质量与效率

Adaptive Keyframe Selection for Scalable 3D Scene Reconstruction in Dynamic Environments

  • 根据图像相似性与运动动态,动态调整关键帧选择阈值
  • 在Spann3r和CUT3R上均显著优于固定间隔选帧方法
  • 适合机器人实时感知与复杂动态场景下的可扩展重建

本文提出一种自适应关键帧选择方法,以改善动态环境中的3D场景重建。该方法融合两个互补模块:基于光度与结构相似性(SSIM)误差的选帧模块,以及根据场景运动动态自适应调整阈值的动量更新模块。通过动态筛选最具信息量的帧,缓解实时感知中的数据瓶颈,实现从压缩数据流构建高质量3D世界表示,为复杂动态环境中机器人的可扩展学习与部署奠定基础。实验表明,该方法显著优于传统静态策略(如固定时间间隔或均匀跳帧)。在两个前沿3D重建网络Spann3r和CUT3R上均取得一致性能提升。消融实验验证了各组件的有效性,凸显其对整体性能的贡献。

原文摘要 · Abstract (English)

In this paper, we propose an adaptive keyframe selection method for improved 3D scene reconstruction in dynamic environments. The proposed method integrates two complementary modules: an error-based selection module utilizing photometric and structural similarity (SSIM) errors, and a momentum-based update module that dynamically adjusts keyframe selection thresholds according to scene motion dynamics. By dynamically curating the most informative frames, our approach addresses a key data bottleneck in real-time perception. This allows for the creation of high-quality 3D world representations from a compressed data stream, a critical step towards scalable robot learning and deployment in complex, dynamic environments. Experimental results demonstrate significant improvements over traditional static keyframe selection strategies, such as fixed temporal intervals or uniform frame skipping. These findings highlight a meaningful advancement toward adaptive perception systems that can dynamically respond to complex and evolving visual scenes. We evaluate our proposed adaptive keyframe selection module on two recent state-of-the-art 3D reconstruction networks, Spann3r and CUT3R, and observe consistent improvements in reconstruction quality across both frameworks. Furthermore, an extensive ablation study confirms the effectiveness of each individual component in our method, underlining their contribution to the overall performance gains.

3D重建关键帧动态环境机器人感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。