跨多年重建3D模型,解决珊瑚礁等长期监测中的视觉变化难题
Long-Term Multi-Session 3D Reconstruction Under Substantial Appearance Change
- 联合重建时直接建模跨会话对应关系,避免事后对齐失败
- 在真实珊瑚礁数据上实现多年拍摄图像的稳定统一建模
- 结合手工与学习特征,仅对可能匹配对使用昂贵特征提升效率
长期环境监测需要在相隔数月甚至数年的多次访问中重建并对齐3D模型。然而,现有SfM流程隐含假设图像为近同时采集且外观变化有限,因此在珊瑚礁调查等长期监测场景中失效,因显著的视觉与结构变化普遍存在。本文指出,当前方法主要缺陷在于依赖独立重建后的事后对齐,难以应对大时间跨度下的外观变化。为此,我们提出在联合SfM重建中直接强制跨会话对应关系,结合互补的手工与学习视觉特征,在标准独立或联合SfM失效的情况下,仍能从相隔数年的影像中重建出单一连贯的3D模型。我们在包含显著现实变化的长期珊瑚礁数据集上验证该方法,证明其在其他方法无法生成一致结果时仍能实现稳定联合重建。为保证大规模数据可扩展性,我们通过视觉位置识别筛选出高概率跨会话图像对,仅对这些对使用昂贵的特征匹配,显著降低计算成本并提升对齐鲁棒性。
原文摘要 · Abstract (English)
Long-term environmental monitoring requires the ability to reconstruct and align 3D models across repeated site visits separated by months or years. However, existing Structure-from-Motion (SfM) pipelines implicitly assume near-simultaneous image capture and limited appearance change, and therefore fail when applied to long-term monitoring scenarios such as coral reef surveys, where substantial visual and structural change is common. In this paper, we show that the primary limitation of current approaches lies in their reliance on post-hoc alignment of independently reconstructed sessions, which is insufficient under large temporal appearance change. We address this limitation by enforcing cross-session correspondences directly within a joint SfM reconstruction. Our approach combines complementary handcrafted and learned visual features to robustly establish correspondences across large temporal gaps, enabling the reconstruction of a single coherent 3D model from imagery captured years apart, where standard independent and joint SfM pipelines break down. We evaluate our method on long-term coral reef datasets exhibiting significant real-world change, and demonstrate consistent joint reconstruction across sessions in cases where existing methods fail to produce coherent reconstructions. To ensure scalability to large datasets, we further restrict expensive learned feature matching to a small set of likely cross-session image pairs identified via visual place recognition, which reduces computational cost and improves alignment robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。