arXiv:2607.00579cs.CV2026-07中稿 · ECCV

用边缘图对齐优化3D重建,提速降耗还更准。

EPO: Boosting 3D Foundation Models with Edge-based Pose Optimization

论文配图:EPO: Boosting 3D Foundation Models with Edge-based Pose Optimization
图 1 · 摘自论文原文
  • 不依赖特征匹配,直接通过边缘图对齐优化姿态
  • 在多个数据集上达到或超越传统优化方法的精度
  • 内存占用极低,适合手机等消费级设备运行

我们提出边对齐姿态优化(Edge-based Pose Optimization, EPO),一种无需轨迹的几何优化框架,用于提升3D基础模型生成的运动恢复结构(SfM)结果。这些模型通过跳过传统流程中的特征提取与匹配阶段实现快速推理,但几何精度不足。尽管可通过类似束调整(Bundle Adjustment)的方法后处理改进,但该过程需重建特征轨迹,破坏原始速度优势。EPO采用全可微的边缘图对齐作为几何优化代理,完全避免特征提取与轨迹构建。在多个数据集和任务上的广泛评估表明,EPO在显著更低的运行时间和内存消耗下,仍能匹配或超越传统优化方法的精度。其极低的内存开销使其适用于消费级硬件,而其他竞争性方法在此类设备上无法运行。

原文摘要 · Abstract (English)

We introduce \textbf{Edge-based Pose Optimization (EPO)}, a trackless geometric optimization framework specifically designed to boost the Structure-from-Motion reconstructions generated by 3D Foundation Models. These models achieve rapid inference by bypassing the time-consuming feature extraction and matching stages of traditional pipelines, where explicit correspondences between each 3D point and multiple images, referred to as tracks, are established. However, their geometric accuracy currently falls short of traditional pipelines. While this can be addressed in a post-processing step via Bundle Adjustment-like refinement, doing so requires extracting feature tracks, thus defeating the original speed advantage. Instead, our fully differentiable framework uses edge map alignment as a proxy for geometric optimization, avoiding feature extraction and track construction entirely. Through extensive evaluation across multiple datasets and tasks, we demonstrate that EPO matches or outperforms Bundle Adjustment-like methods while requiring significantly lower runtime and memory. Notably, its reduced memory footprint makes EPO suitable for consumer-grade hardware, where competing refinement methods cannot run.

3D重建几何优化轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。