统一解决跨视角图像检索与姿态估计,提升定位精度与覆盖范围。
CIPER: A Unified Framework for Cross-view Image-retrieval and Pose-estimation

- 共享变压器编码器+任务专用标记,解耦全局检索与空间定位特征。
- 双向注意力机制缓解地面与航拍视图差异,实现稳定3-自由度姿态回归。
- 单模型同时支持城市级检索与高精度定位,适合实际导航场景。
跨视角地理定位通过匹配地面图像与航拍图像数据库来估计其地理位置。现有方法或侧重大规模检索,或聚焦精准姿态估计,但难以兼顾:检索方法虽可覆盖大范围,但定位精度低;姿态估计方法虽精度高,但仅适用于狭窄搜索区域。简单级联两者会导致误差传播和特征表示不一致。本文将跨视角地理定位建模为统一问题,需同时实现城市级检索与精确3-自由度(3-DoF)姿态估计。提出CIPER(Cross-view Image-retrieval and Pose-estimation transformER),一种单一架构,通过相互促进的特征学习联合完成两项任务。CIPER采用共享变压器编码器,并使用任务特定标记分离全局检索特征与空间定位线索。为弥合地面与航拍视图间的巨大域差异,引入双向变压器姿态解码器,以地面特征作为空间查询,进行双向交叉注意力。采用集合预测策略,在统一多任务目标下实现稳定的3-DoF回归。在VIGOR、KITTI和Ford Multi-AV数据集上的实验表明,该方法在视场受限和任意朝向条件下表现优异。代码已开源:https://github.com/yurimjeon1892/CIPER。
原文摘要 · Abstract (English)
Cross-view geo-localization estimates the geographic location of a ground image by matching it against an aerial image database. Existing methods tackle this through either large-scale retrieval or precise pose estimation, but not both: retrieval-based methods enable wide-area search at the cost of localization accuracy, while pose estimation methods achieve high precision within only a narrow search space. Naively cascading these pipelines introduces error propagation and inconsistent feature representations. We formulate cross-view geo-localization as a unified problem requiring simultaneous city-scale retrieval and precise 3-DoF pose estimation. We propose CIPER (Cross-view Image-retrieval and Pose-estimation transformER), a single architecture that jointly performs both tasks through mutually beneficial feature learning. CIPER uses a shared transformer encoder with task-specific tokens to disentangle global retrieval features from spatial localization cues. To bridge the large domain gap between ground and aerial views, we introduce a two-way transformer pose decoder that uses ground features as spatial queries for bidirectional cross-attention. A set prediction strategy further enables stable 3-DoF regression under a unified multi-task objective. Experiments on VIGOR, KITTI, and Ford Multi-AV demonstrate competitive performance, especially under limited field-of-view and arbitrary orientation conditions. Code is available at https://github.com/yurimjeon1892/CIPER.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。