用解码端分离机制提升图像地理定位精度
GeoBridge: Decoupled Semantic Conditioning for Generative Image Geolocalization

- 将语义推理与坐标生成解耦,用连续条件驱动球面生成
- 在IM2GPS3K上达到25/200/750公里阈值下38.67/52.89/70.37的准确率
- 适合需要高精度地理坐标的视觉定位任务
多模态大语言模型(MLLM)在图像地理定位上的进展主要集中在地理线索的推理能力提升,但推理结果如何转化为坐标仍滞后。传统通过地名查API的方式是离散且信息损失严重的,忽略图像证据并将多粒度语义压缩为粗略查找。我们认为瓶颈已从模型的推理内容转向其推理表示方式以适配连续、几何感知的解码器。本文提出GeoBridge,一种角色解耦的条件机制,将冻结的语义MLLM与冻结的黎曼流匹配头连接,实现球面上坐标生成。核心挑战在于角色冲突:用离散语义标签监督会诱导表征偏向类别判别几何,违背生成头所需的光滑流形。GeoBridge通过独立投影构建连续条件,注入地理先验而不干扰球面解码器。在IM2GPS3K数据集上,GeoBridge在25/200/750公里阈值下分别达到38.67/52.89/70.37的准确率,优于基于地名查API的管道和增强推理的直接预测方法。GeoBridge是一种解码侧算法贡献,与思维链推理正交互补。代码将公开。
原文摘要 · Abstract (English)
Multimodal large language models (MLLMs) have advanced image geolocalization mainly by improving how they reason about geographic cues. How that reasoning isdecoded into coordinates, however, has lagged behind. Predicting a place name for a geocoding API is discrete and lossy: it ignores image evidence and collapses multi-granular semantics into a coarse lookup. We argue that the bottleneck has shifted from what a model reasons to how that reasoning is represented for a continuous, geometry-aware decoder. We present GeoBridge, a role-decoupled conditioning mechanism that connects a frozen semantic MLLM to a frozen Riemannian flow-matching head that generates coordinates on the sphere. The central obstacle is arole conflict: supervising the condition with discrete semantic labels biases its representation toward class-discriminative geometry, at odds with the smooth manifold the generative head requires. GeoBridge keeps the semantic supervision decoupled from the condition interface: a separate projection forms the continuous condition the frozen head expects, injecting geographic priors without disturbing the spherical decoder. On IM2GPS3K, GeoBridge reaches 38.67/52.89/70.37 at the 25/200/750 km thresholds, improving over a place-name-to-API pipeline and reasoning-augmented direct prediction at these precision-relevant scales. GeoBridge is a decode-side algorithmic contribution, orthogonal and complementary to chain-of-thought reasoning. Code will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。