arXiv:2607.28571cs.CVcs.IR2026-07

高效检索卫星影像变化:用文本匹配前后图像对,提升搜索速度与精度

Finding Change in Satellite Archives from Text: How to Combine Before-and-After Images Efficiently

论文配图:Finding Change in Satellite Archives from Text: How to Combine Before-and-After Images Efficiently
图 1 · 摘自论文原文
  • 提出分阶段检索策略:先快速筛选候选对,再精排,大幅降低查询成本
  • 实验表明,该方法在LEVIR-CC上召回率不降反升,查询耗时减少10-15倍
  • 压缩融合表示(TBF)可降参2.3倍、延迟降1.6倍,微小性能损失但细节易丢

实际地球观测需求日益增长,要求回答如“找出新建建筑出现的图像对”这类问题。这需要在前-后时相卫星图像对的档案中搜索,并根据自然语言描述对变化的匹配度进行排序。其中,融合模块负责结合“前”与“后”视图,在查询时需对大量候选对运行,其速度决定整体搜索成本。本文对八种不同设计进行了受控比较,均基于同一冻结的CLIP图像编码器和统一训练方案,涵盖注意力机制、状态空间模型(Mamba)及学习型压缩(我们提出的时序瓶颈融合,TBF)三类。在两个基准数据集(LEVIR-CC 和 Dubai-CC)上,每种方法使用十次随机种子测试,结果具有统计意义。关键发现:一、无需训练的两阶段搜索(先用廉价差值模型粗筛,再用注意力融合重排)在LEVIR-CC上实现与全融合相当或更优的召回率,同时将查询成本降低10–15倍,迪拜-CC上R@1/R@5表现也相近;二、尽管Mamba的线性扫描理论上高效,但在典型视觉变压器块数(L=196)下因内存带宽受限,未带来速度优势,而注意力机制更适配并行硬件;三、压缩融合表示(TBF)使参数减少2.3倍、延迟降低1.6倍,仅导致变化检测的BLEU-1下降0.007,但更激进的压缩会悄悄丢失关键变化细节,且聚合指标难以察觉。

原文摘要 · Abstract (English)

Operational Earth observation increasingly calls for answering queries such as ``find the image pairs where a new building appeared.'' This means searching an archive of before-and-after (bi-temporal) satellite image pairs and ranking each pair by how well it matches a natural-language description of the change. The component that performs this match, the fusion module that combines the ``before'' and ``after'' views, must be run at query time across many candidate pairs, so its speed largely sets the cost of every search. We present a controlled comparison of how to build that module. Using one fixed image encoder (a frozen CLIP model) and one training recipe for all variants, we evaluate eight designs drawn from three families: attention, state-space models (Mamba), and learned compression (our Temporal Bottleneck Fusion, TBF). Each design is tested on two benchmarks (LEVIR-CC and Dubai-CC) with ten random seeds, so the reported differences are statistically grounded. We outline three findings: first, a training-free two-stage search (a cheap difference model that shortlists candidates, followed by attention fusion that re-ranks them) matches or exceeds full-fusion recall on LEVIR-CC while cutting query cost $10$-$15\times$, with comparable R@1/R@5 on Dubai-CC; second, the linear-time scan of Mamba, attractive on paper, gives no speed benefit at the patch counts typical of vision transformers ($L{=}196$): the scan is limited by memory bandwidth, whereas attention maps cleanly onto parallel hardware; and third, compressing the fused representation (TBF) reduces parameters by $2.3\times$ and latency by $1.6\times$ for a change-only BLEU-1 cost of $0.007$, although more aggressive compression quietly discards change-relevant detail that aggregate metrics fail to reveal.

卫星影像文本检索变化检测高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。