arXiv:2603.24109eess.IVcs.AI2026-03

用双形式注意力机制实现高效多模卫星时序分析,支持实时增量更新。

Comparative analysis of dual-form networks for live land monitoring using multi-modal satellite image time series

  • 提出双形式注意力机制,支持并行训练与递归推理。
  • 在哨兵1/2数据上性能接近标准Transformer,计算效率显著提升。
  • 适合需要大范围定期更新的实景土地监测系统。

多模卫星图像时序(SITS)分析在实时土地监测中面临巨大计算挑战。尽管Transformer架构能有效捕捉时间依赖性并融合多源数据,但其二次复杂度及每次新数据需重新处理整序列的特性,限制了其在大规模、高频监测中的部署。本文研究多种双形式注意力机制,实现高效多模SITS分析,支持并行训练与递归推理。为应对SITS中时间不规则与对齐困难问题,提出基于实际获取日期而非序列索引计算标记距离的时间自适应机制。在两个任务上评估:以多模SITS预测为代理任务,以及真实太阳能板建设监测。实验表明,双形式机制性能接近标准Transformer,同时支持高效递归推理。多模框架在两项任务中均优于单模方法,证明双机制在传感器融合中的有效性。该工作为需要定期更新的大范围陆地监测系统开辟新可能。

原文摘要 · Abstract (English)

Multi-modal Satellite Image Time Series (SITS) analysis faces significant computational challenges for live land monitoring applications. While Transformer architectures excel at capturing temporal dependencies and fusing multi-modal data, their quadratic computational complexity and the need to reprocess entire sequences for each new acquisition limit their deployment for regular, large-area monitoring. This paper studies various dual-form attention mechanisms for efficient multi-modal SITS analysis, that enable parallel training while supporting recurrent inference for incremental processing. We compare linear attention and retention mechanisms within a multi-modal spectro-temporal encoder. To address SITS-specific challenges of temporal irregularity and unalignment, we develop temporal adaptations of dual-form mechanisms that compute token distances based on actual acquisition dates rather than sequence indices. Our approach is evaluated on two tasks using Sentinel-1 and Sentinel-2 data: multi-modal SITS forecasting as a proxy task, and real-world solar panel construction monitoring. Experimental results demonstrate that dual-form mechanisms achieve performance comparable to standard Transformers while enabling efficient recurrent inference. The multimodal framework consistently outperforms mono-modal approaches across both tasks, demonstrating the effectiveness of dual mechanisms for sensor fusion. The results presented in this work open new opportunities for operational land monitoring systems requiring regular updates over large geographic areas.

卫星遥感时间序列注意力机制土地监测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。