将变化检测全流程搬上卫星,实现近实时处理。
Compress-Align-Detect: onboard change detection from unregistered images
- 三模块协同:压缩、轻量配准、高效变化检测
- 压缩率下F1分数仍达高水准,每秒处理0.7兆像素
- 适合资源受限的星载系统,首次端到端整合
从卫星图像中进行变化检测通常因图像下传延迟和地面站正射校正耗时而产生数小时至数天的延迟,难以满足实时或近实时应用需求。为克服这一限制,本文提出将整个变化检测流程移至卫星上执行,需同时应对数据存储、图像配准与变化检测的挑战,并满足严格的计算复杂度约束。我们提出一种新型高效的星载变化检测框架,采用端到端深度神经网络,包含三个相互关联的子模块:(1)面向最小化星上存储资源的图像压缩;(2)针对非正射校正多时相图像对的轻量级共配准;(3)一种新型时不变且计算高效的检测模型。这是首个在星载处理约束下,将所有任务统一于单一端到端框架中的方法。实验对比各子模块与当前最优技术,并在低功耗硬件上评估整体系统在真实场景下的性能。结果表明,在不同压缩率下均获得优异的检测效果,且在15瓦加速器上维持0.7兆像素/秒的吞吐率。
原文摘要 · Abstract (English)
Change detection from satellite images typically incurs a delay ranging from several hours up to days because of latency in downlinking the acquired images and generating orthorectified image products at the ground stations; this may preclude real- or near real-time applications. To overcome this limitation, we propose shifting the entire change detection workflow onboard satellites. This requires to simultaneously solve challenges in data storage, image registration and change detection with a strict complexity constraint. In this paper, we present a novel and efficient framework for onboard change detection that addresses the aforementioned challenges in an end-to-end fashion with a deep neural network composed of three interlinked submodules: (1) image compression, tailored to minimize onboard data storage resources; (2) lightweight co-registration of non-orthorectified multi-temporal image pairs; and (3) a novel temporally-invariant and computationally efficient change detection model. This is the first approach in the literature combining all these tasks in a single end-to-end framework with the constraints dictated by onboard processing. Experimental results compare each submodule with the current state-of-the-art, and evaluate the performance of the overall integrated system in realistic setting on low-power hardware. Compelling change detection results are obtained in terms of F1 score as a function of compression rate, sustaining a throughput of 0.7 Mpixel/s on a 15W accelerator.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。