为卫星实时超分辨设计轻量神经网络,逐行处理提升效率
Onboard Hyperspectral Super-Resolution with Deep Pushbroom Neural Network
- 按卫星推扫扫描方式逐行处理,用因果记忆减少计算开销
- 在低功耗硬件上实现每行采集即超分辨,满足实时性要求
- 性能媲美甚至超越更复杂方法,适合星载部署
卫星上的高光谱成像仪虽能获取精细的光谱特征以区分不同物质,但空间分辨率有限。提升空间分辨率是下游任务中增强检测能力的重要预处理步骤。同时,越来越多需求要求将推理方法直接部署于卫星平台,亟需可在载荷上实时运行的轻量化超分辨率方法。本文提出一种新型神经网络——深度推扫超分辨(Deep Pushbroom Super-Resolution, DPSR),其设计匹配高光谱传感器的推扫式成像机制,沿航向逐行处理图像,并通过因果记忆机制利用已获取的前序行信息。该设计大幅降低内存占用与计算复杂度,在低功耗硬件上实现星载实时性能:每行图像的超分辨时间不超过下一行的采集时间。实验表明,超分辨图像质量达到或超过当前最先进方法,而后者模型复杂度显著更高。
原文摘要 · Abstract (English)
Hyperspectral imagers on satellites obtain the fine spectral signatures essential for distinguishing one material from another at the expense of limited spatial resolution. Enhancing the latter is thus a desirable preprocessing step in order to further improve the detection capabilities offered by hyperspectral images on downstream tasks. At the same time, there is a growing interest towards deploying inference methods directly onboard of satellites, which calls for lightweight image super-resolution methods that can be run on the payload in real time. In this paper, we present a novel neural network design, called Deep Pushbroom Super-Resolution (DPSR) that matches the pushbroom acquisition of hyperspectral sensors by processing an image line by line in the along-track direction with a causal memory mechanism to exploit previously acquired lines. This design greatly limits memory requirements and computational complexity, achieving onboard real-time performance, i.e., the ability to super-resolve a line in the time it takes to acquire the next one, on low-power hardware. Experiments show that the quality of the super-resolved images is competitive or even outperforms state-of-the-art methods that are significantly more complex.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。