用轻量压缩提升遥感数据传输效率,边端实现语义保真
Compressed learning based onboard semantic compression for remote sensing platforms
- 基于压缩学习框架,仅用稀疏矩阵乘法实现快速编码
- 在低压缩比下,噪声环境下分类准确率提升显著
- 适用于卫星、无人机等资源受限的遥感平台
地球观测对构建可持续社会至关重要。卫星、航空平台及近期兴起的小型无人机和无人机均用于地球观测,采集大量数据需下行传输至地面处理分析。高吞吐量采集的主要瓶颈在于下行带宽。需采用以数据为中心的图像压缩方案应对数据洪流。本文研究基于压缩学习框架的语义压缩,仅使用快速且稀疏的矩阵-向量乘法进行数据编码。考虑相机噪声与通信信道作为失真来源。完整的语义通信流程包括:在机上对噪声相机输出进行低复杂度压缩矩阵编码,生成观测向量并经通信信道下行;通过展开网络处理后输入深度学习模型完成下游任务(如图像分类)。失真通过展开多层NA-ALISTA并结合小波稀疏先验进行补偿。解码为即插即用设计,根据相机/环境信息和下游任务定制。下游深度学习模型与压缩矩阵、展开网络通过损失函数联合端到端微调。结果显示,在低压缩比下,加入恢复损失可显著提升噪声环境中的下游性能。
原文摘要 · Abstract (English)
Earth observation (EO) plays a crucial role in creating and sustaining a resilient and prosperous society that has far reaching consequences for all life and the planet itself. Remote sensing platforms like satellites, airborne platforms, and more recently dones and UAVs are used for EO. They collect large amounts of data and this needs to be downlinked to Earth for further processing and analysis. Bottleneck for such high throughput acquisition is the downlink bandwidth. Data-centric solutions to image compression is required to address this deluge. In this work, semantic compression is studied through a compressed learning framework that utilizes only fast and sparse matrix-vector multiplication to encode the data. Camera noise and a communication channel are the considered sources of distortion. The complete semantic communication pipeline then consists of a learned low-complexity compression matrix that acts on the noisy camera output to generate onboard a vector of observations that is downlinked through a communication channel, processed through an unrolled network and then fed to a deep learning model performing the necessary downstream tasks; image classification is studied. Distortions are compensated by unrolling layers of NA-ALISTA with a wavelet sparsity prior. Decoding is thus a plug-n-play approach designed according to the camera/environment information and downstream task. The deep learning model for the downstream task is jointly fine-tuned with the compression matrix and the unrolled network through the loss function in an end-to-end fashion. It is shown that addition of a recovery loss along with the task dependent losses improves the downstream performance in noisy settings at low compression ratios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。