为卫星部署设计高效SAR船舶检测模型,1分钟内处理700万像素图像。
Efficient SAR Vessel Detection for FPGA-Based On-Satellite Sensing
- 改造YOLOv8架构,适配FPGA低功耗环境
- 700万像素图像处理<1分钟,功耗<10W
- 性能仅比顶尖GPU模型低2%-3%,效率高2500倍
卫星影像的分钟级至小时级快速分析对遥感应用日益重要,是下一代自主分布式卫星系统的关键。星上机器学习可克服卫星与地面站间断连接带来的延迟,但现有模型往往过大或功耗过高,难以在轨部署。基于合成孔径雷达(SAR)的船舶检测是海事安全中关键的时间敏感任务,此前模型或过于庞大,或未针对低功耗硬件开发,或仅在小规模数据集上测试,无法反映真实挑战。本文系统探索架构优化,提出一种专为该任务和FPGA处理设计的新YOLOv8模型。部署于Kria KV260 MPSoC平台后,可在<10W功耗下处理约700兆像素的SAR图像,用时不足1分钟。该模型在最大最多样化的公开SAR船舶数据集xView3-SAR上的检测与分类性能仅比最先进的GPU模型低约2%和3%,但计算效率高出约50倍和2500倍。本工作推动了面向时间敏感的SAR分析的星上机器学习发展,助力更自主、可扩展的卫星系统。
原文摘要 · Abstract (English)
Rapid analysis of satellite imagery within minutes-to-hours of acquisition is increasingly vital for many remote sensing applications, and is an essential component for developing next-generation autonomous and distributed satellite systems. On-satellite machine learning (ML) has the potential for such rapid analysis, by overcoming latency associated with intermittent satellite connectivity to ground stations or relay satellites, but state-of-the-art models are often too large or power-hungry for on-board deployment. Vessel detection using Synthetic Aperture Radar (SAR) is a critical time-sensitive application in maritime security that exemplifies this challenge. SAR vessel detection has previously been demonstrated only by ML models that either are too large for satellite deployment, have not been developed for sufficiently low-power hardware, or have only been tested on small SAR datasets that do not sufficiently represent the difficulty of the real-world task. Here we systematically explore a suite of architectural adaptations to develop a novel YOLOv8 architecture optimized for this task and FPGA-based processing. We deploy our model on a Kria KV260 MPSoC, and show it can analyze a ~700 megapixel SAR image in less than a minute, within common satellite power constraints (<10W). Our model has detection and classification performance only ~2% and 3% lower than values from state-of-the-art GPU-based models on the largest and most diverse open SAR vessel dataset, xView3-SAR, despite being ~50 and ~2500 times more computationally efficient. This work represents a key contribution towards on-satellite ML for time-critical SAR analysis, and more autonomous, scalable satellites.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。