arXiv:2411.03403cs.CV2024-11被引 10

直接在卫星上用原始数据检测船只,降低延迟与能耗。

Enhancing Maritime Situational Awareness through End-to-End Onboard Raw Data Analysis

  • 跳过校正步骤,直接用深度学习分析原始卫星图像。
  • 构建了两个新数据集,含真实卫星与船舶定位信息。
  • 验证了多光谱组合对海上监测最有效,适合小卫星部署。

基于卫星的在轨数据处理对需要快速响应的时敏应用至关重要。边缘人工智能的发展正将计算能力从地面中心转移到轨道平台,重塑‘感知-通信-决策-反馈’循环,显著降低从数据获取到交付的延迟。本研究针对小型卫星在带宽、功耗和延迟方面的严苛约束,聚焦海上监测,提出三项主要创新:首先,探索深度学习技术直接从原始卫星影像中进行船只检测与分类,简化在轨处理流程,避免需大量计算的校正与正射校准步骤;其次,为应对原始卫星数据稀缺问题,构建两个新数据集——分别来自哨兵-2(Sentinel-2)和环境监测新微卫星(VENuS)任务的原始数据,并融合自动识别系统(AIS)记录;第三,通过统计与特征分析,验证单波段及多波段组合在两类数据集上的最优配置。最终,基于类立方星硬件的原型验证证明了该方法的可行性,确认其在实际卫星海上监控中的潜力。

原文摘要 · Abstract (English)

Satellite-based onboard data processing is crucial for time-sensitive applications requiring timely and efficient rapid response. Advances in edge artificial intelligence are shifting computational power from ground-based centers to on-orbit platforms, transforming the "sensing-communication-decision-feedback" cycle and reducing latency from acquisition to delivery. The current research presents a framework addressing the strict bandwidth, energy, and latency constraints of small satellites, focusing on maritime monitoring. The study contributes three main innovations. Firstly, it investigates the application of deep learning techniques for direct ship detection and classification from raw satellite imagery. By simplifying the onboard processing chain, our approach facilitates direct analyses without requiring computationally intensive steps such as calibration and ortho-rectification. Secondly, to address the scarcity of raw satellite data, we introduce two novel datasets, VDS2Raw and VDV2Raw, which are derived from raw data from Sentinel-2 and Vegetation and Environment Monitoring New Micro Satellite (VENuS) missions, respectively, and enriched with Automatic Identification System (AIS) records. Thirdly, we characterize the tasks' optimal single and multiple spectral band combinations through statistical and feature-based analyses validated on both datasets. In sum, we demonstrate the feasibility of the proposed method through a proof-of-concept on CubeSat-like hardware, confirming the models' potential for operational satellite-based maritime monitoring.

卫星计算海上监测边缘AI原始数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。