LEMMA用拉普拉斯金字塔提升海面语义分割精度,大幅降低计算开销。
LEMMA: Laplacian pyramids for Efficient Marine SeMAntic Segmentation
- 用拉普拉斯金字塔早期融合边缘信息,减少深层网络计算
- 参数量和计算量最多降71倍,推理速度最快快84.65%
- 适合资源受限的海上无人机与灾害监测实时应用
海洋环境中的语义分割对无人水面艇自主导航及海岸地球观测(如溢油事件)至关重要。现有方法多依赖深度卷积神经网络和基于Transformer的架构,但计算成本高、资源消耗大,难以在真实海洋场景中实现实时低耗应用。为此,我们提出LEMMA,一种专为资源受限条件设计的轻量级语义分割模型。该模型利用拉普拉斯金字塔增强边缘识别能力,关键在于早期融合边缘信息,避免深层网络中昂贵的特征图计算,显著降低模型规模、复杂度和推理时间。LEMMA在多种平台采集的数据集上均达领先性能,相比现有模型,可减少最多71倍的可训练参数、88.5%的GFLOPs,以及84.65%的推理时间。实验显示其在油污数据集上达到93.42% IoU,在Mastr1325数据集上实现98.97% mIoU,验证了其有效性与实际应用潜力。
原文摘要 · Abstract (English)
Semantic segmentation in marine environments is crucial for the autonomous navigation of unmanned surface vessels (USVs) and coastal Earth Observation events such as oil spills. However, existing methods, often relying on deep CNNs and transformer-based architectures, face challenges in deployment due to their high computational costs and resource-intensive nature. These limitations hinder the practicality of real-time, low-cost applications in real-world marine settings. To address this, we propose LEMMA, a lightweight semantic segmentation model designed specifically for accurate remote sensing segmentation under resource constraints. The proposed architecture leverages Laplacian Pyramids to enhance edge recognition, a critical component for effective feature extraction in complex marine environments for disaster response, environmental surveillance, and coastal monitoring. By integrating edge information early in the feature extraction process, LEMMA eliminates the need for computationally expensive feature map computations in deeper network layers, drastically reducing model size, complexity and inference time. LEMMA demonstrates state-of-the-art performance across datasets captured from diverse platforms while reducing trainable parameters and computational requirements by up to 71x, GFLOPs by up to 88.5\%, and inference time by up to 84.65\%, as compared to existing models. Experimental results highlight its effectiveness and real-world applicability, including 93.42\% IoU on the Oil Spill dataset and 98.97\% mIoU on Mastr1325.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。