针对遥感视频中小目标分割难题,提出高效高精度交互式分割方法。
ROS-SAM: High-Quality Interactive Segmentation for Remote Sensing Moving Object
- 基于LoRA微调实现高效领域适配,保持模型泛化能力
- 提升深层特征判别力,减少误分类,提升分割质量
- 融合全局上下文与局部边界细节,生成高质量掩码
大规模遥感视频数据的可用性凸显了高质量交互式分割的重要性。然而,小目标尺寸、特征模糊和泛化能力有限等问题使现有方法难以达成目标。本文提出ROS-SAM,旨在实现跨多样化遥感数据的高质量交互式分割。该方法包含三项关键创新:1)基于LoRA的微调,实现高效领域适配同时保留SAM的泛化能力;2)增强深层网络层以提升特征判别性,降低误分类;3)在掩码解码器中融合全局上下文与局部边界细节,生成高质量分割掩码。此外,设计的数据流水线确保模型在训练时学习处理不同尺度物体,推理时聚焦高精度预测。在遥感视频数据集上的实验表明,重构的数据流水线使IoU提升6%,而ROS-SAM使IoU进一步提升13%。在现有遥感目标追踪数据集上评估显示,ROS-SAM具备出色的零样本能力,生成的掩码与人工标注高度接近。结果证实其在遥感精细分割应用中的强大潜力。代码已开源。
原文摘要 · Abstract (English)
The availability of large-scale remote sensing video data underscores the importance of high-quality interactive segmentation. However, challenges such as small object sizes, ambiguous features, and limited generalization make it difficult for current methods to achieve this goal. In this work, we propose ROS-SAM, a method designed to achieve high-quality interactive segmentation while preserving generalization across diverse remote sensing data. The ROS-SAM is built upon three key innovations: 1) LoRA-based fine-tuning, which enables efficient domain adaptation while maintaining SAM's generalization ability, 2) Enhancement of deep network layers to improve the discriminability of extracted features, thereby reducing misclassifications, and 3) Integration of global context with local boundary details in the mask decoder to generate high-quality segmentation masks. Additionally, we design the data pipeline to ensure the model learns to better handle objects at varying scales during training while focusing on high-quality predictions during inference. Experiments on remote sensing video datasets show that the redesigned data pipeline boosts the IoU by 6%, while ROS-SAM increases the IoU by 13%. Finally, when evaluated on existing remote sensing object tracking datasets, ROS-SAM demonstrates impressive zero-shot capabilities, generating masks that closely resemble manual annotations. These results confirm ROS-SAM as a powerful tool for fine-grained segmentation in remote sensing applications. Code is available at https://github.com/ShanZard/ROS-SAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。