针对遥感图像中小目标分割难题,提出SOPSeg框架提升精度与效率。
SOPSeg: Prompt-based Small Object Instance Segmentation in Remote Sensing Imagery
- 基于自适应放大策略与定制解码器,保留小目标精细细节
- 在遥感小目标分割任务上显著超越现有方法,边界更准确
- 专为遥感定向框设计提示机制,适合灾害监测等应用
从遥感影像中提取小目标在城市规划、环境监测和灾害管理中至关重要。尽管当前研究多集中于小目标检测,小目标实例分割仍缺乏系统探索,且无专用数据集。这主要源于像素级标注的技术挑战与高成本。虽然通用分割模型SAM具备出色的零样本泛化能力,但其在小目标分割上表现下降明显,主因是1/16的粗粒度特征分辨率导致细小空间信息严重丢失。为此,本文提出SOPSeg,一种专为遥感图像小目标分割设计的提示式框架。该框架采用区域自适应放大策略以保持细粒度细节,并引入结合边缘预测与渐进式优化的定制解码器,实现精准边界分割。此外,提出一种面向遥感中广泛使用的定向边界框的新型提示机制。SOPSeg在小目标分割性能上优于现有方法,并支持高效构建遥感数据集。我们进一步基于SODA-A构建了综合性小目标实例分割数据集,将公开发布模型与数据集以推动后续研究。
原文摘要 · Abstract (English)
Extracting small objects from remote sensing imagery plays a vital role in various applications, including urban planning, environmental monitoring, and disaster management. While current research primarily focuses on small object detection, instance segmentation for small objects remains underexplored, with no dedicated datasets available. This gap stems from the technical challenges and high costs of pixel-level annotation for small objects. While the Segment Anything Model (SAM) demonstrates impressive zero-shot generalization, its performance on small-object segmentation deteriorates significantly, largely due to the coarse 1/16 feature resolution that causes severe loss of fine spatial details. To this end, we propose SOPSeg, a prompt-based framework specifically designed for small object segmentation in remote sensing imagery. It incorporates a region-adaptive magnification strategy to preserve fine-grained details, and employs a customized decoder that integrates edge prediction and progressive refinement for accurate boundary delineation. Moreover, we introduce a novel prompting mechanism tailored to the oriented bounding boxes widely adopted in remote sensing applications. SOPSeg outperforms existing methods in small object segmentation and facilitates efficient dataset construction for remote sensing tasks. We further construct a comprehensive small object instance segmentation dataset based on SODA-A, and will release both the model and dataset to support future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。