让SAM2在遥感图像中实现高覆盖、无碎片的全图分割。
Remote SAMsing: From Segment Anything to Segment Everything

- 多轮迭代+动态阈值,逐轮提升分割覆盖率,优先保留高质量掩膜
- 覆盖率达91%~98%,较单次运行提升超一倍,检测精度达85%以上
- 无需训练,适配大图、多尺度、异源影像,适合遥感分析与产线部署
SAM2在自然图像上可实现高质量零样本分割,但应用于大尺度遥感图像时存在两大问题:(1) 掩膜生成器存在质量-覆盖权衡——严格阈值保证精度但覆盖不足,宽松阈值虽提升覆盖却降低质量;(2) 大图像需分块处理,导致物体被切碎于块边界。本文提出Remote SAMsing,一个开源无训练管道,解决上述问题。通过多轮迭代算法,在每块上重复运行SAM2,将已接受掩膜置为黑色以简化场景,仅在覆盖率停滞时才放松阈值,确保先捕获最精确掩膜。通过上下文填充与无参最优匹配合并策略,重建跨块物体。在七组遥感场景(5~cm至4.78~m GSD)上,覆盖率从30%~68%提升至91%~98%。消融实验量化各组件贡献。按类别评估显示,建筑物检测率95%,车辆82%~93% [email protected],边界精度为SLIC和Felzenszwalb的3~8倍。块尺寸作为隐式尺度参数,从1,000降至250使[email protected]从56%升至85%,优于SAM2内置多尺度机制。该管道可直接用于MNF伪彩色影像(99.5% ASA),并支持生产级大图:19.4亿像素的Potsdam拼接图实现97%覆盖率且无质量下降。
原文摘要 · Abstract (English)
SAM2 produces high-quality zero-shot segmentation on natural images, but applying it to large remote sensing scenes exposes two problems: (1) its mask generator faces an inherent quality-coverage trade-off: strict thresholds yield precise masks but leave most of the image unsegmented, while relaxed thresholds increase coverage at the cost of mask quality; and (2) large images must be tiled, fragmenting objects across tile boundaries. We propose Remote SAMsing, an open-source pipeline that solves both problems without modifying SAM2 or requiring training data. For coverage, a multi-pass algorithm runs SAM2 repeatedly on each tile, painting accepted masks black between passes to simplify the scene for the next iteration, and relaxing quality thresholds only when coverage gains stagnate, ensuring that the most precise masks are always captured first. For spatial consistency, contextual padding and a parameter-free best-match merge reconstruct objects fragmented across tile boundaries. Evaluated on seven scenes (5~cm to 4.78~m GSD), the pipeline raises coverage from 30--68\% (single-pass SAM2) to 91--98\%. Ablation experiments quantify the contribution of each component to coverage and detection quality. Per-class evaluation shows that SAM2 transfers well to discrete RS objects (buildings 95\%, cars 82--93\% [email protected]) with segment boundaries 3--8$\times$ more precise than SLIC and Felzenszwalb baselines. Tile size functions as an implicit scale parameter: reducing it from $1{,}000$ to 250 raises [email protected] from 56\% to 85\%, outperforming SAM2's built-in multi-scale mechanism. The pipeline generalizes to MNF false-color imagery without retraining (99.5\% ASA) and scales to production-sized images: a 1.94 billion pixel Potsdam mosaic achieved 97\% coverage without quality degradation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。