无需训练即可统一完成遥感图像目标检测与分割,尤其擅长小目标和密集场景。
ZODS-RS -- Zero-training Oriented Detection & Segmentation for Remote Sensing

- 基于DINOv3特征与SAM思路,设计无训练闭式流程处理旋转缩放变化。
- 在FAIR1M上实现13.06的mAP,UAV数据集小目标识别提升30.70点。
- 适合无标注数据、需快速部署的遥感图像分析场景,如无人机巡检。
遥感与无人机应用需要在不进行任务特定训练的前提下跨平台、跨视角泛化。然而,现有免训练方法在方向几何、尺度/旋转变化及密集港口或机场场景中表现不佳,且极少同时支持检测与分割。本文提出ZODS-RS,一种免训练、闭式求解的统一框架,可输出水平框(HBB)与实例掩码。该框架基于DINOv3密集特征与SAM风格提案,包含:原型净化(PP,通过泰勒协方差实现)、旋转-尺度等变匹配(R-SEM,使用可分离核与全局匈牙利分配)、不确定性感知像素级融合(UAM,含自适应先验与可选负原型)。轻量级CWLA融合多层DINOv3特征。在FAIR1M(HBB)上,获得$ ext{mAP}_{0.50:0.95}=13.06$,$ ext{AP}_S=2.93$(船/飞机平均);在xView(HBB)上报告$ ext{mAP}=16.69$。在自建无人机数据集上,掩码mIoU达31.10,小目标AP较Grounded-SAM提升+30.70(单张5090显卡)。本工作提供了一种统一的免训练解决方案,兼具明确闭式公式与DINOv3深度耦合,并在小目标、密集目标及跨域场景中持续提升性能,部署简单。
原文摘要 · Abstract (English)
Remote-sensing and UAV applications need models that generalize across platforms and viewpoints without task-specific training. Yet training-free pipelines often falter on oriented geometry, scale/rotation variation, and crowded ports or airfields, and rarely unify detection and segmentation. We introduce ZODS-RS, a training-free, closed-form pipeline that outputs horizontal boxes (HBB) and instance masks. Built on DINOv3 dense features and SAM-style proposals, ZODS-RS chains: PP (prototype purification via Tyler covariance), R-SEM (rotation-scale equivariant matching with separable kernels and global Hungarian assignment), and UAM (uncertainty-aware pixelwise merging with adaptive priors and optional negative prototypes). A lightweight CWLA fuses multiple DINOv3 layers. On FAIR1M (HBB) we obtain $\mathrm{mAP}_{0.50:0.95}=\mathbf{13.06}$ and $\mathrm{AP}_S=\mathbf{2.93}$ \emph{(class-averaged over ship/airplane)}; on xView (HBB) we report $\mathrm{mAP}=\mathbf{16.69}$. On our UAV dataset, ZODS-RS achieves mask $\mathrm{mIoU}=\mathbf{31.10}$ and improves small-object AP by $\mathbf{+30.70}$ over Grounded-SAM on a single 5090. This work offers a unified, \emph{no-training} solution for horizontal-box detection plus instance segmentation in aerial imagery; provides explicit closed-form formulations for PP/R-SEM/UAM tightly coupled with DINOv3; and demonstrates \emph{consistent} gains on small and crowded targets and under cross-domain shifts while keeping deployment simple.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。