无需训练,用冻结特征直接估计类别分布,实现遥感图像少样本分割
FROST: Training-Free Few-Shot Segmentation with Frozen Features and Nonparametric Statistics

- 将参考样本视为单位球面上的点云,用非参数密度比判断查询像素归属
- 单样本支持下达5.6 mIoU领先,支持集越大优势越明显
- 适合遥感领域中小而异质的目标,模型轻量且无需调参
少样本分割要求模型仅凭少量标注样例即可分割查询图像中的目标类别,该任务在遥感领域尤为严峻,因标签稀缺且遥感影像与预训练自然图像差异显著。现有方法或需在标注任务上训练,导致泛化受限;或将类别简化为丢失结构的特征摘要(如单原型、聚类原型或离散聚类),无法保留多模态类别的内部结构。本文提出FROST,一种无需训练的少样本分割方法,认为类别应由分布描述而非单一节点,且冻结的自监督特征已蕴含足够结构以直接估计分布。FROST将参考前景与背景视为冻结DINOv3特征空间单位球面上的点云,通过非参数密度比对查询令牌进行分类,阈值由贝叶斯规则在先验相等时确定为零。随着参考样本增多,密度估计方差减小,决策逐渐清晰,核带宽、空间门控等所有参数均来自支持集,无需人工调整。该方法特别适用于遥感图像中分散的小型异质实例,能有效捕捉密度变化。在十七个遥感基准测试中,FROST超越所有训练自由与学习型方法,单样本支持下领先5.6 mIoU,且随支持集增大优势持续扩大,同时保持极小模型体积。代码已开源。
原文摘要 · Abstract (English)
Few-shot segmentation asks a model to delineate a target class in a query image from only a handful of annotated examples, a setting most acute in remote sensing, where labels are scarce and the imagery departs sharply from the natural images on which vision backbones are pretrained. Prevailing approaches either train a segmenter on labelled episodes, which raises accuracy within the training distribution but binds the model to it, or reduce each class to a lossy summary of frozen features, a single prototype, a few cluster prototypes, or a discrete clustering, none of which preserves the internal structure of a multimodal class. We argue that a class is better described by a distribution than by a point, and that frozen self-supervised features already carry enough structure to estimate that distribution directly. We introduce FROST, a training-free few-shot segmenter that treats the reference foreground and background as two point clouds on the unit sphere of frozen DINOv3 features and labels each query token by a nonparametric density ratio, with a threshold the Bayes rule fixes at zero under equal priors. Because the variance of a density estimate shrinks as its sample grows, the decision sharpens as references accumulate, and every remaining quantity from the kernel bandwidth to the spatial gate is read from the support set rather than tuned. We develop FROST for overhead imagery, where a class is typically a scatter of many small and dissimilar instances that a density tracks but a lossy summary blurs. Across seventeen remote-sensing benchmarks FROST surpasses both training-free and learning-based methods, leading by 5.6 mIoU from a single annotated example and widening its lead as the support set grows, all while remaining among the smallest models compared. Code is available at https://github.com/jhpark-ai/FROST.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。