arXiv:2512.10521cs.CV2025-12被引 2

用轻量级方法让编码器快速适应新类别,提升少样本分割效果。

Take a Peek: Efficient Encoder Adaptation for Few-Shot Semantic Segmentation via LoRA

论文配图:Take a Peek: Efficient Encoder Adaptation for Few-Shot Semantic Segmentation via LoRA
图 1 · 摘自论文原文
  • 通过低秩适配在支持集上微调编码器,实现特征空间迁移。
  • 在多个数据集上显著提升分割精度,尤其在多类别场景中表现突出。
  • 计算开销极小,可无缝集成到现有少样本分割框架中。

少样本语义分割(FSS)旨在仅用少量标注的支持图像对查询图像中的新类别进行分割。以往研究主要聚焦于解码器优化,而编码器在提取未见类别特征方面的能力有限,仍是关键瓶颈。本文提出「看一眼」(Take a Peek, TaP),一种简单有效的编码器适配方法,通过在支持集条件下的轻量级特征空间偏移,提升编码器在FSS及跨域FSS中的适应能力。该方法采用低秩适配(LoRA)对编码器进行微调,计算开销极小,能快速适应新类别并缓解灾难性遗忘。所提方法模型无关,可无缝融入现有FSS流程。在多个基准测试上(包括COCO $20^i$、Pascal $5^i$,以及DeepGlobe、ISIC、Chest X-ray等跨域数据集)的实验表明,TaP在不同模型与样本设置下均能持续提升性能。尤其在复杂多类别场景中表现显著,凸显其在真实场景中的实用性。秩敏感性分析显示,即使低秩配置也能取得优异效果,保障高效性。通过解决编码器对新类别的泛化难题,TaP为构建更鲁棒、高效、通用的分割系统开辟了新路径。代码已公开于https://github.com/pasqualedem/TakeAPeek。

原文摘要 · Abstract (English)

Few-shot semantic segmentation (FSS) aims to segment novel classes in query images using only a small annotated support set. While prior research has mainly focused on improving decoders, the encoder's limited ability to extract meaningful features for unseen classes remains a key bottleneck. In this work, we introduce \textit{Take a Peek} (TaP), a simple yet effective method that enhances encoder adaptability for both FSS and cross-domain FSS \rev{by inducing a lightweight \textit{feature-space shift} conditioned on the support set}. TaP leverages Low-Rank Adaptation to fine-tune the encoder on the support set with minimal computational overhead, enabling fast adaptation to novel classes while mitigating catastrophic forgetting. Our method is model-agnostic and can be seamlessly integrated into existing FSS pipelines. Extensive experiments across multiple benchmarks--including COCO $20^i$, Pascal $5^i$, and cross-domain datasets such as DeepGlobe, ISIC, and Chest X-ray--demonstrate that TaP consistently improves segmentation performance across diverse models and shot settings. Notably, TaP delivers significant gains in complex multi-class scenarios, highlighting its practical effectiveness in realistic settings. A rank sensitivity analysis also shows that strong performance can be achieved even with low-rank adaptations, thereby ensuring computational efficiency. By addressing a critical limitation in FSS--the encoder's generalization to novel classes--TaP paves the way toward more robust, efficient, and generalizable segmentation systems. The code is available at https://github.com/pasqualedem/TakeAPeek.

少样本分割编码器适配LoRA特征迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。