将少量样本知识蒸馏进模型,实现快速轻量分割推理。
DistillFSS: Synthesizing Few-Shot Knowledge into a Lightweight Segmentation Model
- 用教师-学生蒸馏将支持集知识嵌入模型参数
- 测试时无需支持图像,多类多样本下性能超越基线
- 适合医疗、工业、遥感等跨域新类别快速部署
跨域少样本语义分割(CD-FSS)旨在仅用少量标注样本对未见领域中的未知类别进行分割。该任务极具挑战:源域与目标域分布差异大,标签空间不重叠,支持图像稀少,导致传统基于轮次的方法在测试时不可靠且计算开销大。为此,我们提出DistillFSS框架,通过教师-学生蒸馏将支持集知识直接嵌入模型参数。通过在学生网络中引入专用层内化少样本推理能力,该方法在测试时无需支持图像,实现快速轻量推理,并可通过教师驱动的快速专化扩展至未见领域的新型别。结合微调,该方法可高效处理大规模支持集,显著降低计算负担。为评估真实场景下的表现,我们构建了一个涵盖医学影像、工业检测和遥感的新CD-FSS基准,具有不重叠标签空间和可变支持集大小。实验表明,DistillFSS在多类多样本场景下达到或超过当前最优水平,同时带来显著效率提升。代码已公开于https://github.com/pasqualedem/DistillFSS。
原文摘要 · Abstract (English)
Cross-Domain Few-Shot Semantic Segmentation (CD-FSS) seeks to segment unknown classes in unseen domains using only a few annotated examples. This setting is inherently challenging: source and target domains exhibit substantial distribution shifts, label spaces are disjoint, and support images are scarce--making standard episodic methods unreliable and computationally demanding at test time. To address these constraints, we propose DistillFSS, a framework that embeds support-set knowledge directly into a model's parameters through a teacher--student distillation process. By internalizing few-shot reasoning into a dedicated layer within the student network, DistillFSS eliminates the need for support images at test time, enabling fast, lightweight inference, while allowing efficient extension to novel classes in unseen domains through rapid teacher-driven specialization. Combined with fine-tuning, the approach scales efficiently to large support sets and significantly reduces computational overhead. To evaluate the framework under realistic conditions, we introduce a new CD-FSS benchmark spanning medical imaging, industrial inspection, and remote sensing, with disjoint label spaces and variable support sizes. Experiments show that DistillFSS matches or surpasses state-of-the-art baselines, particularly in multi-class and multi-shot scenarios, while offering substantial efficiency gains. The code is available at https://github.com/pasqualedem/DistillFSS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。