通过并行解码器与渐进微调,提升跨域少样本目标检测的泛化能力。
A Closer Look at Cross-Domain Few-Shot Object Detection: Fine-Tuning Matters and Parallel Decoder Helps
- 设计共享层级+并行分支解码器,利用去噪查询增强预测多样性。
- 在10抽样设置下,RF100-VL数据集上达41.9平均精度,超越SAM3的35.7。
- 无需复杂数据增强,适合追求稳定少样本适配的工业应用。
少样本目标检测因训练样本稀缺导致优化不稳定和泛化能力差而面临挑战。为此,我们提出一种混合集成解码器,在微调过程中增强泛化能力。受集成学习启发,该解码器包含一个共享分层结构及多个并行解码分支,每个分支使用从共享层继承或新初始化的去噪查询,以促进预测多样性。该设计充分利用预训练权重,不增加额外参数,且多样预测可有效集成以提升泛化性能。此外,我们引入统一的渐进式微调框架与平台感知的学习率调度策略,稳定优化过程,实现强少样本适应,无需复杂的数据增强或繁复超参数调优。在CD-FSOD、ODinW-13和RF100-VL上的大量实验验证了方法的有效性。特别地,在包含100个跨领域数据集的RF100-VL上,10抽样设置下平均性能达41.9,显著优于近期方法SAM3的35.7。我们还从CD-FSOD构建混合领域测试集,评估对分布外样本的鲁棒性,结果表明所提模块带来明显提升。这些结果凸显了方法的有效性、泛化性和鲁棒性。代码已公开于:https://github.com/Intellindust-AI-Lab/FT-FSOD。
原文摘要 · Abstract (English)
Few-shot object detection (FSOD) is challenging due to unstable optimization and limited generalization arising from the scarcity of training samples. To address these issues, we propose a hybrid ensemble decoder that enhances generalization during fine-tuning. Inspired by ensemble learning, the decoder comprises a shared hierarchical layer followed by multiple parallel decoder branches, where each branch employs denoising queries either inherited from the shared layer or newly initialized to encourage prediction diversity. This design fully exploits pretrained weights without introducing additional parameters, and the resulting diverse predictions can be effectively ensembled to improve generalization. We further leverage a unified progressive fine-tuning framework with a plateau-aware learning rate schedule, which stabilizes optimization and achieves strong few-shot adaptation without complex data augmentations or extensive hyperparameter tuning. Extensive experiments on CD-FSOD, ODinW-13, and RF100-VL validate the effectiveness of our approach. Notably, on RF100-VL, which includes 100 datasets across diverse domains, our method achieves an average performance of 41.9 in the 10-shot setting, significantly outperforming the recent approach SAM3, which obtains 35.7. We further construct a mixed-domain test set from CD-FSOD to evaluate robustness to out-of-distribution (OOD) samples, showing that our proposed modules lead to clear improvement gains. These results highlight the effectiveness, generalization, and robustness of the proposed method. Code is available at: https://github.com/Intellindust-AI-Lab/FT-FSOD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。