用语言桥接域差异,零训练实现单样本目标检测泛化
LAB-Det: Language as a Domain-Invariant Bridge for Training-Free One-Shot Domain Generalization in Object Detection
- 通过语言描述投影替代视觉特征调整,实现无参数更新的域泛化
- 在水下和工业缺陷数据集上提升5.4点mAP,超越微调基线
- 适合数据稀缺场景,无需训练即可快速适配新领域
基础目标检测器如GLIP和Grounding DINO在通用数据上表现优异,但在水下影像或工业缺陷等专业且数据稀缺场景中性能下降。传统跨域少样本方法依赖目标域少量数据微调,带来成本与过拟合风险。本文提出无需训练的一次性域泛化检测任务:仅用每类一个标注样本,不更新任何参数即可适应新领域。为此,我们提出LAB-Det,利用语言作为域不变桥梁——将每个样本投影为描述性文本,以语言条件引导冻结的检测器。该语言条件取代梯度更新,实现数据稀缺场景下的鲁棒泛化。在UODD(水下)和NEU-DET(工业缺陷)两个典型基准上评估,当物体边界模糊时,相比最优微调基线,其mAP提升最高达5.4点,且未更新任何参数。结果确立了语言自适应在专业检测任务中高效、可解释的替代路径。
原文摘要 · Abstract (English)
Foundation object detectors such as GLIP and Grounding DINO excel on general-domain data but often degrade in specialized and data-scarce settings like underwater imagery or industrial defects. Typical cross-domain few-shot approaches rely on fine-tuning scarce target data, incurring cost and overfitting risks. We instead ask: Can a frozen detector adapt with only one exemplar per class without training? To answer this, we introduce training-free one-shot domain generalization for object detection, where detectors must adapt to specialized domains with only one annotated exemplar per class and no weight updates. To tackle this task, we propose LAB-Det, which exploits Language As a domain-invariant Bridge. Instead of adapting visual features, we project each exemplar into a descriptive text that conditions and guides a frozen detector. This linguistic conditioning replaces gradient-based adaptation, enabling robust generalization in data-scarce domains. We evaluate on UODD (underwater) and NEU-DET (industrial defects), two widely adopted benchmarks for data-scarce detection, where object boundaries are often ambiguous, and LAB-Det achieves up to 5.4 mAP improvement over state-of-the-art fine-tuned baselines without updating a single parameter. These results establish linguistic adaptation as an efficient and interpretable alternative to fine-tuning in specialized detection settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。