arXiv:2608.14142cs.CV2026-08

PISA通过生成伪个体源域特征,提升测试时开放词汇检测的准确性。

PISA: A Pseudo-Individual Source-Domain Feature Adaptation Framework for Test-Time Open-Vocabulary Object Detection

论文配图:PISA: A Pseudo-Individual Source-Domain Feature Adaptation Framework for Test-Time Open-Vocabulary Object Detection
图 1 · 摘自论文原文
  • 利用图像畸变不变特征提取器捕捉检测所需的密集特征。
  • 在COCO-C上实现3.92%的AP@50%提升,超越现有方法。
  • 无需源域数据,适合部署在开放词汇检测系统中。

开放词汇目标检测测试时自适应(OVOD-TTA)旨在缓解预训练模型在遭遇图像域偏移时性能下降的问题。现有无源域方法依赖于测试时信息重评分或伪标签自训练,当初始预测不佳时导致显著精度下降。传统源域估计方法恢复抽象稀疏表示,不适用于检测任务。为此,本文提出PISA,一种可无缝集成至开放词汇视觉骨干网络的新型无源域方法。核心包括畸变不变特征提取器(CIFE)、特征对齐模块(FAM)和多尺度对齐框架(BAA)。CIFE利用CLIP视觉特征在畸变图像间的不变性,确保对各类畸变的鲁棒性。FAM与BAA在预训练与适配阶段将畸变不变特征转化为接近原始源域特征的伪个体源域特征。由此,使用可靠且密集的伪个体源域特征进行监督,而非不可靠的伪标签信号。在三个基线模型上,PISA在被扰动的VOC-C、COCO-C和LVIS-C基准上均显著提升定位精度与类别识别准确率。尤其在COCO-C上,其在AP@50%上达到领先水平,较现有方法提升3.92%。

原文摘要 · Abstract (English)

Open-vocabulary object detection test-time adaptation (OVOD-TTA) aims to address the performance degradation that pre-trained base models suffer when encountering image-domain shifts. Existing source-free OVOD-TTA methods rely either on refined test-time information for re-scoring or on pseudo-labels for self-training, leading to significant accuracy degradation when initial predictions are poor. Meanwhile, most conventional source-domain estimation methods recover abstract, sparse representations suitable for the classification task, but fail to capture the dense, concrete features required for detection. To address these issues, we propose PISA, a novel source-free OVOD-TTA method that can be seamlessly integrated into open-vocabulary visual backbones. The core components of our method are the Corruption-Invariant Feature Extractor (CIFE), the Feature Alignment Module (FAM), and a multi-scale alignment framework (BAA). To capture detection-suitable features, we develop CIFE to exploit the invariance of CLIP's visual features across corrupted images, ensuring robustness against various corruptions. We further develop FAM and BAA for the pre-training and adaptation to transform the corruption-invariant features into pseudo-individual source-domain features that are close to the original source-domain features. In this way, dense and concrete pseudo-individual source-domain features are used for supervision instead of unreliable pseudo-label signals. Experiments on the corrupted VOC-C, COCO-C, and LVIS-C benchmarks across three base models demonstrate that PISA substantially improves both the localization precision and the category recognition accuracy of the original models. Notably, PISA achieves state-of-the-art performance without requiring access to source-domain data, surpassing existing methods by 3.92% in AP@50% on COCO-C.

目标检测测试时适应开放词汇无源域

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。