解决跨域少样本检测中目标域注意力模糊问题,提升定位精度。
Remedying Target-Domain Astigmatism for Cross-Domain Few-Shot Object Detection
- 通过类原型和背景建模,重构注意力分布,模拟人眼中心-周边视觉机制。
- 在六个基准上实现新最优性能,显著改善目标定位准确率。
- 适合研究少样本检测、跨域适应与注意力机制的学者参考。
跨域少样本目标检测(CD-FSOD)旨在将源域预训练检测器适配到标注稀缺的目标域,面临严重领域偏移与数据稀疏性问题。本文首次发现:模型在目标域中注意力分散且不聚焦,导致定位不准与冗余预测,类似人类近视现象,称之为‘目标域散光’问题。分析Transformer各层注意力距离表明,常规微调虽有缓解趋势但效果仍不足。受人眼中央凹视觉系统启发,提出中心-周边注意力精炼框架:(1)正向模式精炼模块利用类别特定原型重塑注意力,模拟视觉中心;(2)负向上下文调制模块建模背景上下文以增强边界判别,模拟视觉周边;(3)文本语义对齐模块通过跨模态线索强化中心-周边区分。该生物启发方法将散光注意力转化为聚焦模式,在六个挑战性CD-FSOD基准上持续取得更高检测精度,确立新最优结果。
原文摘要 · Abstract (English)
Cross-domain few-shot object detection (CD-FSOD) aims to adapt pretrained detectors from a source domain to target domains with limited annotations, suffering from severe domain shifts and data scarcity problems. In this work, we find a previously overlooked phenomenon: models exhibit dispersed and unfocused attention in target domains, leading to imprecise localization and redundant predictions, just like a human cannot focus on visual objects. Therefore, we call it the target-domain Astigmatism problem. Analysis on attention distances across transformer layers reveals that regular fine-tuning inherently shows a trend to remedy this problem, but results are still far from satisfactory, which we aim to enhance in this paper. Biologically inspired by the human fovea-style visual system, we enhance the fine-tuning's inherent trend through a center-periphery attention refinement framework, which contains (1) a Positive Pattern Refinement module to reshape attention toward semantic objects using class-specific prototypes, simulating the visual center region; (2) a Negative Context Modulation module to enhance boundary discrimination by modeling background context, simulating the visual periphery region; and (3) a Textual Semantic Alignment module to strengthen center-periphery distinction through cross-modal cues. Our bio-inspired approach transforms astigmatic attention into focused patterns, substantially improving adaptation to target domains. Experiments on six challenging CD-FSOD benchmarks consistently demonstrate improved detection accuracy and establish new state-of-the-art results.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。