通过局部全局对比学习,无需标注即可提升跨域目标检测性能
Improving Object Detection via Local-global Contrastive Learning
- 利用空间注意力掩码构建局部与全局特征对比,隐式区分物体与背景
- 在三个基准上实现当前最佳跨域检测效果,无需对象标注或微调检测器
- 适合研究无监督域适应和低成本目标检测的学者与工程师
视觉域差距常影响目标检测性能。图像到图像的翻译可缓解此问题,对比学习方法可在无监督条件下学习图像映射。然而,现有方法难以处理含多个实例的复杂场景,导致检测性能不佳。通常需依赖对象标注才能捕捉实例级内容,但标注成本高昂。为此,我们提出一种面向跨域目标检测的新图像到图像翻译方法。该方法基于带有归纳先验的对比学习框架,通过空间注意力掩码优化对象实例的外观,隐式将场景划分为与目标实例相关的前景区域和非对象背景区域。无需依赖对象标注显式建模实例,本方法通过对比局部-全局信息来学习对象表征。这使得我们能够探索一个未被充分研究的问题:在域偏移下,不依赖对象标注或检测器微调,仍可实现高性能检测。我们在三个挑战性基准的多个跨域目标检测设置中进行实验,报告了当前最优性能。
原文摘要 · Abstract (English)
Visual domain gaps often impact object detection performance. Image-to-image translation can mitigate this effect, where contrastive approaches enable learning of the image-to-image mapping under unsupervised regimes. However, existing methods often fail to handle content-rich scenes with multiple object instances, which manifests in unsatisfactory detection performance. Sensitivity to such instance-level content is typically only gained through object annotations, which can be expensive to obtain. Towards addressing this issue, we present a novel image-to-image translation method that specifically targets cross-domain object detection. We formulate our approach as a contrastive learning framework with an inductive prior that optimises the appearance of object instances through spatial attention masks, implicitly delineating the scene into foreground regions associated with the target object instances and background non-object regions. Instead of relying on object annotations to explicitly account for object instances during translation, our approach learns to represent objects by contrasting local-global information. This affords investigation of an under-explored challenge: obtaining performant detection, under domain shifts, without relying on object annotations nor detector model fine-tuning. We experiment with multiple cross-domain object detection settings across three challenging benchmarks and report state-of-the-art performance. Project page: https://local-global-detection.github.io
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。