跨数据集迁移标签,解决目标检测中类别和框不一致问题。
Bridging Annotation Gaps: Transferring Labels to Align Object Detection Datasets
- 用伪标签+特权提议生成器对齐不同数据集的标注。
- 在多个基准上提升检测性能,最高达+4.8AP。
- 无需共享标签空间或人工标注,适合多源数据融合。
整合多个目标检测数据集可提升模型泛化能力,但受限于类别语义与边界框标注的不一致性。现有方法或假设共享标签体系、仅处理空间差异,或需人工重标注,或生成统一标签空间,难以适应固定目标标签空间需求。本文提出标签对齐迁移(LAT)框架,系统性地将异构源数据集的标注投影到目标数据集的标签空间。LAT首先训练各数据集专用检测器生成伪标签,再通过特权提议生成器(PPG)融合伪标签与真实标注,替代两阶段检测器中的区域提议网络。为进一步优化区域特征,引入语义特征融合(SFF)模块,利用置信度加权注意力机制注入重叠提议的类别感知上下文与特征。该流程在保留数据集特异性标注粒度的同时,实现跨异构数据集的多对一标签空间迁移,生成语义与空间对齐的表示,适用于下游检测器训练。LAT同时解决类别与边界框不一致问题,无需共享标签空间或人工标注。在多个基准上,LAT均展现稳定性能提升,相比半监督基线最高提升+4.8AP。
原文摘要 · Abstract (English)
Combining multiple object detection datasets offers a path to improved generalisation but is hindered by inconsistencies in class semantics and bounding box annotations. Some methods to address this assume shared label taxonomies and address only spatial inconsistencies; others require manual relabelling, or produce a unified label space, which may be unsuitable when a fixed target label space is required. We propose Label-Aligned Transfer (LAT), a label transfer framework that systematically projects annotations from diverse source datasets into the label space of a target dataset. LAT begins by training dataset-specific detectors to generate pseudo-labels, which are then combined with ground-truth annotations via a Privileged Proposal Generator (PPG) that replaces the region proposal network in two-stage detectors. To further refine region features, a Semantic Feature Fusion (SFF) module injects class-aware context and features from overlapping proposals using a confidence-weighted attention mechanism. This pipeline preserves dataset-specific annotation granularity while enabling many-to-one label space transfer across heterogeneous datasets, resulting in a semantically and spatially aligned representation suitable for training a downstream detector. LAT thus jointly addresses both class-level misalignments and bounding box inconsistencies without relying on shared label spaces or manual annotations. Across multiple benchmarks, LAT demonstrates consistent improvements in target-domain detection performance, achieving gains of up to +4.8AP over semi-supervised baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。