解决多光谱行人检测中标注稀疏问题,提升伪标签质量和多样性。
Multispectral Pedestrian Detection with Sparsely Annotated Label
- 引入自适应加权与伪标签增强机制,提升缺失标注的伪标签质量。
- 在多个数据集上实现显著性能提升,最高达12.3%的AP增益。
- 适合标注资源有限的多光谱行人检测场景,尤其适用于红外可见光融合。
尽管现有稀疏标注目标检测(SAOD)方法在多光谱领域取得进展,但依然存在两大缺陷:(i) 未充分优化缺失标注的伪标签质量;(ii) 依赖固定真实标注,限制了对多光谱下行人外观的多样化学习。为此,我们提出一种新框架SAMPD。针对问题(i),设计多光谱行人感知自适应权重(MPAW)与正伪标签增强(PPE)模块,利用多光谱信息生成高质量伪标签,并根据模态特性动态加权。针对问题(ii),提出自适应行人检索增强(APRA)模块,从真实标注中动态提取行人图像块,并融合高质量伪标签,扩大训练样本多样性。大量实验表明,SAMPD在稀疏标注的多光谱环境中显著提升检测性能,在FLIR、KAIST等数据集上平均精度(AP)提升最高达12.3%。
原文摘要 · Abstract (English)
Although existing Sparsely Annotated Object Detection (SAOD) approches have made progress in handling sparsely annotated environments in multispectral domain, where only some pedestrians are annotated, they still have the following limitations: (i) they lack considerations for improving the quality of pseudo-labels for missing annotations, and (ii) they rely on fixed ground truth annotations, which leads to learning only a limited range of pedestrian visual appearances in the multispectral domain. To address these issues, we propose a novel framework called Sparsely Annotated Multispectral Pedestrian Detection (SAMPD). For limitation (i), we introduce Multispectral Pedestrian-aware Adaptive Weight (MPAW) and Positive Pseudo-label Enhancement (PPE) module. Utilizing multispectral knowledge, these modules ensure the generation of high-quality pseudo-labels and enable effective learning by increasing weights for high-quality pseudo-labels based on modality characteristics. To address limitation (ii), we propose an Adaptive Pedestrian Retrieval Augmentation (APRA) module, which adaptively incorporates pedestrian patches from ground-truth and dynamically integrates high-quality pseudo-labels with the ground-truth, facilitating a more diverse learning pool of pedestrians. Extensive experimental results demonstrate that our SAMPD significantly enhances performance in sparsely annotated environments within the multispectral domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。