用对比学习增强夜视行人检测数据,提升夜间识别准确率。
Contrastive-SDXL: Annotation-Preserving Night-Time Augmentation for Pedestrian Detection

- 基于SDXL-Turbo和LoRA微调,引入局部与全局语义对比损失
- 合成图像FID达22.5,误检率降低6-7%,接近真实夜间数据效果
- 适合需要高精度夜间感知的自动驾驶与安防系统
夜间行人检测因标注数据稀缺且光照差异大而困难。现有基于扩散模型的图像翻译方法在关键感知任务中常忽略目标与语义结构的保留。本文提出Contrastive-SDXL,一种基于SDXL-Turbo并使用低秩适配(LoRA)微调的日转夜增强框架。通过预训练DINOv2编码器引导的块级语义对比损失,结合多层级自注意力图与行人一致性损失,确保输入白天图像与生成夜间图像间语义对应。该方法生成真实感夜间图像,弗雷歇起始距离(FID)为22.5。使用合成数据训练的检测器相比仅用白天数据训练的基线,漏检率降低6%-7%,性能逼近使用真实夜间数据训练的模型。结果表明,以一致性驱动的扩散增强可有效支持安全关键场景下的夜间行人检测。
原文摘要 · Abstract (English)
Night-time pedestrian detection remains challenging because labelled night-time data are limited and large illumination differences make daytime-only trained detectors unreliable. Latent diffusion models (LDMs) provide a powerful basis for image-to-image translation and cross-domain augmentation, but their effectiveness in safety-critical perception depends on whether detector-relevant objects and local semantic structure are preserved when translating between source and target domains. In this work, we present Contrastive-SDXL, a day-to-night augmentation framework for night-time pedestrian detection built on SDXL-Turbo and fine-tuned using Low-Rank Adaptation (LoRA). To preserve semantic correspondence between daytime inputs and translated night-time images, we introduce a patch-wise semantic contrastive loss guided by a pretrained DINOv2 encoder rather than generator encoder features. Multi-level DINOv2 self-attention maps enforce both local and global semantic consistency, while an object consistency loss explicitly encourages pedestrian preservation. Contrastive-SDXL produces realistic night-time images, achieving a Frechet Inception Distance (FID) of 22.5. Detectors trained with our synthetic images obtain a 6-7% reduction in miss rate compared with a daytime-only baseline, approaching the performance of detectors trained on real night-time data. These results demonstrate that consistency-driven diffusion augmentation can effectively support safety-critical night-time pedestrian detection.Specific
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。