arXiv:2504.11472cs.CVeess.IV2025-04ECCV被引 5

用模传感器实现高动态范围成像,提升自动驾驶在极端光照下的检测精度。

High Dynamic Range Modulo Imaging for Robust Object Detection in Autonomous Driving

  • 采用模传感器捕捉溢出光强,通过解包算法恢复高动态范围图像。
  • 在YOLOv10上检测准确率接近传统HDR,远超饱和图像。
  • 成像速度比传统HDR快,适合实时自动驾驶系统。

物体检测精度对保障自动驾驶系统的安全与效率至关重要。图像质量直接影响系统对车辆、行人及障碍物的实时识别与响应能力。然而,真实环境光照差异极大,导致像素饱和,丢失关键检测信息。传统高动态范围(HDR)图像虽能捕获宽广光强范围,但需多次拍摄,难以满足自动驾驶实时性要求。本文提出使用模传感器:当像素达到饱和时自动重置,记录辐照度编码图像,并通过解包算法恢复。该方法可有效重建颜色强度与图像细节,在极端光照下仍保持良好视觉质量。实验表明,结合模成像与HDR重建的方案,在YOLOv10模型上性能接近传统HDR图像,显著优于饱和图像;且整体处理时间短于传统HDR采集流程,具备实际应用潜力。

原文摘要 · Abstract (English)

Object detection precision is crucial for ensuring the safety and efficacy of autonomous driving systems. The quality of acquired images directly influences the ability of autonomous driving systems to correctly recognize and respond to other vehicles, pedestrians, and obstacles in real-time. However, real environments present extreme variations in lighting, causing saturation problems and resulting in the loss of crucial details for detection. Traditionally, High Dynamic Range (HDR) images have been preferred for their ability to capture a broad spectrum of light intensities, but the need for multiple captures to construct HDR images is inefficient for real-time applications in autonomous vehicles. To address these issues, this work introduces the use of modulo sensors for robust object detection. The modulo sensor allows pixels to `reset/wrap' upon reaching saturation level by acquiring an irradiance encoding image which can then be recovered using unwrapping algorithms. The applied reconstruction techniques enable HDR recovery of color intensity and image details, ensuring better visual quality even under extreme lighting conditions at the cost of extra time. Experiments with the YOLOv10 model demonstrate that images processed using modulo images achieve performance comparable to HDR images and significantly surpass saturated images in terms of object detection accuracy. Moreover, the proposed modulo imaging step combined with HDR image reconstruction is shorter than the time required for conventional HDR image acquisition.

自动驾驶高动态范围模传感器目标检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。