事件相机自动调节偏置,应对明暗变化,提升人脸检测效果。
Autobiasing Event Cameras
- 通过实时监控性能指标,自动调整事件相机像素偏置值。
- 在暗光与频闪条件下,目标检测置信度提升33%以上,人脸检测提升37%。
- 无需额外硬件,适合车载驾驶监控等复杂光照场景。
本文提出一种自主方法,解决事件相机在严重光照条件下机器视觉应用中的挑战。研究利用事件相机内置的像素偏置设置功能,以应对车辆行驶中不可避免的光照变化。以基于神经形态YOLO的人脸跟踪模块作为事件相机应用案例,通过数值指标实时监控系统性能。当性能下降时,系统检测到异常并自动调整偏置值。采用Nelder-Mead单纯形算法优化调整过程,持续微调直至性能恢复。该方法可在不增加硬件或软件的前提下,有效应对闪烁或黑暗等极端条件。实验在低照度和多种闪烁频率下测试,原默认偏置无法检测人脸。经自动动态偏置调整后,各项指标显著改善:目标检测置信度提升超33%,人脸检测提升超37%,验证了方法的有效性。
原文摘要 · Abstract (English)
This paper presents an autonomous method to address challenges arising from severe lighting conditions in machine vision applications that use event cameras. To manage these conditions, the research explores the built in potential of these cameras to adjust pixel functionality, named bias settings. As cars are driven at various times and locations, shifts in lighting conditions are unavoidable. Consequently, this paper utilizes the neuromorphic YOLO-based face tracking module of a driver monitoring system as the event-based application to study. The proposed method uses numerical metrics to continuously monitor the performance of the event-based application in real-time. When the application malfunctions, the system detects this through a drop in the metrics and automatically adjusts the event cameras bias values. The Nelder-Mead simplex algorithm is employed to optimize this adjustment, with finetuning continuing until performance returns to a satisfactory level. The advantage of bias optimization lies in its ability to handle conditions such as flickering or darkness without requiring additional hardware or software. To demonstrate the capabilities of the proposed system, it was tested under conditions where detecting human faces with default bias values was impossible. These severe conditions were simulated using dim ambient light and various flickering frequencies. Following the automatic and dynamic process of bias modification, the metrics for face detection significantly improved under all conditions. Autobiasing resulted in an increase in the YOLO confidence indicators by more than 33 percent for object detection and 37 percent for face detection highlighting the effectiveness of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。