提出仿生分步视觉模型,提升暗光交通场景实时目标感知精度
A biologically inspired separable learning vision model for real-time traffic object perception in Dark
- 基于生物视觉机制设计分步学习框架,分阶段处理光照与特征
- 在Dark-traffic数据集上检测、分割、光流任务均超越现有模型
- 适合自动驾驶、低照度视觉系统研发者参考使用
低光照交通场景下的快速准确目标感知日益受到关注。然而,由于光照严重退化和可靠视觉线索缺失,现有感知模型难以在低光环境下快速适应并准确预测。此外,缺乏专门针对低光照交通场景的大规模基准数据集。为此,我们提出一种物理基础的光照退化方法,构建了目前最大且密集标注的低光照交通数据集Dark-traffic,支持目标检测、实例分割和光流估计。进一步提出分步学习视觉模型(SLVM),一种受生物启发的框架,以增强恶劣光照下的感知能力。SLVM集成四个关键组件:光照自适应瞳孔机制用于敏感特征提取,特征级分步学习策略实现高效表征,任务解耦分支支持多任务分步学习,空间错位感知融合模块实现多特征精确对齐。大量实验表明,SLVM在计算开销更低的情况下达到顶尖性能。显著优于RT-DETR 11.2个百分点(检测),优于YOLOv12 6.1个百分点(分割),在Dark-traffic上将基线端点误差(EPE)降低12.37%。在LIS基准上,端到端训练的SLVM在关键指标上平均超越Swin Transformer+EnlightenGAN与ConvNeXt-T+EnlightenGAN达11个百分点,超过带光照增强的Mask RCNN 3.1个百分点。Dark-traffic数据集及完整代码已开源。
原文摘要 · Abstract (English)
Fast and accurate object perception in low-light traffic scenes has attracted increasing attention. However, due to severe illumination degradation and the lack of reliable visual cues, existing perception models and methods struggle to quickly adapt to and accurately predict in low-light environments. Moreover, there is the absence of available large-scale benchmark specifically focused on low-light traffic scenes. To bridge this gap, we introduce a physically grounded illumination degradation method tailored to real-world low-light settings and construct Dark-traffic, the largest densely annotated dataset to date for low-light traffic scenes, supporting object detection, instance segmentation, and optical flow estimation. We further propose the Separable Learning Vision Model (SLVM), a biologically inspired framework designed to enhance perception under adverse lighting. SLVM integrates four key components: a light-adaptive pupillary mechanism for illumination-sensitive feature extraction, a feature-level separable learning strategy for efficient representation, task-specific decoupled branches for multi-task separable learning, and a spatial misalignment-aware fusion module for precise multi-feature alignment. Extensive experiments demonstrate that SLVM achieves state-of-the-art performance with reduced computational overhead. Notably, it outperforms RT-DETR by 11.2 percentage points in detection, YOLOv12 by 6.1 percentage points in instance segmentation, and reduces endpoint error (EPE) of baseline by 12.37% on Dark-traffic. On the LIS benchmark, the end-to-end trained SLVM surpasses Swin Transformer+EnlightenGAN and ConvNeXt-T+EnlightenGAN by an average of 11 percentage points across key metrics, and exceeds Mask RCNN (with light enhancement) by 3.1 percentage points. The Dark-traffic dataset and complete code is released at https://github.com/alanli1997/slvm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。