arXiv:2601.02020cs.CV2026-01被引 1

用事件相机提升深度模型在恶劣光照下的鲁棒性

Adapting Depth Anything to Adverse Imaging Conditions with Events

  • 通过信息熵自适应融合帧与事件特征
  • 利用运动线索修正模糊区域的深度估计
  • 让深度基础模型在极端光照下依然准确

在动态和恶劣光照条件下实现鲁棒深度估计对机器人系统至关重要。当前深度基础模型如 Depth Anything 在理想场景中表现优异,但在极端照明和运动模糊等退化条件下仍面临挑战。这些退化会破坏帧相机的视觉信号,削弱基于帧的深度在空间和时间维度上的区分能力。现有方法通常结合事件相机以利用其高动态范围和高时间分辨率,试图补偿受损的帧特征,但这类专用融合模型多从头训练于特定数据集,难以继承基础模型所具备的开放世界知识和强泛化能力。本文提出 ADAE,一种面向退化场景的事件引导时空融合框架,用于增强 Depth Anything。设计基于两点关键洞察:1)熵感知空间融合:通过信息熵策略自适应融合帧与事件特征,以指示光照引起的退化;2)运动引导时间校正:利用事件相机的运动线索重新校准模糊区域中的模糊特征。在统一框架下,两项组件互补协同,在恶劣成像条件下显著提升 Depth Anything 的性能。大量实验验证了所提方法的优势,代码将在接受后公开。

原文摘要 · Abstract (English)

Robust depth estimation under dynamic and adverse lighting conditions is essential for robotic systems. Currently, depth foundation models, such as Depth Anything, achieve great success in ideal scenes but remain challenging under adverse imaging conditions such as extreme illumination and motion blur. These degradations corrupt the visual signals of frame cameras, weakening the discriminative features of frame-based depths across the spatial and temporal dimensions. Typically, existing approaches incorporate event cameras to leverage their high dynamic range and temporal resolution, aiming to compensate for corrupted frame features. However, such specialized fusion models are predominantly trained from scratch on domain-specific datasets, thereby failing to inherit the open-world knowledge and robust generalization inherent to foundation models. In this work, we propose ADAE, an event-guided spatiotemporal fusion framework for Depth Anything in degraded scenes. Our design is guided by two key insights: 1) Entropy-Aware Spatial Fusion. We adaptively merge frame-based and event-based features using an information entropy strategy to indicate illumination-induced degradation. 2) Motion-Guided Temporal Correction. We resort to the event-based motion cue to recalibrate ambiguous features in blurred regions. Under our unified framework, the two components are complementary to each other and jointly enhance Depth Anything under adverse imaging conditions. Extensive experiments have been performed to verify the superiority of the proposed method. Our code will be released upon acceptance.

深度估计事件相机鲁棒性融合模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。