arXiv:2509.24863cs.CV2025-09

模仿视网膜机制,用稀疏对比度表示提升模型光照鲁棒性。

Improved Robustness from Biologically Inspired Sparse Contrast Representations

  • 基于人眼视网膜原理,设计固定预处理模块提取光照不变特征。
  • 在夜间等极端光照下,分割准确率显著提升,且数据稀缺时仍有效。
  • 特征稀疏度达70%仍保持性能稳定,适合低延迟、低带宽场景。

深度神经网络在诸多视觉任务上超越人类,但在光照、天气等分布外变化下仍缺乏鲁棒性。现有方法多依赖额外数据、增强、架构修改或测试时调整。本文提出一种互补思路:受人眼视网膜启发,设计一个固定、模型无关的预处理模块,提取对光照变化更稳定的信号。该方法结合色彩重映射与局部对比度提取,生成强调结构特征的稀疏表示。我们在Cityscapes上训练,于Dark Zurich和ACDC上评估泛化能力。结果表明,该预处理在保持原分布性能的同时,显著提升复杂光照条件下的鲁棒性,尤其在夜间等标注数据稀缺场景。即使对比度表示稀疏至70%,分割精度仍保持稳定。这些成果表明,重新思考输入表示本身可增强鲁棒性,并为可压缩、低延迟成像传感器提供新可能。

原文摘要 · Abstract (English)

Deep neural networks surpass humans on many vision benchmarks, yet remain far less robust to distribution shifts such as illumination and weather changes. Existing approaches address this challenge by additional training data, extensive augmentation, architectural modifications, or test-time adaptation. In this work, we explore a complementary direction: inspired by the human retina, we propose a fixed, model-agnostic preprocessing module that extracts signals that are more stable with respect to variations of illumination. Our method combines color remapping with local contrast extraction, producing sparse representations that emphasize structural features. We study its impact on semantic segmentation by training on Cityscapes and evaluating generalization under adverse conditions on Dark Zurich and ACDC. Our results show that the biologically inspired preprocessing preserves in-distribution performance while consistently improving robustness in challenging lighting scenarios, such as nighttime, where annotated training data are scarce. Moreover, the segmentation accuracy remains stable even when the contrast-based representation is sparsified by up to 70%. These gains suggest that rethinking the input representation itself can improve robustness while also opening opportunities for lower-latency, transmission-aware imaging sensors when sparsity can be exploited close to acquisition.

视觉鲁棒性稀疏表示生物启发

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。