arXiv:2412.07102q-bio.NCcs.CV2024-12

V1神经元通过预测光源颜色实现色恒常,而非抵消光照影响。

Primary visual cortex contributes to color constancy by predicting rather than discounting the illuminant: evidence from a computational study

  • 基于电生理数据构建V1神经模型,从自然图像中学习光源颜色。
  • 双对立神经元比简单神经元更擅长预测光照,响应特性与真实数据吻合。
  • 挑战传统观点,为视觉机制和计算机视觉模型提供新思路。

色恒常性(CC)是人类视觉系统在光照变化时仍能稳定感知物体颜色的重要能力。尽管神经科学证据表明视觉系统的多个层次参与实现色恒常性,但初级视皮层(V1)的作用尚不明确。特别是,V1中的双对立(DO)神经元被认为有助于实现一定程度的色恒常性,但其计算机制仍未阐明。本研究构建了一个基于电生理数据的V1神经模型,利用带有真实光源标签的自然图像数据集进行训练。通过对模型神经元响应特性的定性和定量分析,发现其感受野的空间结构和颜色权重与真实记录的简单和双对立神经元高度相似。计算结果显示,双对立细胞在光源预测任务中表现优于简单细胞。因此,该工作为V1双对立神经元通过编码光源来实现色恒常性提供了计算证据,这与普遍认为的‘通过抵消光照实现色恒常’的假设相矛盾。该发现有望揭示色恒常性的视觉机制,并为开发更有效的计算机视觉模型提供启示。

原文摘要 · Abstract (English)

Color constancy (CC) is an important ability of the human visual system to stably perceive the colors of objects despite considerable changes in the color of the light illuminating them. While increasing evidence from the field of neuroscience supports that multiple levels of the visual system contribute to the realization of CC, how the primary visual cortex (V1) plays role in CC is not fully resolved. In specific, double-opponent (DO) neurons in V1 have been thought to contribute to realizing a degree of CC, but the computational mechanism is not clear. We build an electrophysiologically based V1 neural model to learn the color of the light source from a natural image dataset with the ground truth illuminants as the labels. Based on the qualitative and quantitative analysis of the responsive properties of the learned model neurons, we found that both the spatial structures and color weights of the receptive fields of the learned model neurons are quite similar to those of the simple and DO neurons recorded in V1. Computationally, DO cells perform more robustly than the simple cells in V1 for illuminant prediction. Therefore, this work provides computational evidence supporting that V1 DO neurons serve to realize color constancy by encoding the illuminant,which is contradictory to the common hypothesis that V1 contributes to CC by discounting the illuminant using its DO cells. This evidence is expected to not only help resolve the visual mechanisms of CC, but also provide inspiration to develop more effective computer vision models.

色恒常视觉神经计算建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。