arXiv:2505.18361q-bio.NCcs.AI2025-05NeurIPS被引 1

用仿鼠须阵列数据训练出能匹配大脑触觉处理的新型神经网络。

Task-Optimized Convolutional Recurrent Networks Align with Tactile Processing in the Rodent Brain

  • 设计EAD框架,用卷积循环网络提升触觉分类性能。
  • 模型神经表征与鼠类体感皮层高度匹配,且性能与对齐度呈线性关系。
  • 自监督方法无需标签也能逼近监督模型,适合真实环境触觉感知。

触觉感知在神经科学中理解不足,在人工系统中也远不如视觉和语言成熟。本文提出编码器-注意力器-解码器(EAD)框架,基于定制化鼠须阵列模拟器生成的真实触觉输入序列,系统探索任务优化的时序神经网络。发现卷积循环网络(ConvRNN)作为编码器优于纯前馈与状态空间架构,用于触觉分类。关键的是,基于ConvRNN编码器的EAD模型生成的神经表征与鼠类体感皮层高度吻合,解释了大部分神经变异,并揭示分类性能与神经对齐度间存在清晰线性关系。此外,采用触觉特化增强的对比自监督式ConvRNN-EAD模型,其性能媲美监督模型,可作为无标签、符合行为学的代理模型。对神经科学而言,结果表明非线性循环处理对体感皮层通用触觉表征至关重要,首次定量刻画该系统的归纳偏置。对具身智能而言,强调需采用循环式EAD架构并结合定制自监督学习,以实现与动物相同的传感器在复杂环境中鲁棒的触觉感知。

原文摘要 · Abstract (English)

Tactile sensing remains far less understood in neuroscience and less effective in artificial systems compared to more mature modalities such as vision and language. We bridge these gaps by introducing a novel Encoder-Attender-Decoder (EAD) framework to systematically explore the space of task-optimized temporal neural networks trained on realistic tactile input sequences from a customized rodent whisker-array simulator. We identify convolutional recurrent neural networks (ConvRNNs) as superior encoders to purely feedforward and state-space architectures for tactile categorization. Crucially, these ConvRNN-encoder-based EAD models achieve neural representations closely matching rodent somatosensory cortex, saturating the explainable neural variability and revealing a clear linear relationship between supervised categorization performance and neural alignment. Furthermore, contrastive self-supervised ConvRNN-encoder-based EADs, trained with tactile-specific augmentations, match supervised neural fits, serving as an ethologically-relevant, label-free proxy. For neuroscience, our findings highlight nonlinear recurrent processing as important for general-purpose tactile representations in somatosensory cortex, providing the first quantitative characterization of the underlying inductive biases in this system. For embodied AI, our results emphasize the importance of recurrent EAD architectures to handle realistic tactile inputs, along with tailored self-supervised learning methods for achieving robust tactile perception with the same type of sensors animals use to sense in unstructured environments.

触觉感知神经网络卷积循环自监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。