arXiv:2505.06881cs.CVcs.AI2025-05

受大脑视觉皮层启发,提升图像分类模型跨域泛化能力

NeuRN: Neuro-inspired Domain Generalization for Image Classification

  • 引入类神经元响应归一化层,模拟哺乳动物视觉皮层机制
  • 在多个架构上验证,跨域分类准确率显著优于基线模型
  • 适合追求鲁棒性、跨域泛化的计算机视觉研究者

图像分类中的域泛化是关键挑战,现有模型在未见数据集上表现不佳。本文提出受哺乳动物视觉皮层启发的神经响应归一化(NeuRN)层,通过在源域上训练深度学习模型,提升其在未见目标域的表现。实验覆盖多种深度网络架构,包括神经架构搜索生成的模型与Vision Transformer。为从海量优秀模型中筛选候选,还提出基于Needleman-Wunsch算法的架构相似性计算方法。结果表明,集成NeuRN的模型在跨域图像分类任务中显著优于基线。该框架为未来类脑深度学习模型奠定基础。

原文摘要 · Abstract (English)

Domain generalization in image classification is a crucial challenge, with models often failing to generalize well across unseen datasets. We address this issue by introducing a neuro-inspired Neural Response Normalization (NeuRN) layer which draws inspiration from neurons in the mammalian visual cortex, which aims to enhance the performance of deep learning architectures on unseen target domains by training deep learning models on a source domain. The performance of these models is considered as a baseline and then compared against models integrated with NeuRN on image classification tasks. We perform experiments across a range of deep learning architectures, including ones derived from Neural Architecture Search and Vision Transformer. Additionally, in order to shortlist models for our experiment from amongst the vast range of deep neural networks available which have shown promising results, we also propose a novel method that uses the Needleman-Wunsch algorithm to compute similarity between deep learning architectures. Our results demonstrate the effectiveness of NeuRN by showing improvement against baseline in cross-domain image classification tasks. Our framework attempts to establish a foundation for future neuro-inspired deep learning models.

域泛化类脑计算视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。