受大脑连接机制启发,提升图像识别中上下文理解能力。
Connectivity-Inspired Network for Context-Aware Recognition

- 借鉴人脑视觉通路连接结构设计神经网络
- 模块化组件显著提升分类准确率与解释鲁棒性
- 适合需要强上下文感知的视觉任务研究者
本文旨在三方面推进:首先,通过广泛文献综述向人工智能从业者介绍人类视觉系统;其次,提出一种受生物学启发的新型神经网络用于图像分类;最后,设计一种即插即用的新模块以建模上下文感知。该工作聚焦于生物大脑中电路特征对视觉识别的影响。所提出的卷积架构受人脑皮层与皮下通路连接方式启发,实现自下而上与自上而下的调制,模拟视觉与认知区域间的广泛传入和传出连接。提出的上下文注意力模块简单有效,可嵌入任意前馈神经网络,根据特征图对场景的因果影响推断权重并乘以特征图,建模图像中不同物体的共现关系。将该模块置于不同瓶颈位置,实现层级化的上下文感知。在基准数据集上的图像分类实验验证了其性能一致性提升,并通过类别激活图增强了解释的鲁棒性。代码已公开于 https://github.com/gianlucarloni/CoCoReco。
原文摘要 · Abstract (English)
The aim of this paper is threefold. We inform the AI practitioner about the human visual system with an extensive literature review; we propose a novel biologically motivated neural network for image classification; and, finally, we present a new plug-and-play module to model context awareness. We focus on the effect of incorporating circuit motifs found in biological brains to address visual recognition. Our convolutional architecture is inspired by the connectivity of human cortical and subcortical streams, and we implement bottom-up and top-down modulations that mimic the extensive afferent and efferent connections between visual and cognitive areas. Our Contextual Attention Block is simple and effective and can be integrated with any feed-forward neural network. It infers weights that multiply the feature maps according to their causal influence on the scene, modeling the co-occurrence of different objects in the image. We place our module at different bottlenecks to infuse a hierarchical context awareness into the model. We validated our proposals through image classification experiments on benchmark data and found a consistent improvement in performance and the robustness of the produced explanations via class activation. Our code is available at https://github.com/gianlucarloni/CoCoReco.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。