用量子启发神经网络解析脑信号连通性,提升视觉-脑理解精度。
Quantum-Brain: Quantum-Inspired Neural Network Approach to Vision-Brain Understanding
- 基于量子态空间设计脑区连通性建模模块,模拟神经信号相互作用。
- 在自然场景数据集上实现95.1%图像检索准确率和95.6%脑信号检索准确率。
- 适合对脑机接口、神经影像分析感兴趣的科研人员。
视觉-脑理解旨在从人类感知中提取脑信号的语义信息。现有深度学习方法通常采用传统学习范式,缺乏对脑区之间连接关系的学习能力。量子计算理论为设计深度学习模型提供了新范式。受脑信号连通性与量子纠缠特性的启发,我们提出一种新型量子启发神经网络——Quantum-Brain,用于解决视觉-脑理解问题。为计算脑信号区域间的连通性,引入量子启发的体素控制模块,在希尔伯特空间中学习某一脑体素对其他体素的影响;为有效学习连通性,提出相位偏移模块校准脑信号值;最后设计类测量投影模块,将希尔伯特空间中的连通性信息映射到特征空间。该方法能学习脑区间连通性并增强从人类感知中获得的语义信息。在自然场景数据集上的实验表明,该方法在图像与脑信号检索任务中分别达到95.1%和95.6%的Top-1准确率,在fMRI到图像重建任务中取得95.3%的Inception分数。所提出的量子启发网络为通过量子计算理论解决视觉-脑问题提供了潜在新范式。
原文摘要 · Abstract (English)
Vision-brain understanding aims to extract semantic information about brain signals from human perceptions. Existing deep learning methods for vision-brain understanding are usually introduced in a traditional learning paradigm missing the ability to learn the connectivities between brain regions. Meanwhile, the quantum computing theory offers a new paradigm for designing deep learning models. Motivated by the connectivities in the brain signals and the entanglement properties in quantum computing, we propose a novel Quantum-Brain approach, a quantum-inspired neural network, to tackle the vision-brain understanding problem. To compute the connectivity between areas in brain signals, we introduce a new Quantum-Inspired Voxel-Controlling module to learn the impact of a brain voxel on others represented in the Hilbert space. To effectively learn connectivity, a novel Phase-Shifting module is presented to calibrate the value of the brain signals. Finally, we introduce a new Measurement-like Projection module to present the connectivity information from the Hilbert space into the feature space. The proposed approach can learn to find the connectivities between fMRI voxels and enhance the semantic information obtained from human perceptions. Our experimental results on the Natural Scene Dataset benchmarks illustrate the effectiveness of the proposed method with Top-1 accuracies of 95.1% and 95.6% on image and brain retrieval tasks and an Inception score of 95.3% on fMRI-to-image reconstruction task. Our proposed quantum-inspired network brings a potential paradigm to solving the vision-brain problems via the quantum computing theory.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。