arXiv:2510.27091cs.LGcs.AI2025-10

用量子跃迁机制建模多模态情感,提升融合效果与训练稳定性。

QiNN-QJ: A Quantum-inspired Neural Network with Quantum Jump for Multimodal Sentiment Analysis

  • 引入量子跃迁算子模拟非单位变换,实现可控跨模态纠缠。
  • 在三个基准数据集上超越现有最优模型,准确率提升1.2%-3.5%。
  • 通过冯诺依曼熵提供可解释性,适合需要透明决策的场景。

量子理论中的叠加与纠缠等非经典原理为机器学习提供了新范式。然而,现有量子启发融合模型多依赖单位或单位类变换生成纠缠,虽理论上表达力强,但常面临训练不稳与泛化能力弱的问题。本文提出量子启发神经网络量子跃迁(QiNN-QJ),用于多模态纠缠建模:先将各模态编码为量子纯态,再通过可微分模块模拟量子跃迁(QJ)算子,将可分离的乘积态转化为纠缠表示。通过联合学习哈密顿量与林德布拉德算子,利用耗散动力学实现可控跨模态纠缠,其中结构化随机性和稳态吸引子特性有效稳定训练并约束纠缠形态。最终纠缠态投影到可训练测量向量以生成预测。实验表明,该方法在CMU-MOSI、CMU-MOSEI和CH-SIMS数据集上均优于当前最佳模型,性能提升1.2%-3.5%。同时,通过冯诺依曼纠缠熵实现增强的后验可解释性。本工作建立了一个严谨的纠缠多模态融合框架,推动了量子启发方法在复杂跨模态关联建模中的应用。

原文摘要 · Abstract (English)

Quantum theory provides non-classical principles, such as superposition and entanglement, that inspires promising paradigms in machine learning. However, most existing quantum-inspired fusion models rely solely on unitary or unitary-like transformations to generate quantum entanglement. While theoretically expressive, such approaches often suffer from training instability and limited generalizability. In this work, we propose a Quantum-inspired Neural Network with Quantum Jump (QiNN-QJ) for multimodal entanglement modelling. Each modality is firstly encoded as a quantum pure state, after which a differentiable module simulating the QJ operator transforms the separable product state into the entangled representation. By jointly learning Hamiltonian and Lindblad operators, QiNN-QJ generates controllable cross-modal entanglement among modalities with dissipative dynamics, where structured stochasticity and steady-state attractor properties serve to stabilize training and constrain entanglement shaping. The resulting entangled states are projected onto trainable measurement vectors to produce predictions. In addition to achieving superior performance over the state-of-the-art models on benchmark datasets, including CMU-MOSI, CMU-MOSEI, and CH-SIMS, QiNN-QJ facilitates enhanced post-hoc interpretability through von-Neumann entanglement entropy. This work establishes a principled framework for entangled multimodal fusion and paves the way for quantum-inspired approaches in modelling complex cross-modal correlations.

多模态量子启发情感分析可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。