用量子干扰路由提升专家模型,让复杂数据分布更容易分离。
Hybrid Quantum-Classical Mixture of Experts: Unlocking Topological Advantage via Interference-Based Routing
- 用量子门电路做路由,通过波干涉实现高维非线性决策。
- 在双月数据集上,量子路由比经典方法更高效地分离非线性数据。
- 适合需要隐私保护和自适应能力的联邦学习场景。
混合专家(MoE)架构是扩展深度学习模型的有效范式,但受限于专家不平衡和经典路由机制的计算复杂性。本文提出一种新型量子-经典混合专家(QMoE)架构,通过量子门控网络(量子路由)结合经典专家,验证量子优势来源。核心发现支持干涉假设:利用角度编码的量子特征映射与波干涉,量子路由可作为高维核方法,以更少参数建模复杂非线性边界,优于经典方案。在非线性可分数据(如双月数据集)上的实验表明,量子路由能有效“解开”经典线性路由无法高效分离的数据分布,展现显著拓扑优势。同时分析了该架构在模拟量子噪声下的鲁棒性,证实其适用于近期中等规模量子(NISQ)硬件。讨论了其在联邦学习、隐私保护机器学习及自适应系统中的应用潜力。
原文摘要 · Abstract (English)
The Mixture-of-Experts (MoE) architecture has emerged as a powerful paradigm for scaling deep learning models, yet it is fundamentally limited by challenges such as expert imbalance and the computational complexity of classical routing mechanisms. This paper investigates the potential of Quantum Machine Learning (QML) to address these limitations through a novel Hybrid Quantum-Classical Mixture of Experts (QMoE) architecture. Specifically, we conduct an ablation study using a Quantum Gating Network (Router) combined with classical experts to isolate the source of quantum advantage. Our central finding validates the Interference Hypothesis: by leveraging quantum feature maps (Angle Embedding) and wave interference, the Quantum Router acts as a high-dimensional kernel method, enabling the modeling of complex, non-linear decision boundaries with superior parameter efficiency compared to its classical counterparts. Experimental results on non-linearly separable data, such as the Two Moons dataset, demonstrate that the Quantum Router achieves a significant topological advantage, effectively "untangling" data distributions that linear classical routers fail to separate efficiently. Furthermore, we analyze the architecture's robustness against simulated quantum noise, confirming its feasibility for near-term intermediate-scale quantum (NISQ) hardware. We discuss practical applications in federated learning, privacy-preserving machine learning, and adaptive systems that could benefit from this quantum-enhanced routing paradigm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。