用量子启发方法优化无人机6G组网中的探索与利用平衡
Quantum-Inspired Multi Agent Reinforcement Learning for Exploration Exploitation Optimization in UAV-Assisted 6G Network Deployment
- 结合量子电路与多智能体强化学习,提升决策效率
- 10架无人机协作下覆盖性能提升,收敛速度更快
- 适合研究智能网络部署与强化学习融合的科研人员
本研究提出一种量子启发的多智能体强化学习框架,用于优化无人机辅助6G网络部署中的探索与利用权衡。在部分可观测和动态环境下,10个智能无人机协同工作,最大化信号覆盖并支持高效网络扩展。方法融合经典MARL与量子启发优化技术,以变分量子电路(VQCs)为核心结构,采用量子近似优化算法(QAOA)进行组合优化,并通过贝叶斯推断、高斯过程和变分推断实现对环境潜在动态的建模。采用集中训练、分散执行(CTDE)范式,利用共享记忆和局部视图网格增强智能体的局部可观测性。综合实验包括可扩展性测试、敏感性分析及与PPO和DDPG基线的对比,结果表明该框架显著提升样本效率、加快收敛速度,并改善覆盖性能,同时保持鲁棒性。雷达图与收敛分析进一步证明,相比传统方法,量子启发MARL在探索与利用之间实现更优平衡。所有代码与补充材料均公开于GitHub,确保可复现性。
原文摘要 · Abstract (English)
This study introduces a quantum inspired framework for optimizing the exploration exploitation tradeoff in multiagent reinforcement learning, applied to UAVassisted 6G network deployment. We consider a cooperative scenario where ten intelligent UAVs autonomously coordinate to maximize signal coverage and support efficient network expansion under partial observability and dynamic conditions. The proposed approach integrates classical MARL algorithms with quantum-inspired optimization techniques, leveraging variational quantum circuits VQCs as the core structure and employing the Quantum Approximate Optimization Algorithm QAOA as a representative VQC based method for combinatorial optimization. Complementary probabilistic modeling is incorporated through Bayesian inference, Gaussian processes, and variational inference to capture latent environmental dynamics. A centralized training with decentralized execution CTDE paradigm is adopted, where shared memory and local view grids enhance local observability among agents. Comprehensive experiments including scalability tests, sensitivity analysis, and comparisons with PPO and DDPG baselines demonstrate that the proposed framework improves sample efficiency, accelerates convergence, and enhances coverage performance while maintaining robustness. Radar chart and convergence analyses further show that QI MARL achieves a superior balance between exploration and exploitation compared to classical methods. All implementation code and supplementary materials are publicly available on GitHub to ensure reproducibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。