提出分布式算法,让多个通信单元在干扰图上稳定共享频谱。
Distributed Learning in Markovian Restless Bandits over Interference Graphs for Stable Spectrum Sharing
- 基于干扰图建模频谱共享,结合非平稳马尔可夫过程设计学习机制。
- 算法实现对未知信道的探索与利用平衡,收敛到最优稳定分配。
- 适合大规模无线网络中的认知无线电系统,具备高效与可扩展性。
我们研究在通信受限的无线网络中,多个认知通信实体(如基站、子网或认知无线电用户,统称“单元”)之间的分布式频谱接入与共享问题,网络由干扰图建模。目标是实现全局稳定且干扰感知的信道分配。稳定性采用广义的Gale-Shapley多对一匹配定义,这是无线资源分配中的经典解法。考虑L个单元共享S个正交信道,且相邻单元不能同时使用同一信道。每条信道以未知的非平稳马尔可夫过程演化,且收益依赖于单元。这是首个在随机时变非平稳环境下建立全局Gale-Shapley稳定的信道分配工作。为此,我们提出SMILE(Stable Multi-matching with Interference-aware LEarning),一种通信高效的分布式学习算法,融合非平稳强化学习与图约束协调。该算法使各单元能分布式地平衡对未知信道的探索与已有信息的利用。我们证明了SMILE收敛至最优稳定分配,并相对于全知“先验者”实现了对数级遗憾。仿真验证了理论结果,展示了SMILE在多种频谱共享场景下的鲁棒性、可扩展性与效率。
原文摘要 · Abstract (English)
We study distributed learning for spectrum access and sharing among multiple cognitive communication entities, such as cells, subnetworks, or cognitive radio users (collectively referred to as cells), in communication-constrained wireless networks modeled by interference graphs. Our goal is to achieve a globally stable and interference-aware channel allocation. Stability is defined through a generalized Gale-Shapley multi-to-one matching, a well-established solution concept in wireless resource allocation. We consider wireless networks where L cells share S orthogonal channels and cannot simultaneously use the same channel as their neighbors. Each channel evolves as an unknown restless Markov process with cell-dependent rewards, making this the first work to establish global Gale-Shapley stability for channel allocation in a stochastic, temporally varying restless environment. To address this challenge, we develop SMILE (Stable Multi-matching with Interference-aware LEarning), a communication-efficient distributed learning algorithm that integrates restless bandit learning with graph-constrained coordination. SMILE enables cells to distributedly balance exploration of unknown channels with exploitation of learned information. We prove that SMILE converges to the optimal stable allocation and achieves logarithmic regret relative to a genie with full knowledge of expected utilities. Simulations validate the theoretical guarantees and demonstrate SMILE's robustness, scalability, and efficiency across diverse spectrum-sharing scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。