arXiv:2606.00266cs.NIcs.LG2026-06

机器学习让无线设备自动学会高效公平的通信方式。

KISS: Keeping it Simple and Slotted when Learning to Communicate over Wireless

论文配图:KISS: Keeping it Simple and Slotted when Learning to Communicate over Wireless
图 1 · 摘自论文原文
  • 用强化学习训练独立智能体,在时隙信道上自主学习通信策略。
  • 在不同网络负载下接近理论最优效率,且保持公平性。
  • 方法简单有效,适合研究随机接入机制的新思路。

分布式无线系统中高效公平的随机信道访问是一大挑战。现有方案多针对特定约束(如定时、周期性或中心化),但依赖固定启发式规则。受机器学习进展启发,我们探究智能体能否自主学习出高效公平的接入策略,并为介质访问控制(MAC)设计提供新洞见。不提出可部署协议,而是考察去中心化学习是否能在最小假设下重现或逼近理论高效的随机接入机制。为此,我们采用基于贝叶斯推断的离线策略双深度Q网络(DDQN),在时隙信道上训练独立智能体。所提方法完全在线(无需预训练)、完全分布式(独立多智能体学习者)、随机(非周期性),且无需协调或显式通信。大量仿真表明,学习策略能自适应不同网络条件,达到近理论最优效率并维持公平性。消融实验进一步显示,学习行为类似时隙ALOHA,但传输概率动态调整,故称此方法为KISS:Keeping It Simple and Slotted。

原文摘要 · Abstract (English)

A long-standing challenge in distributed wireless systems is ensuring efficient and fair random channel access. Existing solutions often address specific constraints related to timing, periodicity, or centralization, but they typically rely on fixed heuristics. Motivated by recent advances in machine learning (ML), we investigate whether ML agents can autonomously learn efficient and fair access strategies, and whether such learning can offer new insights into medium access control (MAC) design. Rather than proposing a deployable protocol, our aim is to examine whether decentralized learning can rediscover or approximate theoretically efficient random-access mechanisms under minimal assumptions. To this end, we deploy an off-policy Double Deep Q-Network (DDQN) with Bayesian inference to train agents operating over a slotted channel. The resulting method is fully online (no pre-training), fully distributed (independent multi-agent learners), stochastic (non-periodic), and requires no coordination or explicit communication. Extensive simulations show that the learned strategy adapts to varying network conditions and achieves near-theoretical efficiency while maintaining fairness. Ablation studies further reveal that the learned behavior resembles slotted ALOHA with a dynamically adjusted transmission probability, leading us to refer to the method as KISS: Keeping It Simple and Slotted.

无线通信强化学习随机接入智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。