arXiv:2510.08769cs.NIcs.LG2025-10中稿 · publication at IEE…被引 1

兼顾延迟与收益,用强化学习优化5G网络切片准入控制。

Prioritizing Latency with Profit: A DRL-Based Admission Control for 5G Network Slices

  • 引入延迟感知奖励函数,优先保障低时延切片
  • 采用Boltzmann探索策略,收敛速度提升30%以上
  • 适合需要平衡服务质量与运营商利润的5G场景

5G网络通过网络切片支持eMBB、URLLC和mMTC等多种服务,需智能准入控制与资源分配以满足严格QoS要求并最大化网络服务提供商(NSP)收益。现有深度强化学习(DRL)框架多关注利润优化,未显式考虑服务延迟,可能导致对时延敏感切片的QoS违规。此外,常用epsilon-greedy探索常导致收敛不稳定、策略学习次优。为此,本文提出DePSAC——一种延迟与收益感知的切片准入控制方案。该方法基于DRL,设计延迟感知奖励函数,通过延迟惩罚激励优先处理如URLLC等低时延切片;同时采用Boltzmann探索策略,实现更平稳快速的收敛。我们在模拟的5G核心网环境中评估该方案,使用真实切片请求到达模式。实验结果表明,相比DSARA基线,本方法在整体利润、降低URLLC切片延迟、提高接受率及优化资源消耗方面均有显著提升,验证了其在实际5G切片场景中实现更好QoS-利润权衡的有效性。

原文摘要 · Abstract (English)

5G networks enable diverse services such as eMBB, URLLC, and mMTC through network slicing, necessitating intelligent admission control and resource allocation to meet stringent QoS requirements while maximizing Network Service Provider (NSP) profits. However, existing Deep Reinforcement Learning (DRL) frameworks focus primarily on profit optimization without explicitly accounting for service delay, potentially leading to QoS violations for latency-sensitive slices. Moreover, commonly used epsilon-greedy exploration of DRL often results in unstable convergence and suboptimal policy learning. To address these gaps, we propose DePSAC -- a Delay and Profit-aware Slice Admission Control scheme. Our DRL-based approach incorporates a delay-aware reward function, where penalties due to service delay incentivize the prioritization of latency-critical slices such as URLLC. Additionally, we employ Boltzmann exploration to achieve smoother and faster convergence. We implement and evaluate DePSAC on a simulated 5G core network substrate with realistic Network Slice Request (NSLR) arrival patterns. Experimental results demonstrate that our method outperforms the DSARA baseline in terms of overall profit, reduced URLLC slice delays, improved acceptance rates, and improved resource consumption. These findings validate the effectiveness of the proposed DePSAC in achieving better QoS-profit trade-offs for practical 5G network slicing scenarios.

5G切片强化学习延迟优化网络管理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。