arXiv:2509.23913cs.NIcs.AI2025-09

用持续学习让网络转发策略跨场景通用,实测延迟降78%。

Continual Learning to Generalize Forwarding Strategies for Diverse Mobile Wireless Networks

  • 基于新特征与持续学习,训练跨场景通用的转发模型。
  • 在真实城市环境中,延迟降低78%,交付率提升24%。
  • 适合需快速适配新移动网络的系统开发者使用。

深度强化学习(DRL)已成功用于设计多跳移动无线网络的转发策略。尽管这些策略可直接应用于不同连通性和动态条件的网络,但如何在与训练环境差异较大的场景中保持有效性仍缺乏研究。本文提出一种框架,通过(1)构建能适应多样移动网络场景的通用基础模型,(2)在新场景中使用该基础模型,并在必要时仅用少量新数据进行微调。为支持该框架,我们设计了新特征以表征网络变化和特征质量,从而提升DRL决策的信息量;并开发一种持续学习(CL)方法,在不产生灾难性遗忘的前提下,训练跨多种网络场景的DRL模型。通过大量评估,包括两个城市的实际场景,结果表明该方法可泛化至未见的移动性场景。相较于最先进的启发式转发策略,其延迟最高降低78%,交付率提升24%,前向次数相当或略高。

原文摘要 · Abstract (English)

Deep reinforcement learning (DRL) has been successfully used to design forwarding strategies for multi-hop mobile wireless networks. While such strategies can be used directly for networks with varied connectivity and dynamic conditions, developing generalizable approaches that are effective on scenarios significantly different from the training environment remains largely unexplored. In this paper, we propose a framework to address the challenge of generalizability by (i) developing a generalizable base model considering diverse mobile network scenarios, and (ii) using the generalizable base model for new scenarios, and when needed, fine-tuning the base model using a small amount of data from the new scenarios. To support this framework, we first design new features to characterize network variation and feature quality, thereby improving the information used in DRL-based forwarding decisions. We then develop a continual learning (CL) approach able to train DRL models across diverse network scenarios without ``catastrophic forgetting.'' Using extensive evaluation, including real-world scenarios in two cities, we show that our approach is generalizable to unseen mobility scenarios. Compared to a state-of-the-art heuristic forwarding strategy, it leads to up to 78% reduction in delay, 24% improvement in delivery rate, and comparable or slightly higher number of forwards.

持续学习无线网络强化学习转发策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。