arXiv:2608.15138cs.AI2026-08

用大模型持续优化视频流控算法,自动适应新网络环境且保证旧场景不受影响。

ReForge: Keeping ABR Algorithms Never Finished with Verified Large Language Model Edits

论文配图:ReForge: Keeping ABR Algorithms Never Finished with Verified Large Language Model Edits
图 1 · 摘自论文原文
  • 用大模型逐轮提出小修改,通过重播所有历史场景验证安全性。
  • 9个真实网络场景下,平均画质体验从1.23提升至1.74,接近理想方案。
  • 适合需要长期迭代的自适应系统研发团队,尤其关注稳定性与自动化。

设计一个适用于特定网络场景的自适应比特率(ABR)算法通常需工程师数月,而如今大型语言模型可在数小时内完成,性能媲美甚至超越人工设计。但无论哪种方式,设计都只适用于其诞生时的环境,无法应对后续变化。本文提出 ReForge,一种持续性启发式学习框架,使 ABR 算法能随新场景即时更新。该框架在大语言模型(LLM)的驱动下运行:每轮由 LLM 分析当前策略在历史场景中的不足,提出一项微小修改;再通过在所有已服务网络上重播来判断修改是否安全。具体而言,它修改的是一页模糊规则,将每个决策路由到一组冻结的预训练策略中。初始规则仅基于测量数据生成,之后可自主改进。实验评估覆盖 3G、4G 到 5G 的九类真实网络场景,每次新增场景仅需少量修改,平均用户体验得分(QoE)从 1.23 提升至 1.74,超过最优单策略的 1.66,达到理想方案的 94%。甚至修复了从未见过的网络家族,使其得分从 0.30 升至 0.80。所有代码、数据及实验记录将在清理后开源。

原文摘要 · Abstract (English)

Designing an ABR algorithm for one network scenario takes an engineer months, and large language models now do this work in hours, matching or beating hand-built designs. But either way, the design fits only the world visible at its birth, and fails on the world that arrives after. We ask whether an ABR algorithm can keep pace with the world, redesigned in minutes as each scenario arrives, with every change proven harmless to every scenario already served. In this work, we propose ReForge, a continual heuristic learning framework that adapts to continuously changing scenarios. ReForge runs that routine with a large language model (LLM) in the loop. Each round the LLM reads where the current design falls short and proposes one small edit, and a replay over every network served so far decides. Specifically, what it edits is a single page of fuzzy rules that routes every decision to one of a frozen pool of pre-trained policies. The LLM writes the first page from measurements alone, then keeps improving it on its own. Each round it reads where the current rules fall short and proposes one small edit, and a replay over every network served so far decides whether the edit lands. We evaluate ReForge on nine real-world network families arriving one at a time as 3G, 4G, then 5G. A few edits per arrival lift mean QoE from 1.23 to 1.74, past the best single policy at 1.66 and to 94\% of an oracle, and even repair families the loop never saw, one rising from 0.30 to 0.80. All code, data, and experiment records will be open-sourced upon cleanup.

ABR算法大模型持续学习视频流控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。