arXiv:2510.12265cs.MMcs.AI2025-10AAAI

用真人体验反馈优化视频通话带宽估计,提升真实用户体验。

Human-in-the-Loop Bandwidth Estimation for Quality of Experience Optimization in Real-Time Video Communication

  • 基于用户主观评价训练质量奖励模型,指导带宽估算。
  • 利用百万级真实通话数据训练神经网络带宽估计算法。
  • 实测改善差体验比例11.41%,适用于实时音视频系统优化。

视频会议系统的用户体验(QoE)高度依赖于收发端间动态可用带宽的准确估计。由于网络架构快速演进、协议栈日益复杂,以及难以定义能可靠提升用户体验的QoE指标,实时通信中的带宽估计仍是一个开放挑战。本文提出一种部署在真实场景中的、基于人类反馈的数据驱动框架来应对这一问题。首先,通过主观用户评估训练客观的QoE奖励模型,用于实时衡量音视频质量。随后,从真实世界微软Teams通话中收集约100万条带有客观QoE奖励的网络轨迹,构建带宽估计训练数据集。接着,提出一种新的分布式离线强化学习算法,训练基于神经网络的带宽估计算法,以优化用户QoE。真实世界的A/B测试表明,该方法相比基线带宽估计器,主观差通话比例降低11.41%。此外,该离线强化学习算法在D4RL任务上进行了基准测试,证明其在带宽估计之外具备泛化能力。

原文摘要 · Abstract (English)

The quality of experience (QoE) delivered by video conferencing systems is significantly influenced by accurately estimating the time-varying available bandwidth between the sender and receiver. Bandwidth estimation for real-time communications remains an open challenge due to rapidly evolving network architectures, increasingly complex protocol stacks, and the difficulty of defining QoE metrics that reliably improve user experience. In this work, we propose a deployed, human-in-the-loop, data-driven framework for bandwidth estimation to address these challenges. Our approach begins with training objective QoE reward models derived from subjective user evaluations to measure audio and video quality in real-time video conferencing systems. Subsequently, we collect roughly $1$M network traces with objective QoE rewards from real-world Microsoft Teams calls to curate a bandwidth estimation training dataset. We then introduce a novel distributional offline reinforcement learning (RL) algorithm to train a neural-network-based bandwidth estimator aimed at improving QoE for users. Our real-world A/B test demonstrates that the proposed approach reduces the subjective poor call ratio by $11.41\%$ compared to the baseline bandwidth estimator. Furthermore, the proposed offline RL algorithm is benchmarked on D4RL tasks to demonstrate its generalization beyond bandwidth estimation.

带宽估计用户体验强化学习视频通信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。