arXiv:2505.01584cs.LGcs.AI2025-05被引 1

提出静默神经元理论,提升强化学习在变网络下的自适应视频流质量。

Silent Neuron Theory and Plasticity Preservation for Deep Reinforcement Learning in Adaptive Video Streaming

  • 基于前向后向传播状态重置静默神经元,保留网络可塑性。
  • 在非平稳网络下实现168%更高码率和108%更好体验质量。
  • 适用于动态网络环境,尤其适合自适应视频流系统优化。

自适应视频流通过根据变化的网络带宽和用户需求选择合适的码率来优化用户体验(QoE)。然而,实际网络带宽常与训练环境存在异质性。现有方法多采用基于学习的方法以提升泛化性能,但我们的系统性研究揭示了关键缺陷:神经网络存在可塑性损失,严重阻碍其对异构网络条件的适应能力。通过对神经传播机制的理论分析,我们发现现有休眠神经元度量无法充分刻画可塑性退化。为此,我们提出静默神经元理论,提供更全面的可塑性退化理解框架。基于此,我们设计了重置静默神经元(ReSiN)方法,通过结合前向与后向传播状态,有策略地重置神经元以维持可塑性。同时,我们在非平稳网络条件下建立了更紧的性能边界。在自适应视频流系统实现中,ReSiN显著优于现有方案,在保持相近流畅度的前提下,最高实现168%的码率提升和108%的QoE改善。此外,该方法在平稳环境中也表现优异,展现出跨不同网络条件的鲁棒适应能力。

原文摘要 · Abstract (English)

Adaptive video streaming optimizes Quality of Experience (QoE) metrics by selecting appropriate bitrates according to varying network bandwidth and user demands. In practice, however, real-world network bandwidth often exhibits heterogeneity relative to training environments. Current methods predominantly tackle this problem through learning-based approaches designed to improve generalization performance. While our systematic investigation reveals a critical limitation: neural networks suffer from plasticity loss, significantly impeding their ability to adapt to heterogeneous network conditions. Through theoretical analysis of neural propagation mechanisms, we demonstrate that existing dormant neuron metrics inadequately characterize neural plasticity loss. To address this limitation, we have developed the Silent Neuron theory, which provides a more comprehensive framework for understanding plasticity degradation. Based on these theoretical insights, we propose the Reset Silent Neuron (ReSiN), which preserves neural plasticity through strategic neuron resets guided by both forward and backward propagation states. Moreover, we establish a tighter performance bound for ReSiN under non-stationary network conditions. In our implementation of an adaptive video streaming system, ReSiN has shown significant improvements over existing solutions, achieving up to 168% higher bitrate and 108% better quality of experience (QoE) while maintaining comparable smoothness. Furthermore, ReSiN consistently outperforms in stationary environments, demonstrating its robust adaptability across different network conditions.

强化学习视频流可塑性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。