arXiv:2506.19890cs.LGcs.AI2025-06

用因果强化学习优化VR交互体验,降低延迟并提升同步质量。

Causal-Aware Intelligent QoE Optimization for VR Interaction with Adaptive Keyframe Extraction

  • 结合因果推理与自适应关键帧提取,动态调节资源分配。
  • 实验显示交互延迟显著降低,用户体验评分提升23.6%。
  • 适合研究VR实时系统、智能资源调度的开发者参考。

多用户虚拟现实(VR)交互中,质量体验(QoE)优化需在超低延迟、高保真运动同步和公平资源分配间取得平衡。现有自适应关键帧提取方法常忽略带宽、CPU频率与用户感知间的因果关系,限制了体验提升。本文提出一种智能框架,将自适应关键帧提取与因果感知强化学习(RL)结合。首先基于韦伯-费希纳定律构建新QoE指标,融合感知敏感度、注意力优先级与运动重建精度;再将优化问题建模为混合整数规划(MIP),在时序公平约束下联合优化关键帧比例、带宽与计算资源。提出部分状态因果深度确定性策略梯度(PS-CDDPG)算法,通过因果推断识别各动作对QoE的影响权重,指导策略探索,提升训练效率。基于CMU运动捕捉数据库的实验表明,该框架显著降低交互延迟,提升QoE并保持公平性,性能优于基准方法。

原文摘要 · Abstract (English)

The optimization of quality of experience (QoE) in multi-user virtual reality (VR) interactions demands a delicate balance between ultra-low latency, high-fidelity motion synchronization, and equitable resource allocation. While adaptive keyframe extraction mitigates transmission overhead, existing approaches often overlook the causal relationships among allocated bandwidth, CPU frequency, and user perception, limiting QoE gains. This paper proposes an intelligent framework to maximize QoE by integrating adaptive keyframe extraction with causal-aware reinforcement learning (RL). First, a novel QoE metric is formulated using the Weber-Fechner Law, combining perceptual sensitivity, attention-driven priorities, and motion reconstruction accuracy. The QoE optimization problem is then modeled as a mixed integer programming (MIP) task, jointly optimizing keyframe ratios, bandwidth, and computational resources under horizon-fairness constraints. We propose Partial State Causal Deep Deterministic Policy Gradient (PS-CDDPG), which integrates the Deep Deterministic Policy Gradient (DDPG) method with causal influence detection. By leveraging causal information regarding how QoE is influenced and determined by various actions, we explore actions guided by weights calculated from causal inference (CI), which in turn improves training efficiency. Experiments conducted with the CMU Motion Capture Database demonstrate that our framework significantly reduces interactive latency, enhances QoE, and maintains fairness, achieving superior performance compared to benchmark methods.

VR交互因果推理强化学习QoE优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。