arXiv:2509.17282cs.CVcs.NI2025-09

优化3D场景传输,兼顾数据新鲜度与质量。

Task-Oriented Communications for 3D Scene Representation: Balancing Timeliness and Fidelity

  • 用上下文强化学习选图,融合时效与语义信息。
  • 在保持低延迟前提下,提升场景重建精度。
  • 适合机器人实时环境感知与元宇宙应用。

实时三维场景表征是数字制造、虚拟/增强/混合现实(VR/AR/MR)及新兴元宇宙等前沿应用的基础。尽管通信与计算技术不断进步,实现在动态环境中兼顾时效性与保真度的3D场景表征仍具挑战。本文研究一个由多台同质移动机器人搭载摄像头,通过无线信道将图像传至边缘服务器以构建3D场景的系统。提出一种结合年龄信息(AoI)与语义信息的上下文-赌徒策略优化(PPO)框架,用于优化图像选择策略,平衡数据新鲜度与表征质量。对比评估了两种策略(ω-阈值与ω-等待)和两种基准方法(时序嵌入与加权和),在标准数据集与基础3D场景表征模型上进行测试。实验结果表明,在维持低延迟的同时显著提升了表征保真度,并揭示了模型决策机制。本工作通过优化动态环境中的时效性与保真度权衡,推动了实时3D场景表征的发展。

原文摘要 · Abstract (English)

Real-time Three-dimensional (3D) scene representation is a foundational element that supports a broad spectrum of cutting-edge applications, including digital manufacturing, Virtual, Augmented, and Mixed Reality (VR/AR/MR), and the emerging metaverse. Despite advancements in real-time communication and computing, achieving a balance between timeliness and fidelity in 3D scene representation remains a challenge. This work investigates a wireless network where multiple homogeneous mobile robots, equipped with cameras, capture an environment and transmit images to an edge server over channels for 3D representation. We propose a contextual-bandit Proximal Policy Optimization (PPO) framework incorporating both Age of Information (AoI) and semantic information to optimize image selection for representation, balancing data freshness and representation quality. Two policies -- the $ω$-threshold and $ω$-wait policies -- together with two benchmark methods are evaluated, timeliness embedding and weighted sum, on standard datasets and baseline 3D scene representation models. Experimental results demonstrate improved representation fidelity while maintaining low latency, offering insight into the model's decision-making process. This work advances real-time 3D scene representation by optimizing the trade-off between timeliness and fidelity in dynamic environments.

3D重建实时通信强化学习边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。