arXiv:2512.12367physics.opticscs.CV2025-12

提出一种类JPEG的云边全息传输方案,实现低延迟高保真全息显示。

JPEG-Inspired Cloud-Edge Holography

  • 采用可学习的块结构编码器,云端完成复杂计算,边缘仅需轻量解码。
  • 在低于2比特/像素时达到32.15 dB峰值信噪比,解码延迟低至4.2毫秒。
  • 适合资源受限的可穿戴设备,无需神经解码器或专用硬件。

计算机生成全息(CGH)为增强与虚拟现实中的近眼显示提供了变革性解决方案。深度学习的进展显著提升了CGH的重建质量与计算效率。然而,将神经型CGH直接部署于紧凑的镜片式设备面临计算与能耗的严格限制;而通过自然图像编解码器进行云卸载传输会破坏相位信息,且为保证重建质量需高带宽。神经压缩虽可降低带宽,但边缘端需复杂神经解码器,增加推理延迟与硬件需求。本文提出一种类JPEG的云边全息架构,核心为可学习的块结构编码器,保留了JPEG的块式结构与硬件友好特性。系统将全部重负载神经处理置于云端,边缘设备仅执行轻量级解码,无需任何神经推理。为提升吞吐量,我们在云端与边缘均实现了定制化CUDA熵编码内核。该设计在低于2比特/像素条件下实现32.15 dB的峰值信噪比,解码延迟低至4.2毫秒。数值仿真与光学实验均验证了全息图的高质量重建。通过将CGH与具备可学习组件的类JPEG编解码器对齐,本框架实现了资源受限可穿戴设备上的低延迟、高带宽效率全息流传输,仅依赖现代SoC支持的简单块解码,无需神经解码器或专用硬件。

原文摘要 · Abstract (English)

Computer-generated holography (CGH) presents a transformative solution for near-eye displays in augmented and virtual reality. Recent advances in deep learning have greatly improved CGH in reconstructed quality and computational efficiency. However, deploying neural CGH pipelines directly on compact, eyeglass-style devices is hindered by stringent constraints on computation and energy consumption, while cloud offloading followed by transmission with natural image codecs often distorts phase information and requires high bandwidth to maintain reconstruction quality. Neural compression methods can reduce bandwidth but impose heavy neural decoders at the edge, increasing inference latency and hardware demand. In this work, we introduce JPEG-Inspired Cloud-Edge Holography, an efficient pipeline designed around a learnable transform codec that retains the block-structured and hardware-friendly nature of JPEG. Our system shifts all heavy neural processing to the cloud, while the edge device performs only lightweight decoding without any neural inference. To further improve throughput, we implement custom CUDA kernels for entropy coding on both cloud and edge. This design achieves a peak signal-to-noise ratio of 32.15 dB at $<$ 2 bits per pixel with decode latency as low as 4.2 ms. Both numerical simulations and optical experiments confirm the high reconstruction quality of the holograms. By aligning CGH with a codec that preserves JPEG's structural efficiency while extending it with learnable components, our framework enables low-latency, bandwidth-efficient hologram streaming on resource-constrained wearable devices-using only simple block-based decoding readily supported by modern system-on-chips, without requiring neural decoders or specialized hardware.

全息显示云边协同高效编码可穿戴设备

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。