用查表法实现3D视频流高效超分辨率，节省70%带宽。
VoLUT: Efficient Volumetric streaming enhanced by LUT-based super-resolution
- 通过查表（LUT）快速重构低分辨率3D视频细节。
- 带宽降低70%，用户体验提升36.7%，移动端实时处理。
- 适合移动设备上的3D沉浸式视频流场景。
3D体视频提供沉浸式体验，在数字媒体中日益流行。然而，其传输面临高带宽需求的挑战。一种自然的缓解方案是传输前对体视频进行下采样，接收端再用超分辨率（SR）算法重建细节。尽管2D视频的超分辨率技术已成熟，但针对体视频的专用算法仍较少。为此，我们提出VoLUT，一种专为体视频设计的新超分辨率算法。该方法利用查找表（LUT）预存高分辨率值，实现快速、高效的上采样，显著降低计算复杂度与时间。同时结合自适应码率（ABR）算法，根据网络状况动态调整下采样率，实现按需传输。相比已有工作，VoLUT首次在主流移动设备上实现线速高质量3D超分辨率。评估显示，其可降低70%带宽，提升36.7%用户体验，并实现无质量损失的3D SR加速。
原文摘要 · Abstract (English)
3D volumetric video provides immersive experience and is gaining traction in digital media. Despite its rising popularity, the streaming of volumetric video content poses significant challenges due to the high data bandwidth requirement. A natural approach to mitigate the bandwidth issue is to reduce the volumetric video's data rate by downsampling the content prior to transmission. The video can then be upsampled at the receiver's end using a super-resolution (SR) algorithm to reconstruct the high-resolution details. While super-resolution techniques have been extensively explored and advanced for 2D video content, there is limited work on SR algorithms tailored for volumetric videos. To address this gap and the growing need for efficient volumetric video streaming, we have developed VoLUT with a new SR algorithm specifically designed for volumetric content. Our algorithm uniquely harnesses the power of lookup tables (LUTs) to facilitate the efficient and accurate upscaling of low-resolution volumetric data. The use of LUTs enables our algorithm to quickly reference precomputed high-resolution values, thereby significantly reducing the computational complexity and time required for upscaling. We further apply adaptive video bit rate algorithm (ABR) to dynamically determine the downsampling rate according to the network condition and stream the selected video rate to the receiver. Compared to related work, VoLUT is the first to enable high-quality 3D SR on commodity mobile devices at line-rate. Our evaluation shows VoLUT can reduce bandwidth usage by 70% , boost QoE by 36.7% for volumetric video streaming and achieve 3D SR speed-up with no quality compromise.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。