arXiv:2608.05570cs.HCcs.CV2026-08中稿 · IEEE ISMAR 2026, t…

用多层设计实现360度全景超高清远程互动,兼顾画质与实时性。

A Multi-Layer System for Ultra-High-Resolution Static 360-Degree Telepresence

论文配图:A Multi-Layer System for Ultra-High-Resolution Static 360-Degree Telepresence
图 1 · 摘自论文原文
  • 分三层:8K全景底图+4K动态前景+可选区域4K特写
  • 通过拼接4K PTZ视频提升背景分辨率至超8K级
  • 用户可控制视角,系统自动更新对应区域细节

360度视频远程呈现具有强沉浸潜力,但受限于当前捕获与显示硬件的分辨率。许多远程呈现系统采用固定视角且场景基本静止,然而针对此类设置的优化策略研究较少。本文提出一种多层超高清静态360度远程呈现系统,结合8K全景相机与可旋转4K全景云台变焦(PTZ)相机。系统构建三层表示:(1) 基于瓦片的超高清全景背景,通过离线将高细节4K PTZ扫描拼接至8K全景底图,实现超越原始采集分辨率的有效分辨率,并以空间瓦片形式存储;(2) 动态更新层,通过实时高分辨率背景抠像融合8K流中的前景运动;(3) 兴趣区域4K层,实时传输选定区域的PTZ视图,并随时间更新对应背景瓦片。通过与典型视频超分辨率方法对比及用户研究评估感知细节与沉浸感,结果表明基于瓦片的背景优化结合用户引导更新,是平衡全景保真度与交互性的有效方案。

原文摘要 · Abstract (English)

360-degree video telepresence offers strong immersive potential but remains constrained by the limited resolution of current capture and display hardware. Many telepresence installations feature fixed viewpoints and largely static scenes, yet optimization strategies tailored to such setups have received limited attention. We present a multi-layer, ultra-high-resolution system for static 360-degree telepresence that combines an 8K panoramic camera with a rotatable 4K pan-tilt-zoom (PTZ) camera. Our approach builds a three-layer representation: (1) a tile-based ultra-high-resolution panoramic background, generated by offline stitching high-detail 4K PTZ scans onto the base 8K panorama to achieve effective resolution beyond native capture, and represented as a set of spatial tiles; (2) a dynamic update layer that composites foreground motions from the 8K stream via real-time high-resolution background matting; and (3) a region-of-interest 4K layer that streams a real-time PTZ view of the selected region and additionally updates the corresponding background tiles over time. We evaluate the proposed system through comparisons with representative video super-resolution approaches and a user study assessing perceived detail and immersive experience. Our results indicate that tile-based background refinement, together with user-guided updates, provides a practical way to balance panoramic fidelity and interactivity in static 360-degree telepresence.

360度视频超高清远程呈现多层建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。