让全息投影自动匹配人眼瞳孔变化,真实还原景深模糊效果。
Pupil-Adaptive 3D Holography Beyond Coherent Depth-of-Field
- 根据人眼瞳孔状态动态调整全息图的景深范围。
- 在模拟和原型设备上验证,景深表现提升至少5分贝。
- 适合关注真实感三维显示的视觉算法研究者。
基于深度学习的全息显示技术虽已实现高保真投影,但仍难以呈现真实的聚焦线索。当前相干光全息显示与真实世界中非相干光产生的离焦效应之间存在显著差距。此外,现有方法未考虑观察者瞳孔大小变化对3D投影感知质量的影响,尤其是由此导致的景深模糊差异。本文提出一种框架,弥合全息显示相干景深与真实世界非相干光下景深表现之间的鸿沟。我们研究了瞳孔形状与运动对全息投影质量的影响,设计了一种瞳孔自适应的动态景深调节方法。具体而言,引入一个学习框架,根据观察者当前瞳孔状态实时调整接收场,从而生成传统计算机生成全息术无法实现的图像效果。我们在仿真与实验原型全息显示系统上验证该方法,结果表明其在景深效果呈现上显著优于现有方法,峰值信噪比提升至少5 dB。
原文摘要 · Abstract (English)
Recent holographic display approaches propelled by deep learning have shown remarkable success in enabling high-fidelity holographic projections. However, these displays have still not been able to demonstrate realistic focus cues, and a major gap still remains between the defocus effects possible with a coherent light-based holographic display and those exhibited by incoherent light in the real world. Moreover, existing methods have not considered the effects of the observer's eye pupil size variations on the perceived quality of 3D projections, especially on the defocus blur due to varying depth-of-field of the eye. In this work, we propose a framework that bridges the gap between the coherent depth-of-field of holographic displays and what is seen in the real world due to incoherent light. To this end, we investigate the effect of varying shape and motion of the eye pupil on the quality of holographic projections, and devise a method that changes the depth-of-the-field of holographic projections dynamically in a pupil-adaptive manner. Specifically, we introduce a learning framework that adjusts the receptive fields on-the-go based on the current state of the observer's eye pupil to produce image effects that otherwise are not possible in current computer-generated holography approaches. We validate the proposed method both in simulations and on an experimental prototype holographic display, and demonstrate significant improvements in the depiction of depth-of-field effects, outperforming existing approaches both qualitatively and quantitatively by at least 5 dB in peak signal-to-noise ratio.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。