无需相机参数,直接从图像生成真实镜头虚化效果
Parameter-Free Neural Lens Blur Rendering for High-Fidelity Composites
- 从RGB图像直接估计模糊程度图,不依赖深度或相机信息
- 通过线性关系推导虚拟物体的模糊值,实现自然虚化
- 适合普通用户快速制作高保真混合现实合成内容
一致且自然的镜头虚化对无缝融合3D虚拟物体与真实场景至关重要。由于镜头虚化通常随景深变化,虚拟物体的位置及其对应的模糊程度显著影响混合现实合成的视觉质量。现有方法常依赖相机参数(如焦距、对焦距离、光圈大小)和场景深度来计算弥散圆(CoC)以实现真实虚化渲染,但这些信息对普通用户往往不可用,限制了方法的可及性和泛化能力。本文提出一种新型合成方法,直接从RGB图像估计CoC图,无需场景深度或相机元数据。虚拟物体的CoC值通过其符号化CoC图与深度的线性关系推断,并利用神经重模糊网络实现真实虚化渲染。实验表明,该方法在定性和定量评估中均优于现有最佳技术,实现了高保真合成与逼真的散焦效果。
原文摘要 · Abstract (English)
Consistent and natural camera lens blur is important for seamlessly blending 3D virtual objects into photographed real-scenes. Since lens blur typically varies with scene depth, the placement of virtual objects and their corresponding blur levels significantly affect the visual fidelity of mixed reality compositions. Existing pipelines often rely on camera parameters (e.g., focal length, focus distance, aperture size) and scene depth to compute the circle of confusion (CoC) for realistic lens blur rendering. However, such information is often unavailable to ordinary users, limiting the accessibility and generalizability of these methods. In this work, we propose a novel compositing approach that directly estimates the CoC map from RGB images, bypassing the need for scene depth or camera metadata. The CoC values for virtual objects are inferred through a linear relationship between its signed CoC map and depth, and realistic lens blur is rendered using a neural reblurring network. Our method provides flexible and practical solution for real-world applications. Experimental results demonstrate that our method achieves high-fidelity compositing with realistic defocus effects, outperforming state-of-the-art techniques in both qualitative and quantitative evaluations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。