用户可自定义焦点平面与光圈,实现精准虚化效果生成。
Variable Aperture Bokeh Rendering via Customized Focal Plane Guidance
- 通过自定义焦点平面和光圈参数控制虚化
- 仅用440万参数达到顶尖性能
- 适合移动端轻量化虚化应用
虚化渲染是摄影中广受欢迎的技术,能引导观者注意力聚焦于图像特定区域。然而,由于移动设备光学系统受限,获得理想虚化效果仍具挑战,通常需依赖昂贵的单反镜头大光圈。近年来,许多基于深度学习的计算摄影方法被提出以模拟虚化效果,但多数仅支持单一光圈设置,缺乏用户友好的焦点平面控制与定制化虚化生成能力。同时,也缺少真实可靠的可变光圈虚化数据集。为此,本文提出一种可控虚化渲染方法,并构建了可变光圈虚化数据集(VABD)。用户可自定义焦点平面定位目标主体,并选择目标光圈信息进行虚化渲染。在公开的EBB!基准数据集及自建的VABD数据集上的实验表明,结合焦点平面与光圈提示可有效引导模型生成逼真虚化效果。所提方法仅需440万参数,显著轻量于主流虚化模型,性能达到当前领先水平。相关数据集与源码将开源至GitHub:https://github.com/MoTong-AI-studio/VABM。
原文摘要 · Abstract (English)
Bokeh rendering is one of the most popular techniques in photography. It can make photographs visually appealing, forcing users to focus their attentions on particular area of image. However, achieving satisfactory bokeh effect usually presents significant challenge, since mobile cameras with restricted optical systems are constrained, while expensive high-end DSLR lens with large aperture should be needed. Therefore, many deep learning-based computational photography methods have been developed to mimic the bokeh effect in recent years. Nevertheless, most of these methods were limited to rendering bokeh effect in certain single aperture. There lacks user-friendly bokeh rendering method that can provide precise focal plane control and customised bokeh generation. There as well lacks authentic realistic bokeh dataset that can potentially promote bokeh learning on variable apertures. To address these two issues, in this paper, we have proposed an effective controllable bokeh rendering method, and contributed a Variable Aperture Bokeh Dataset (VABD). In the proposed method, user can customize focal plane to accurately locate concerned subjects and select target aperture information for bokeh rendering. Experimental results on public EBB! benchmark dataset and our constructed dataset VABD have demonstrated that the customized focal plane together aperture prompt can bootstrap model to simulate realistic bokeh effect. The proposed method has achieved competitive state-of-the-art performance with only 4.4M parameters, which is much lighter than mainstream computational bokeh models. The contributed dataset and source codes will be released on github https://github.com/MoTong-AI-studio/VABM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。