让布尔几何形状可微分渲染,实现参数化建模的端到端优化。
DiffCSG: Differentiable CSG via Rasterization
- 通过光栅化实现无需显式生成网格的可微分布尔运算。
- 在物体交界处应用抗锯齿,确保梯度计算准确可靠。
- 适合需要图像驱动的3D建模与参数化设计的应用场景。
可微分渲染是逆向渲染和机器学习的关键技术,它允许通过优化场景参数(如形状、材质、光照)来最佳匹配目标图像。可微分渲染要求每个场景参数都能通过可微操作与像素值关联。尽管3D网格渲染已实现可微分化,但其难以直接扩展至构造实体几何(CSG),因为底层布尔运算通常依赖复杂的黑箱网格处理库。本文提出DiffCSG算法,实现对CSG模型的可微分渲染。该算法基于CSG光栅化,无需显式计算最终网格即可呈现原始体素间的布尔运算结果,从而绕过黑箱网格处理。我们描述了如何将CSG光栅化集成到可微分渲染流程中,并特别关注在原始体素交界处应用抗锯齿,以获得这些关键区域的精确梯度。该方法简单高效,可轻松融入现代机器学习框架,支持计算机辅助设计中的直接与基于图像的CSG原型编辑。代码与数据见:https://yyyyyhc.github.io/DiffCSG/。
原文摘要 · Abstract (English)
Differentiable rendering is a key ingredient for inverse rendering and machine learning, as it allows to optimize scene parameters (shape, materials, lighting) to best fit target images. Differentiable rendering requires that each scene parameter relates to pixel values through differentiable operations. While 3D mesh rendering algorithms have been implemented in a differentiable way, these algorithms do not directly extend to Constructive-Solid-Geometry (CSG), a popular parametric representation of shapes, because the underlying boolean operations are typically performed with complex black-box mesh-processing libraries. We present an algorithm, DiffCSG, to render CSG models in a differentiable manner. Our algorithm builds upon CSG rasterization, which displays the result of boolean operations between primitives without explicitly computing the resulting mesh and, as such, bypasses black-box mesh processing. We describe how to implement CSG rasterization within a differentiable rendering pipeline, taking special care to apply antialiasing along primitive intersections to obtain gradients in such critical areas. Our algorithm is simple and fast, can be easily incorporated into modern machine learning setups, and enables a range of applications for computer-aided design, including direct and image-based editing of CSG primitives. Code and data: https://yyyyyhc.github.io/DiffCSG/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。