arXiv:2512.13157cs.CVcs.AI2025-12被引 7

用多视角图像重建高保真材质,提升真实感渲染效果

Intrinsic Image Fusion for Multi-View 3D Material Reconstruction

  • 融合单视角先验,通过扩散模型生成候选材质分解
  • 基于置信度筛选多视角一致预测,优化参数空间
  • 适合需要高质量材质重建的3D渲染与数字孪生应用

我们提出内在图像融合方法,从多视角图像中重建高保真物理材质。材质重建高度欠约束,传统分析-合成方法依赖昂贵且噪声大的路径追踪。为更好约束优化,我们引入单视角先验。利用基于扩散的材质估计算法,每视角生成多个但常不一致的候选分解。通过拟合低维显式参数函数降低不一致性。提出鲁棒优化框架,结合软视角选择与置信度驱动的多视角内点集,融合最可信视角中最一致的预测至统一参数空间。最终通过逆向路径追踪优化低维参数。在合成与真实场景上,材质解耦性能超越现有最优方法,生成清晰锐利的重建结果,适用于高质量光影重演。

原文摘要 · Abstract (English)

We introduce Intrinsic Image Fusion, a method that reconstructs high-quality physically based materials from multi-view images. Material reconstruction is highly underconstrained and typically relies on analysis-by-synthesis, which requires expensive and noisy path tracing. To better constrain the optimization, we incorporate single-view priors into the reconstruction process. We leverage a diffusion-based material estimator that produces multiple, but often inconsistent, candidate decompositions per view. To reduce the inconsistency, we fit an explicit low-dimensional parametric function to the predictions. We then propose a robust optimization framework using soft per-view prediction selection together with confidence-based soft multi-view inlier set to fuse the most consistent predictions of the most confident views into a consistent parametric material space. Finally, we use inverse path tracing to optimize for the low-dimensional parameters. Our results outperform state-of-the-art methods in material disentanglement on both synthetic and real scenes, producing sharp and clean reconstructions suitable for high-quality relighting.

材质重建多视角扩散模型3D渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。