arXiv:2607.02301cs.CV2026-07被引 1

一键重建带材质的3D场景,支持真实光照与视角切换。

InvSplat: Inverse Feed-Forward Scene Splatting

论文配图:InvSplat: Inverse Feed-Forward Scene Splatting
图 1 · 摘自论文原文
  • 直接输出带材质参数的3D高斯点云,一次前向传播完成重建。
  • 在真实和合成数据上实现更一致的多视角表现与准确材质还原。
  • 适合需要物理可信渲染的工业级3D重建任务。

逆向渲染旨在从图像中恢复三维几何与物理意义明确的材质属性,支持再光照和新视角合成等应用。基于优化的方法虽精度高但需逐场景耗时拟合,而基于图像空间学习的方法常出现多视角不一致,且缺乏显式3D表示导致新视角渲染不稳定。本文提出一种前馈式多视角重建框架,直接预测带有内在材质属性的结构化3D高斯表示。每个高斯原语由均值、法线、不透明度、旋转、尺度、反照率、金属度和粗糙度参数化,实现解耦且物理基础的场景表达。模型融合材质估计网络先验与多视图3D重建主干,在单次前向传播中联合预测几何与反射参数。在合成与真实世界数据集上的实验表明,相比2D基线方法,本方法具有更优的多视角一致性、准确的材质恢复能力以及稳定的视角生成效果。该表示还支持基于物理的再光照及对视角依赖效应更真实的建模,优于现有基于RGB的前馈重建方法。

原文摘要 · Abstract (English)

Inverse rendering aims to recover both 3D geometry and physically meaningful material properties from images, enabling applications such as relighting and novel view synthesis. Optimization-based methods achieve high fidelity but require costly per-scene fitting, while image-space learning-based approaches often suffer from multi-view inconsistencies and lack an explicit 3D representation for stable novel view rendering. We present a feed-forward multi-view reconstruction framework for inverse rendering that directly predicts a structured 3D Gaussian representation with intrinsic material attributes. Each Gaussian primitive is parameterized by mean, normal, opacity, rotation, scale, albedo, metallic, and roughness, enabling a disentangled and physically grounded scene representation. Our model integrates priors from a material estimation network with a multi-view 3D reconstruction backbone, allowing joint prediction of geometry and reflectance parameters in a single forward pass. Experiments on synthetic and real-world datasets demonstrate improved multi-view consistency compared to 2D baselines, accurate material recovery, and stable novel view rendering. Our representation further supports physically-based relighting and more faithful modeling of view-dependent effects compared to existing RGB-based feed-forward reconstruction methods. Our project webpage is: $\href{https://poliik.github.io/invsplat/}{\text{https://poliik.github.io/invsplat/}}$.

3D重建材质恢复高斯溅射逆向渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。