arXiv:2605.30250cs.CVcs.GR2026-05International Conf…

用近红外闪光提升光照鲁棒性,实现更准的物体三维重建

Ambient-robust Inverse Rendering using Active RGB-NIR Imaging

论文配图:Ambient-robust Inverse Rendering using Active RGB-NIR Imaging
图 1 · 摘自论文原文
  • 结合可见光与主动近红外成像,利用近红外闪光获得稳定光照信息
  • 在多种环境光条件下均实现高精度几何与反射率重建,误差显著降低
  • 适合需要高鲁棒性三维重建的应用,如机器人视觉、数字孪生

逆向渲染旨在从图像中重建物体的几何与反射特性。尽管近年取得进展,现有方法仍对环境光照敏感,导致重建结果不准确。本文提出一种基于主动RGB-NIR成像的光照鲁棒逆向渲染方法。核心思路是利用人眼不可见的近红外(NIR)闪光,获取不受环境光影响的点光源阴影。通过多视角可见光图像(环境光照明)与主动NIR闪光拍摄的NIR图像,结合二者互补优势,采用三阶段逆向渲染流程,实现精确的几何与反射率重建。为支持密集多视角采集,我们构建了一个搭载RGB-NIR相机与移动基座上NIR闪光灯的主动成像系统,并首次在多种环境光照条件下采集了多视角RGB-NIR逆向渲染数据集。实验表明,本方法优于先前方法,在多种光照场景下均能实现高精度重建。

原文摘要 · Abstract (English)

Inverse rendering aims to reconstruct geometry and reflectance of objects from images. Despite recent progress, existing methods often produces inaccurate reconstructions that are sensitive to ambient illumination conditions. Here we introduce an ambient-robust inverse rendering method enabled by active RGB-NIR imaging. Our key insight is to leverage near-infrared (NIR) flash illumination-imperceptible to human observers-to obtain stable point-light shading that is largely invariant to ambient illumination. By using multi-view RGB images illuminated by ambient light and NIR images acquired with active NIR flash illumination, we reconstruct accurate geometry and reflectance by exploiting the complementary benefits of RGB and NIR images via a three-stage inverse rendering method. To enable dense multi-view acquisition, we develop an active imaging system equipped with a RGB-NIR camera and a NIR flash mounted on a mobile base. Using this system, we collect the first multi-view RGB-NIR inverse rendering dataset captured under multiple ambient illumination conditions. Experiments demonstrate that our method outperforms prior approaches, achieving accurate geometry and reflectance estimation across multiple ambient lighting scenarios.

逆向渲染RGB-NIR光照鲁棒三维重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。