arXiv:2506.23854cs.CVcs.GR2025-06ICCV被引 2

解决复杂场景下神经表面重建的几何与光照一致性难题

HiNeuS: High-fidelity Neural Surface Mitigating Low-texture and Reflective Ambiguity

  • 通过SDF引导的射线追踪实现连续遮挡建模,消除反射模糊
  • 在纹理缺失区域保持表面完整性,厘米级结构恢复无坍缩
  • 动态调节几何约束,兼顾细节保留与全局平滑性

神经表面重建在复杂场景下难以兼顾几何保真度与光照一致性。本文提出HiNeuS统一框架,系统解决三大核心问题:多视角辐射不一致、无纹理区域关键点缺失、联合优化中过强Eikonal约束导致的结构退化。方法包括:1)基于SDF引导的射线追踪实现差分可见性验证,通过连续遮挡建模消除反射歧义;2)采用射线对齐的平面共形正则化,自适应外观加权以保持局部表面连贯性并保留锐边;3)物理基础的Eikonal松弛机制,根据局部辐射梯度动态调节几何约束,实现细节保留与全局规则性的平衡。相比以往分步优化或孤立模块的方法,本方案在训练全程实现外观-几何约束协同演化。跨合成与真实数据集的全面评估显示,相较反射感知基线,法向距离降低21.4%;相比神经渲染方法,PSNR提升2.32 dB。定性分析表明,该方法在恢复镜面物体、厘米级城市结构及低纹理表面方面表现优异,且成功应用于材质分解与视图一致重光照等逆渲染任务。

原文摘要 · Abstract (English)

Neural surface reconstruction faces persistent challenges in reconciling geometric fidelity with photometric consistency under complex scene conditions. We present HiNeuS, a unified framework that holistically addresses three core limitations in existing approaches: multi-view radiance inconsistency, missing keypoints in textureless regions, and structural degradation from over-enforced Eikonal constraints during joint optimization. To resolve these issues through a unified pipeline, we introduce: 1) Differential visibility verification through SDF-guided ray tracing, resolving reflection ambiguities via continuous occlusion modeling; 2) Planar-conformal regularization via ray-aligned geometry patches that enforce local surface coherence while preserving sharp edges through adaptive appearance weighting; and 3) Physically-grounded Eikonal relaxation that dynamically modulates geometric constraints based on local radiance gradients, enabling detail preservation without sacrificing global regularity. Unlike prior methods that handle these aspects through sequential optimizations or isolated modules, our approach achieves cohesive integration where appearance-geometry constraints evolve synergistically throughout training. Comprehensive evaluations across synthetic and real-world datasets demonstrate state-of-the-art performance, including a 21.4% reduction in Chamfer distance over reflection-aware baselines and 2.32 dB PSNR improvement against neural rendering counterparts. Qualitative analyses reveal superior capability in recovering specular instruments, urban layouts with centimeter-scale infrastructure, and low-textured surfaces without local patch collapse. The method's generalizability is further validated through successful application to inverse rendering tasks, including material decomposition and view-consistent relighting.

神经表面三维重建光照一致性反射建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。