arXiv:2502.19683eess.IVcs.CV2025-02AAAI被引 4

用双分支图网络提升非视域成像的纹理与深度重建质量

Dual-branch Graph Feature Learning for NLOS Imaging

  • 分设纹理与深度专用分支,解耦重建任务
  • 相比现有方法,合成与真实数据上性能最优
  • 首次用GNN压缩密集网格为稀疏结构特征

非视域(NLOS)成像技术快速发展,可揭示不可直视的场景。但现有系统面临两大挑战:一是三维网格数据导致计算与存储开销巨大;二是同时重建反照率与深度需精细调节损失函数超参数,难以兼顾。本文提出新方法 \nets,采用双分支架构:一个专注于反照率恢复,另一个提取几何结构,分离内容传递以提升重建质量。首次将图神经网络(GNN)作为核心组件,将密集的NLOS网格数据转换为稀疏结构特征,实现高效重建。大量实验表明,该方法在合成与真实数据集上均达到现有最佳性能。

原文摘要 · Abstract (English)

The domain of non-line-of-sight (NLOS) imaging is advancing rapidly, offering the capability to reveal occluded scenes that are not directly visible. However, contemporary NLOS systems face several significant challenges: (1) The computational and storage requirements are profound due to the inherent three-dimensional grid data structure, which restricts practical application. (2) The simultaneous reconstruction of albedo and depth information requires a delicate balance using hyperparameters in the loss function, rendering the concurrent reconstruction of texture and depth information difficult. This paper introduces the innovative methodology, \xnet, which integrates an albedo-focused reconstruction branch dedicated to albedo information recovery and a depth-focused reconstruction branch that extracts geometrical structure, to overcome these obstacles. The dual-branch framework segregates content delivery to the respective reconstructions, thereby enhancing the quality of the retrieved data. To our knowledge, we are the first to employ the GNN as a fundamental component to transform dense NLOS grid data into sparse structural features for efficient reconstruction. Comprehensive experiments demonstrate that our method attains the highest level of performance among existing methods across synthetic and real data. https://github.com/Nicholassu/DG-NLOS.

非视域成像图神经网络双分支结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。