用3D楔形结构建模,无训练、抗噪,提升低信噪比三维成像质量。
3D Field of Junctions: A Noise-Robust, Training-Free Structural Prior for Volumetric Inverse Problems
- 通过优化3D楔形结构解释体积块,保持重叠块一致性
- 在低信噪比下仍能保留锐利边缘和角点,优于经典与训练模型
- 无需训练数据,可直接嵌入各类三维逆问题求解流程
体素去噪是计算成像中的基础问题,因许多三维成像逆问题存在高测量噪声。受2D图像去噪中Field of Junctions(ICCV 2021)优异性能的启发,本文提出一种全新的全体积3D Field of Junctions(3D FoJ)表示:通过优化一组3D楔形结构,使其最佳解释整个体积的每个3D局部块,并在重叠块间施加一致性约束。除直接体素去噪外,3D FoJ作为结构先验具有三大优势:(i) 无需训练数据,避免幻觉风险;(ii) 在低信噪比(SNR)条件下仍能有效保留并增强三维尖锐边缘与角点结构;(iii) 可通过投影或近端梯度下降以即插即用方式应用于任意低SNR的体积逆问题。我们在三种不同低信噪比三维成像任务中验证了3D FoJ的有效性:低剂量X射线计算机断层扫描(CT)、冷冻电子断层成像(cryo-ET)以及恶劣天气下的激光雷达点云去噪。在这些挑战性任务中,3D FoJ在性能上超越了所评估的经典去噪器、未训练神经去噪器及仅用噪声样本训练的去噪器。代码已公开于 https://github.com/voilalab/3D-Field-of-Junctions。
原文摘要 · Abstract (English)
Volume denoising is a foundational problem in computational imaging, as many 3D imaging inverse problems face high levels of measurement noise. Inspired by the strong 2D image denoising properties of Field of Junctions (ICCV 2021), we propose a novel, fully volumetric 3D Field of Junctions (3D FoJ) representation that optimizes a junction of 3D wedges that best explain each 3D patch of a full volume, while encouraging consistency between overlapping patches. In addition to direct volume denoising, we leverage our 3D FoJ representation as a structural prior that: (i) requires no training data, and thus precludes the risk of hallucination, (ii) preserves and enhances sharp edge and corner structures in 3D, even under low signal to noise ratio (SNR), and (iii) can be used as a drop-in denoising representation via projected or proximal gradient descent for any volumetric inverse problem with low SNR. We demonstrate successful volume reconstruction and denoising with 3D FoJ across three diverse 3D imaging tasks with low-SNR measurements: low-dose X-ray computed tomography (CT), cryogenic electron tomography (cryo-ET), and denoising point clouds such as those from lidar in adverse weather. Across these challenging low-SNR volumetric imaging problems, 3D FoJ outperforms the evaluated classical denoisers, untrained neural denoisers, and denoisers trained only on noisy examples. Code is available at https://github.com/voilalab/3D-Field-of-Junctions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。