用图结构保持深度一致性,提升ToF传感器去噪效果
Consistent Time-of-Flight Depth Denoising via Graph-Informed Geometric Attention
- 利用跨帧几何图结构实现动态场景下的稳定去噪
- 在合成数据集上达到最优精度与时间一致性
- 适合需要高精度深度图的自动驾驶与机器人应用
基于飞行时间(ToF)传感器获取的深度图像易受噪声干扰,需去噪以保障下游任务可靠性。以往方法或仅处理单帧,或未考虑跨帧对应像素间的深度变化,导致时间不一致和空间模糊。本文提出一种新型ToF深度去噪网络,通过运动不变的图融合机制,同时提升时间稳定性与空间锐度。尽管帧间存在深度偏移,图结构仍具时序自相似性,支持跨帧几何注意力融合。结合图像平滑先验与基于ToF噪声分布的数据保真项,构建最大后验问题,并将其解展开为自适应学习权重的迭代滤波器,得到高性能且可解释的网络。实验表明,该方法在合成DVToF数据集上达成最优精度与一致性,在真实Kinectv2数据集上也展现良好泛化能力。源代码将发布于https://github.com/davidweidawang/GIGA-ToF。
原文摘要 · Abstract (English)
Depth images captured by Time-of-Flight (ToF) sensors are prone to noise, requiring denoising for reliable downstream applications. Previous works either focus on single-frame processing, or perform multi-frame processing without considering depth variations at corresponding pixels across frames, leading to undesirable temporal inconsistency and spatial ambiguity. In this paper, we propose a novel ToF depth denoising network leveraging motion-invariant graph fusion to simultaneously enhance temporal stability and spatial sharpness. Specifically, despite depth shifts across frames, graph structures exhibit temporal self-similarity, enabling cross-frame geometric attention for graph fusion. Then, by incorporating an image smoothness prior on the fused graph and data fidelity term derived from ToF noise distribution, we formulate a maximum a posterior problem for ToF denoising. Finally, the solution is unrolled into iterative filters whose weights are adaptively learned from the graph-informed geometric attention, producing a high-performance yet interpretable network. Experimental results demonstrate that the proposed scheme achieves state-of-the-art performance in terms of accuracy and consistency on synthetic DVToF dataset and exhibits robust generalization on the real Kinectv2 dataset. Source code will be released at \href{https://github.com/davidweidawang/GIGA-ToF}{https://github.com/davidweidawang/GIGA-ToF}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。