用拉普拉斯金字塔分层重构深度图,速度快效果好。
Learning Inverse Laplacian Pyramid for Progressive Depth Completion
- 基于拉普拉斯金字塔分层渐进式预测,先粗后细
- 在KITTI等数据集上达最优性能,速度优于现有方法
- 适合需要高效高精度深度重建的场景
深度补全旨在从稀疏深度测量中重建稠密深度图,利用对应彩色图像的信息。现有方法多依赖单尺度传播策略,通过像素级消息传递迭代优化初始粗略深度估计。尽管效果良好,但常受计算效率低和场景上下文理解有限的制约。为此,我们提出LP-Net,一种基于拉普拉斯金字塔分解的多尺度、渐进式预测框架。不同于传播式方法,LP-Net从低分辨率初步预测出发,捕获全局场景上下文,再通过逐级上采样与高频细节恢复逐步细化。设计了两个新模块:1)多路径特征金字塔模块,将特征图分路处理,通过多尺度变换融合空间信息;2)选择性深度滤波模块,动态学习应用平滑与锐化滤波,有效抑制噪声同时增强细节。结合这些改进,LP-Net在KITTI、NYUv2和TOFDC等户外与室内基准上均取得当前最优(SOTA)表现,并展现出更优的计算效率。提交时,LP-Net在官方KITTI排行榜上排名第一。
原文摘要 · Abstract (English)
Depth completion endeavors to reconstruct a dense depth map from sparse depth measurements, leveraging the information provided by a corresponding color image. Existing approaches mostly hinge on single-scale propagation strategies that iteratively ameliorate initial coarse depth estimates through pixel-level message passing. Despite their commendable outcomes, these techniques are frequently hampered by computational inefficiencies and a limited grasp of scene context. To circumvent these challenges, we introduce LP-Net, an innovative framework that implements a multi-scale, progressive prediction paradigm based on Laplacian Pyramid decomposition. Diverging from propagation-based approaches, LP-Net initiates with a rudimentary, low-resolution depth prediction to encapsulate the global scene context, subsequently refining this through successive upsampling and the reinstatement of high-frequency details at incremental scales. We have developed two novel modules to bolster this strategy: 1) the Multi-path Feature Pyramid module, which segregates feature maps into discrete pathways, employing multi-scale transformations to amalgamate comprehensive spatial information, and 2) the Selective Depth Filtering module, which dynamically learns to apply both smoothness and sharpness filters to judiciously mitigate noise while accentuating intricate details. By integrating these advancements, LP-Net not only secures state-of-the-art (SOTA) performance across both outdoor and indoor benchmarks such as KITTI, NYUv2, and TOFDC, but also demonstrates superior computational efficiency. At the time of submission, LP-Net ranks 1st among all peer-reviewed methods on the official KITTI leaderboard.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。