arXiv:2411.03239cs.CV2024-11CVPR被引 10

分离细节与全局结构,提升压缩深度图的超分辨率效果

Decoupling Fine Detail and Global Geometry for Compressed Depth Map Super-Resolution

  • 分两路处理:一路抓精细细节,一路提取全局几何
  • 在多个数据集上优于现有方法,获ECCV 2024挑战赛第一名
  • 适合需要高精度深度图的自动驾驶与三维重建场景

由于消费级深度相机的限制以及数据传输带宽的约束,从压缩源恢复高质量深度图受到广泛关注。然而,当前方法仍面临两大挑战:一是位深压缩导致细微变化区域呈现均匀深度表示,阻碍细节恢复;二是密集分布的随机噪声降低场景全局几何结构估计的准确性。为此,我们提出一种新颖框架——几何解耦网络(GDNet),通过分离处理全局与细节几何特征来实现高质量深度图重建。具体而言,设计细粒度几何细节编码器(FGDE),在高分辨率低层特征中聚合精细几何细节,同时融合低分辨率上下文特征的互补信息;开发全局几何编码器(GGE),通过在低秩空间构建紧凑特征表示,有效抑制噪声并提取全局几何信息。我们在多个基准数据集上进行实验,结果表明GDNet在几何一致性与细节恢复方面显著优于现有方法。在ECCV 2024 AIM压缩深度上采样挑战赛中,我们的方案获得第一名。代码已开源:https://github.com/Ian0926/GDNet。

原文摘要 · Abstract (English)

Recovering high-quality depth maps from compressed sources has gained significant attention due to the limitations of consumer-grade depth cameras and the bandwidth restrictions during data transmission. However, current methods still suffer from two challenges. First, bit-depth compression produces a uniform depth representation in regions with subtle variations, hindering the recovery of detailed information. Second, densely distributed random noise reduces the accuracy of estimating the global geometric structure of the scene. To address these challenges, we propose a novel framework, termed geometry-decoupled network (GDNet), for compressed depth map super-resolution that decouples the high-quality depth map reconstruction process by handling global and detailed geometric features separately. To be specific, we propose the fine geometry detail encoder (FGDE), which is designed to aggregate fine geometry details in high-resolution low-level image features while simultaneously enriching them with complementary information from low-resolution context-level image features. In addition, we develop the global geometry encoder (GGE) that aims at suppressing noise and extracting global geometric information effectively via constructing compact feature representation in a low-rank space. We conduct experiments on multiple benchmark datasets, demonstrating that our GDNet significantly outperforms current methods in terms of geometric consistency and detail recovery. In the ECCV 2024 AIM Compressed Depth Upsampling Challenge, our solution won the 1st place award. Our codes are available at: https://github.com/Ian0926/GDNet.

深度图超分几何解耦压缩图像三维重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。