arXiv:2412.11680cs.CV2024-12被引 1

提升RGB-D相机点云分辨率,精准保留边缘细节。

EGP3D: Edge-guided Geometric Preserving 3D Point Cloud Super-resolution for RGB-D camera

  • 在2D投影空间加入边缘约束,优化3D点云重建。
  • 多损失函数协同优化,显著提升边缘清晰度与几何保真度。
  • 自建真实场景数据集,涵盖噪声与杂光干扰,适合实际应用。

当前RGB-D相机捕获的点云或深度图像常因分辨率低,难以满足三维重建与机器人等应用需求。现有点云超分辨率(PCSR)方法或存在几何失真,或忽略边缘细节。为此,我们提出专为RGB-D相机设计的边缘引导几何保真点云超分辨率方法(EGP3D)。该方法创新性地在投影的2D空间施加边缘约束,确保3D PCSR任务中边缘质量。针对超分辨率点云的几何优化难题,特别是边缘形状与平滑性的保持,引入多目标损失函数,同时优化切比雪夫距离、豪斯多夫距离与梯度平滑性。现有用于点云上采样的数据集多为合成数据,未能充分反映真实世界中的噪声与杂光效应。为此,我们构建了包含真实世界噪声与杂光影响的数据集,更准确模拟实际环境。通过仿真与真实实验验证,所提方法在保持边缘清晰度与几何细节方面表现优异。

原文摘要 · Abstract (English)

Point clouds or depth images captured by current RGB-D cameras often suffer from low resolution, rendering them insufficient for applications such as 3D reconstruction and robots. Existing point cloud super-resolution (PCSR) methods are either constrained by geometric artifacts or lack attention to edge details. To address these issues, we propose an edge-guided geometric-preserving 3D point cloud super-resolution (EGP3D) method tailored for RGB-D cameras. Our approach innovatively optimizes the point cloud with an edge constraint on a projected 2D space, thereby ensuring high-quality edge preservation in the 3D PCSR task. To tackle geometric optimization challenges in super-resolution point clouds, particularly preserving edge shapes and smoothness, we introduce a multi-faceted loss function that simultaneously optimizes the Chamfer distance, Hausdorff distance, and gradient smoothness. Existing datasets used for point cloud upsampling are predominantly synthetic and inadequately represent real-world scenarios, neglecting noise and stray light effects. To address the scarcity of realistic RGB-D data for PCSR tasks, we built a dataset that captures real-world noise and stray-light effects, offering a more accurate representation of authentic environments. Validated through simulations and real-world experiments, the proposed method exhibited superior performance in preserving edge clarity and geometric details.

点云超分边缘保持RGB-D几何保真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。