通过多视角自投影增强,实现点云的全局与局部细节修复。
PointSea: Point Cloud Completion via Self-structure Augmentation
- 利用多视角自投影深度图增强点云表示
- 双路径生成器按结构类型自适应细化点
- 在多个基准上优于现有方法,兼顾全局形状与局部细节
点云补全是3D视觉中的基础但未完全解决的问题。现有方法通常依赖3D坐标信息或额外数据(如图像、扫描视角)来填补缺失部分。不同于这些方法,本文提出PointSea,一种从全局到局部的点云补全框架。在全局阶段,受人类观察缺陷物体时多角度观察的启发,PointSea通过多视角自投影深度图增强数据表示,并引入跨模态特征融合模块,在视图内与视图间层次上融合特征,以重建紧凑的全局形状。在局部阶段,设计一种自结构双生成器,结合学习到的形状先验与几何自相似性,进行形状精炼。与以往对所有点采用统一策略不同,该双路径结构根据每个点的结构类型自适应调整修复策略,有效应对不同点的不完整问题。在多个常用基准上的实验表明,PointSea能有效理解全局形状并从不完整输入生成精细局部细节,显著优于现有方法。
原文摘要 · Abstract (English)
Point cloud completion is a fundamental yet not well-solved problem in 3D vision. Current approaches often rely on 3D coordinate information and/or additional data (e.g., images and scanning viewpoints) to fill in missing parts. Unlike these methods, we explore self-structure augmentation and propose PointSea for global-to-local point cloud completion. In the global stage, consider how we inspect a defective region of a physical object, we may observe it from various perspectives for a better understanding. Inspired by this, PointSea augments data representation by leveraging self-projected depth images from multiple views. To reconstruct a compact global shape from the cross-modal input, we incorporate a feature fusion module to fuse features at both intra-view and inter-view levels. In the local stage, to reveal highly detailed structures, we introduce a point generator called the self-structure dual-generator. This generator integrates both learned shape priors and geometric self-similarities for shape refinement. Unlike existing efforts that apply a unified strategy for all points, our dual-path design adapts refinement strategies conditioned on the structural type of each point, addressing the specific incompleteness of each point. Comprehensive experiments on widely-used benchmarks demonstrate that PointSea effectively understands global shapes and generates local details from incomplete input, showing clear improvements over existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。