用傅里叶分解分离点云的色彩与几何特征,提升表达能力
Fourier Decomposition for Explicit Representation of 3D Point Cloud Attributes
- 通过三维傅里叶分解解耦颜色与几何特征
- 在DensePoint数据集上实现分类/分割/风格迁移的最新性能
- 适合需要精细点云属性建模的研究者
尽管3D点云在视觉应用中广泛使用,其不规则和稀疏特性使其难以处理。现有编码方法多聚焦于语义信息捕捉,但普遍忽视彩色点云——一种同时包含颜色与几何信息的更丰富表示。当前方法通常逐点独立处理颜色与几何,导致感受野受限,难以捕捉多点间关系。为此,本文提出首个基于3D傅里叶分解的彩色点云编码方法,通过频域操作解耦颜色与几何特征,并扩展感受野。分析表明,幅度分量唯一表征颜色属性,相位分量编码几何结构,支持两者的独立学习与利用。我们在分类、分割与风格迁移任务上验证该方法,在DensePoint数据集上取得当前最优结果。
原文摘要 · Abstract (English)
While 3D point clouds are widely used in vision applications, their irregular and sparse nature make them challenging to handle. In response, numerous encoding approaches have been proposed to capture the rich semantic information of point clouds. Yet, a critical limitation persists: a lack of consideration for colored point clouds, which serve as more expressive 3D representations encompassing both color and geometry. While existing methods handle color and geometry separately on a per-point basis, this leads to a limited receptive field and restricted ability to capture relationships across multiple points. To address this, we pioneer a colored point cloud encoding methodology that leverages 3D Fourier decomposition to disentangle color and geometric features while extending the receptive field through spectral-domain operations. Our analysis confirms that our approach effectively separates feature components, where the amplitude uniquely captures color attributes and the phase encodes geometric structure, thereby enabling independent learning and utilization of both attributes. We validate our colored point cloud encoding approach on classification, segmentation, and style transfer tasks, achieving state-of-the-art results on the DensePoint dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。