直接分解点云的明暗成分,实现真实光照下的纹理编辑与重光照。
IPCD: Intrinsic Point-Cloud Decomposition
- 提出IPCD-Net,通过点级特征聚合处理非网格点云数据。
- 引入PLD机制,通过多视角投影捕捉全局光照方向,提升阴影准确性。
- 在合成与真实场景中验证效果,适用于纹理编辑与光照变化下的点云配准。
点云广泛应用于增强现实与机器人等领域,其中光照重置与纹理编辑对真实感可视化至关重要。这需要准确分离反照率与阴影。然而,点云的非网格结构使传统图像分解模型失效,且现有点云模型未显式考虑全局光照方向,导致阴影不准确。本文提出内在点云分解(IPCD),直接将彩色点云分解为反照率与阴影。针对第一个挑战,设计IPCD-Net,通过点级特征聚合扩展图像模型以处理非网格数据;针对第二个挑战,引入基于投影的亮度分布(PLD)与分层特征精炼,通过多视角投影捕捉全局光照线索。构建了合成户外场景数据集用于全面评估。实验表明,IPCD-Net有效减少反照率中的投射阴影,并提升阴影的颜色准确性。进一步展示了其在纹理编辑、重光照及不同光照条件下的点云配准中的应用。最后验证了方法在真实场景中的适用性。
原文摘要 · Abstract (English)
Point clouds are widely used in various fields, including augmented reality (AR) and robotics, where relighting and texture editing are crucial for realistic visualization. Achieving these tasks requires accurately separating albedo from shade. However, performing this separation on point clouds presents two key challenges: (1) the non-grid structure of point clouds makes conventional image-based decomposition models ineffective, and (2) point-cloud models designed for other tasks do not explicitly consider global-light direction, resulting in inaccurate shade. In this paper, we introduce \textbf{Intrinsic Point-Cloud Decomposition (IPCD)}, which extends image decomposition to the direct decomposition of colored point clouds into albedo and shade. To overcome challenge (1), we propose \textbf{IPCD-Net} that extends image-based model with point-wise feature aggregation for non-grid data processing. For challenge (2), we introduce \textbf{Projection-based Luminance Distribution (PLD)} with a hierarchical feature refinement, capturing global-light ques via multi-view projection. For comprehensive evaluation, we create a synthetic outdoor-scene dataset. Experimental results demonstrate that IPCD-Net reduces cast shadows in albedo and enhances color accuracy in shade. Furthermore, we showcase its applications in texture editing, relighting, and point-cloud registration under varying illumination. Finally, we verify the real-world applicability of IPCD-Net.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。