arXiv:2510.05613cs.CVcs.AI2025-10被引 8

通过多尺度渐进生成,让自回归点云模型首次达到顶尖质量

PointNSP: Autoregressive 3D Point Cloud Generation with Next-Scale Level-of-Detail Prediction

  • 采用下一尺度预测机制,分阶段生成点云结构
  • 在ShapeNet上超越现有自回归方法,8192点生成表现更优
  • 兼顾生成质量与效率,适合高分辨率点云生成任务

自回归点云生成长期落后于基于扩散的方法。其性能差距源于自回归模型人为施加了无序点集的序列顺序,导致形状生成依赖局部连续性预测,难以捕捉长程依赖,进而影响对对称性、拓扑一致性等全局结构的建模。受形状建模中层次细节(LOD)原则启发,本文提出PointNSP,一种从粗到细的生成框架:在低分辨率保留全局结构,通过下一尺度预测逐步细化高阶几何细节。该多尺度分解使自回归目标与点集排列不变性对齐,支持丰富的尺度内交互,避免刚性固定顺序。在ShapeNet上的实验表明,PointNSP首次在自回归范式中实现业界领先的质量。此外,其参数量、训练与推理效率均优于强基准的扩散模型。在包含8192个点的密集生成场景中,优势更加显著,凸显其可扩展潜力。

原文摘要 · Abstract (English)

Autoregressive point cloud generation has long lagged behind diffusion-based approaches in quality. The performance gap stems from the fact that autoregressive models impose an artificial ordering on inherently unordered point sets, forcing shape generation to proceed as a sequence of local predictions. This sequential bias emphasizes short-range continuity but undermines the model's capacity to capture long-range dependencies, hindering its ability to enforce global structural properties such as symmetry, consistent topology, and large-scale geometric regularities. Inspired by the level-of-detail (LOD) principle in shape modeling, we propose PointNSP, a coarse-to-fine generative framework that preserves global shape structure at low resolutions and progressively refines fine-grained geometry at higher scales through a next-scale prediction paradigm. This multi-scale factorization aligns the autoregressive objective with the permutation-invariant nature of point sets, enabling rich intra-scale interactions while avoiding brittle fixed orderings. Experiments on ShapeNet show that PointNSP establishes state-of-the-art (SOTA) generation quality for the first time within the autoregressive paradigm. In addition, it surpasses strong diffusion-based baselines in parameter, training, and inference efficiency. Finally, in dense generation with 8,192 points, PointNSP's advantages become even more pronounced, underscoring its scalability potential.

点云生成自回归多尺度高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。