用多尺度渐进预测,让点云自回归生成首次达到顶尖质量。
PointNSP: Autoregressive 3D Point Cloud Generation with Next-Scale Level-of-Detail Prediction
- 分阶段生成:从低分辨率全局结构到高精度细节,逐步细化。
- 在ShapeNet上首次实现自回归生成的最先进水平,8192点生成更优。
- 比扩散模型更省参数、训练和推理成本,适合高效生成场景。
自回归点云生成长期落后于扩散模型。其性能差距源于模型人为施加了无序点集的序列顺序,导致生成过程依赖局部连续性,难以捕捉长程依赖,影响对对称性、一致拓扑和大尺度几何规律等全局结构的建模。受形状建模中层次细节(LOD)原理启发,我们提出PointNSP,一种从粗到精的生成框架,通过下一尺度预测机制,在低分辨率保持全局结构,并逐级细化高阶几何细节。该多尺度分解使自回归目标与点集的置换不变性对齐,支持同尺度内丰富交互,避免脆弱的固定顺序。在ShapeNet上的实验表明,PointNSP首次在自回归范式中达到状态领先生成质量。此外,其在参数量、训练和推理效率上超越强扩散基线。在包含8192个点的密集生成任务中,优势更为显著,凸显其可扩展潜力。
原文摘要 · Abstract (English)
Autoregressive point cloud generation has long lagged behind diffusion-based approaches in quality. The performance gap stems from the fact that autoregressive models impose an artificial ordering on inherently unordered point sets, forcing shape generation to proceed as a sequence of local predictions. This sequential bias emphasizes short-range continuity but undermines the model's capacity to capture long-range dependencies, hindering its ability to enforce global structural properties such as symmetry, consistent topology, and large-scale geometric regularities. Inspired by the level-of-detail (LOD) principle in shape modeling, we propose PointNSP, a coarse-to-fine generative framework that preserves global shape structure at low resolutions and progressively refines fine-grained geometry at higher scales through a next-scale prediction paradigm. This multi-scale factorization aligns the autoregressive objective with the permutation-invariant nature of point sets, enabling rich intra-scale interactions while avoiding brittle fixed orderings. Experiments on ShapeNet show that PointNSP establishes state-of-the-art (SOTA) generation quality for the first time within the autoregressive paradigm. In addition, it surpasses strong diffusion-based baselines in parameter, training, and inference efficiency. Finally, in dense generation with 8,192 points, PointNSP's advantages become even more pronounced, underscoring its scalability potential.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。