用Mamba提升点云生成效率与细节质量,速度提升9倍。
TFDM: Time-Variant Frequency-Based Point Cloud Diffusion with Mamba
- 通过隐空间重排点云为序列,适配Mamba建模长程依赖。
- 在ShapeNet-v2上达到0.14%的1-NNA-Abs50 EMD,计算参数减少10倍。
- 适合追求高效高质点云生成的3D视觉研究者。
扩散模型在各类生成任务中表现优异。近期图像生成研究显示,状态空间模型Mamba因高效处理长程依赖和序列数据而具备强大能力。然而,将Mamba与3D点云生成结合的研究仍有限。为此,我们提出一种新型扩散框架,包含双隐式Mamba模块(DM-Block)和时变频率编码器(TF-Encoder)。DM-Block利用空间填充曲线将点云重排为适合Mamba建模的序列,并在隐空间操作以降低直接处理3D数据带来的计算开销。TF-Encoder则借助扩散模型在后期阶段优化细节的能力,在U-Net架构中优先关注关键点,通过频率机制提升生成末期的细节质量。在ShapeNet-v2数据集上的实验表明,该方法在特定类别上达到当前最优性能(1-NNA-Abs50 EMD:0.14%,COV EMD:57.90%),同时计算参数和推理时间分别减少至1/10和1/9。源代码见补充材料,接受后将公开。
原文摘要 · Abstract (English)
Diffusion models currently demonstrate impressive performance over various generative tasks. Recent work on image diffusion highlights the strong capabilities of Mamba (state space models) due to its efficient handling of long-range dependencies and sequential data modeling. Unfortunately, joint consideration of state space models with 3D point cloud generation remains limited. To harness the powerful capabilities of the Mamba model for 3D point cloud generation, we propose a novel diffusion framework containing dual latent Mamba block (DM-Block) and a time-variant frequency encoder (TF-Encoder). The DM-Block apply a space-filling curve to reorder points into sequences suitable for Mamba state-space modeling, while operating in a latent space to mitigate the computational overhead that arises from direct 3D data processing. Meanwhile, the TF-Encoder takes advantage of the ability of the diffusion model to refine fine details in later recovery stages by prioritizing key points within the U-Net architecture. This frequency-based mechanism ensures enhanced detail quality in the final stages of generation. Experimental results on the ShapeNet-v2 dataset demonstrate that our method achieves state-of-the-art performance (ShapeNet-v2: 0.14\% on 1-NNA-Abs50 EMD and 57.90\% on COV EMD) on certain metrics for specific categories while reducing computational parameters and inference time by up to 10$\times$ and 9$\times$, respectively. Source code is available in Supplementary Materials and will be released upon accpetance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。