arXiv:2604.24586cs.CV2026-04

用一步生成法实现单图点云重建,速度快质量高。

Point-MF: One-step Point Cloud Generation from a Single Image via Mean Flows

论文配图:Point-MF: One-step Point Cloud Generation from a Single Image via Mean Flows
图 1 · 摘自论文原文
  • 直接在点云空间建模平均流,仅需一次网络计算(1-NFE)
  • 在ShapeNet-R2N2和Pix3D上达到与多步扩散模型相当的精度
  • 适合需要毫秒级延迟的实时点云生成应用

单图像点云重建需从单一RGB图像推断完整3D结构,包括被遮挡部分。尽管基于扩散的方法精度高,但通常需要多次去噪迭代,导致推理慢且成本高。我们提出Point-MF,一种基于平均流的低阶数(low-NFE)单图像点云重建框架,将兼容平均流的架构与辅助损失结合。Point-MF直接在点云空间学习均值速度场,支持仅通过一次网络函数评估(1-NFE)完成重建,无需依赖VAE隐表示。为提升大步长跳跃下的有效性,采用适配平均流设置的扩散变压器,基于冻结的DINOv3图像特征,通过轻量级标记适配器进行条件控制,并显式引入时间间隔条件。此外,引入去噪空间锚点(Denoised Space Anchor)作为辅助损失,在由预测速度场诱导的去噪空间估计 $x_θ$ 上优化,以稳定大步长生成,减少异常点和密度伪影。在ShapeNet-R2N2和Pix3D数据集上,Point-MF在重建质量与推理速度间取得良好平衡,优于多步扩散基线和竞争性前馈模型,且生成点云具有毫秒级延迟。

原文摘要 · Abstract (English)

Single-image point cloud reconstruction must infer complete 3D geometry, including occluded parts, from a single RGB image. While diffusion-based reconstructors achieve high accuracy, they typically require many denoising iterations, resulting in slow and expensive inference. We propose Point-MF, a Mean-Flow-based framework for low-NFE single-image point cloud reconstruction that couples a Mean-Flow-compatible architecture with an auxiliary loss. Specifically, Point-MF operates directly in point-cloud space to learn the mean velocity field and enables one-step reconstruction with a single network function evaluation (1-NFE), without relying on VAE-based latent representations. To make Mean Flow effective under large interval jumps, Point-MF employs a Diffusion Transformer tailored to the Mean-Flow setting, conditioned on frozen DINOv3 image features via a lightweight token adapter and equipped with explicit interval/time conditioning. Moreover, we introduce Denoised Space Anchor, a set-distance auxiliary loss on the denoised-space estimate $x_θ$ induced by the predicted velocity field, to stabilize large-step generation and reduce outliers and density artifacts. On ShapeNet-R2N2 and Pix3D, Point-MF strikes a strong balance between reconstruction quality and inference speed compared to multi-step diffusion baselines and competitive feedforward models, while generating high-quality point clouds with millisecond-level latency.

点云生成平均流单图像重建实时生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。