arXiv:2606.32036cs.CV2026-06

用3D点直接预测高斯分布,让人体三维重建更紧凑高效。

PointSplat: Compact Gaussian Splatting via Human-Centric Prediction

论文配图:PointSplat: Compact Gaussian Splatting via Human-Centric Prediction
图 1 · 摘自论文原文
  • 在3D空间直接预测高斯点,避免多视角重复编码
  • 减少70%以上高斯数量,同时提升新视角渲染质量
  • 适合实时直播等对效率要求高的场景

从输入视角实时生成3D人体表示是沉浸式直播系统的关键,其中表示紧凑性与高保真度同样重要,受限于计算资源和传输带宽。尽管现有前馈重建方法通过视图中心预测实现出色质量,但会在多个视图间重复编码同一主体内容,造成显著的跨视图冗余。我们的核心洞察是直接在3D空间进行预测,使网络学习并生成高度紧凑的表示。为此,我们提出PointSplat,一种新型的人体中心方法,直接从输入点集推断高斯基元。该方法首先估计粗略几何代理,并通过射线投射剔除冗余点并建立显式的2D-3D对应关系。随后,采用点-图像变换器融合外观与几何特征,在单次前向传播中预测高斯属性。此设计将预测限制在感兴趣前景区域,大幅减少高斯总数,同时提升新视角渲染质量。大量实验表明,PointSplat在多个数据集上均实现更高效率与质量,并对视图数量和图像分辨率变化表现出强鲁棒性。

原文摘要 · Abstract (English)

Producing 3D human representations from input views on the fly is essential for immersive live streaming systems, where representation compactness is as critical as high fidelity given limited computational power and transmission bandwidth. Although recent feed-forward reconstruction methods achieve impressive quality through the view-centric prediction of 3D representations, they repeatedly encode the same subject content across multiple views, leading to significant inter-view redundancy. Our key insight is to perform predictions directly in 3D space, enabling the network to learn and produce a highly compact representation. To this end, we propose PointSplat, a novel human-centric approach that directly infers Gaussian primitives from an input point set. The proposed method first estimates a coarse geometric proxy and performs ray casting to prune redundant points and establish explicit 2D--3D correspondences. Subsequently, it employs a Point-Image Transformer to fuse appearance and geometry features, predicting Gaussian attributes in a single forward pass. This design restricts predictions to foreground regions of interest, substantially reducing the total number of Gaussians while improving novel-view rendering quality. Extensive experiments demonstrate that PointSplat achieves higher efficiency and quality while exhibiting strong robustness to variations in view count and image resolution across multiple datasets.

3D重建高斯溅射人体建模实时渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。