arXiv:2512.10267cs.CV2025-12被引 4

Long-LRM++用轻量解码器实现高保真实时360°场景重建。

Long-LRM++: Preserving Fine Details in Feed-Forward Wide-Coverage Reconstruction

  • 采用半显式表示结合轻量解码器,平衡精度与速度
  • 在A100上达14帧/秒,质量媲美LaCT模型
  • 支持64张输入图,对细节和深度预测更优

近期通用高斯点云(GS)进展已实现从数十张输入视图进行前向场景重建。Long-LRM将该范式扩展至32张输入图像(950×540分辨率),单次前向传播完成360°场景重建。然而,一次性预测数百万高斯参数极易出错:位置或属性微小偏差即导致明显模糊,尤其影响文字等精细结构。与此同时,隐式表示方法如LVSM和LaCT通过将场景信息压缩至模型权重中,并使用完整Transformer或TTT骨干网络解码RGB帧,显著提升渲染质量,但每帧解压计算开销大,难以实现实时渲染。这引发关键问题:深度序列“解压”过程是否必要?能否保留隐式表示优势的同时实现实时性能?本文提出Long-LRM++,采用半显式场景表示与轻量解码器,其在DL3DV数据集上渲染质量媲美LaCT,同时在A100 GPU上实现14 FPS实时渲染,突破了先前隐式方法的速度瓶颈。该设计还可扩展至64张输入图(950×540分辨率),展现强泛化能力。此外,Long-LRM++在ScanNetv2上的新视角深度预测优于直接从高斯点云渲染的结果。大量消融实验验证了各组件的有效性。

原文摘要 · Abstract (English)

Recent advances in generalizable Gaussian splatting (GS) have enabled feed-forward reconstruction of scenes from tens of input views. Long-LRM notably scales this paradigm to 32 input images at $950\times540$ resolution, achieving 360° scene-level reconstruction in a single forward pass. However, directly predicting millions of Gaussian parameters at once remains highly error-sensitive: small inaccuracies in positions or other attributes lead to noticeable blurring, particularly in fine structures such as text. In parallel, implicit representation methods such as LVSM and LaCT have demonstrated significantly higher rendering fidelity by compressing scene information into model weights rather than explicit Gaussians, and decoding RGB frames using the full transformer or TTT backbone. However, this computationally intensive decompression process for every rendered frame makes real-time rendering infeasible. These observations raise key questions: Is the deep, sequential "decompression" process necessary? Can we retain the benefits of implicit representations while enabling real-time performance? We address these questions with Long-LRM++, a model that adopts a semi-explicit scene representation combined with a lightweight decoder. Long-LRM++ matches the rendering quality of LaCT on DL3DV while achieving real-time 14 FPS rendering on an A100 GPU, overcoming the speed limitations of prior implicit methods. Our design also scales to 64 input views at the $950\times540$ resolution, demonstrating strong generalization to increased input lengths. Additionally, Long-LRM++ delivers superior novel-view depth prediction on ScanNetv2 compared to direct depth rendering from Gaussians. Extensive ablation studies validate the effectiveness of each component in the proposed framework.

3D重建实时渲染高斯点云隐式表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。