仅用150万参数的轻量适配器,显著提升3D高斯点云重建精度与泛化能力。
AdaptSplat: Adapting Vision Foundation Models for Feed-Forward 3D Gaussian Splatting

- 在通用架构中加入轻量频域保持适配器,提取浅层高频结构先验。
- 在多个基准上达到顶尖重建效果,复杂表面与锐边还原更准确。
- 适合需要高效、高保真3D重建的视觉与图形应用开发者。
本文提出AdaptSplat,一种面向前馈式3D高斯点云渲染(3DGS)的轻量级适配器设计。现有方法通常在通用流程(图像特征提取→多视角交互→特征解码)上引入复杂、架构特定的组件,受限于3D训练数据规模瓶颈及深层网络的低通滤波效应,跨域泛化与高频几何保真度仍不足。为解决此问题,我们证明:仅在通用架构中引入一个150万参数的适配器,即可实现卓越性能。具体而言,设计了轻量级频域保持适配器(FPA),从强大视觉基础模型的浅层特征中提取方向感知的高频结构先验,并通过高频位置编码与自适应残差调制,无缝融入通用流程。该机制有效补偿深层特征过度平滑导致的高频衰减,提升高斯原型对复杂曲面与锐边的拟合精度。大量实验表明,AdaptSplat在多个标准基准上达到前馈重建的最先进水平,且跨域泛化稳定。代码已开源:https://github.com/xmw666/AdaptSplat。
原文摘要 · Abstract (English)
This work explores a simple yet powerful lightweight adapter design for feed-forward 3D Gaussian Splatting (3DGS). Existing methods typically apply complex, architecture-specific designs on top of the generic pipeline of image feature extraction $\rightarrow$ multi-view interaction $\rightarrow$ feature decoding. However, constrained by the scale bottleneck of 3D training data and the low-pass filtering effect of deep networks, these methods still fall short in cross-domain generalization and high-frequency geometric fidelity. To address these problems, we propose AdaptSplat, which demonstrates that without complex component engineering, introducing a single adapter of only 1.5M parameters into the generic architecture is sufficient to achieve superior performance. Specifically, we design a lightweight Frequency-Preserving Adapter (FPA) that extracts direction-aware high-frequency structural priors from the shallow features of a powerful vision foundation model backbone, and seamlessly integrates them into the generic pipeline via high-frequency positional encodings and adaptive residual modulation. This effectively compensates for the high-frequency attenuation caused by over-smoothing in deep features, improving the fitting accuracy of Gaussian primitives on complex surfaces and sharp boundaries. Extensive experiments demonstrate that AdaptSplat achieves state-of-the-art feed-forward reconstruction performance on multiple standard benchmarks, with stable generalization across domains. Code available at: https://github.com/xmw666/AdaptSplat.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。