TSGS提升透明物体3D重建精度,兼顾几何准确与视觉真实。
TSGS: Improving Gaussian Splatting for Transparent Surface Reconstruction via Normal and De-lighting Priors
- 分两阶段重建:先用去镜面输入学几何,再用各向异性建模保精度
- 在TransLab数据集上,切比雪夫距离降低37.3%,F1分数提升8.0%
- 适合需要高精度透明物体重建的机器人操作、工业检测等场景
透明表面重建对实验室机器人操作等任务至关重要,但传统3D高斯点云渲染(3DGS)因标准α混合导致透明-深度矛盾,严重损害几何精度。为此,本文提出透明表面高斯点云(TSGS),将几何学习与外观优化分离:第一阶段使用抑制镜面反射的输入专注几何建模;第二阶段通过各向异性镜面建模提升视觉真实感,同时保持已确定的不透明度以保障几何准确性。为增强深度推断,TSGS采用首表面深度提取方法,利用α混合权重滑动窗口定位最可能表面位置,并计算稳健加权平均深度。为评估真实场景下的表现,构建包含复杂透明实验器皿的TransLab数据集。大量实验证明,TSGS在高效3DGS框架内实现了几何精确与渲染逼真双重突破,相比最优基线,切比雪夫距离减少37.3%,F1得分提升8.0%。代码与数据集已公开于https://longxiang-ai.github.io/TSGS/。
原文摘要 · Abstract (English)
Reconstructing transparent surfaces is essential for tasks such as robotic manipulation in labs, yet it poses a significant challenge for 3D reconstruction techniques like 3D Gaussian Splatting (3DGS). These methods often encounter a transparency-depth dilemma, where the pursuit of photorealistic rendering through standard $α$-blending undermines geometric precision, resulting in considerable depth estimation errors for transparent materials. To address this issue, we introduce Transparent Surface Gaussian Splatting (TSGS), a new framework that separates geometry learning from appearance refinement. In the geometry learning stage, TSGS focuses on geometry by using specular-suppressed inputs to accurately represent surfaces. In the second stage, TSGS improves visual fidelity through anisotropic specular modeling, crucially maintaining the established opacity to ensure geometric accuracy. To enhance depth inference, TSGS employs a first-surface depth extraction method. This technique uses a sliding window over $α$-blending weights to pinpoint the most likely surface location and calculates a robust weighted average depth. To evaluate the transparent surface reconstruction task under realistic conditions, we collect a TransLab dataset that includes complex transparent laboratory glassware. Extensive experiments on TransLab show that TSGS achieves accurate geometric reconstruction and realistic rendering of transparent objects simultaneously within the efficient 3DGS framework. Specifically, TSGS significantly surpasses current leading methods, achieving a 37.3% reduction in chamfer distance and an 8.0% improvement in F1 score compared to the top baseline. The code and dataset are available at https://longxiang-ai.github.io/TSGS/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。