arXiv:2507.11069cs.ROcs.CV2025-07ICCV被引 3

用物理仿真提升透明物体深度重建,支持动态场景快速更新。

TRAN-D: 2D Gaussian Splatting-based Sparse-view Transparent Object Depth Reconstruction via Physics Simulation for Scene Update

  • 基于2D高斯点云分离透明物体与背景,聚焦优化对象几何。
  • 合成数据上均方误差降低超39%,单图更新精度达48.46%。
  • 适合需要快速更新的动态场景透明物体重建任务。

从RGB图像中理解透明物体的三维几何结构极具挑战,因其固有的反射与折射特性。针对稀疏视角和动态环境下的难题,本文提出TRAN-D,一种基于2D高斯点云的透明物体深度重建方法。核心思路是将透明物体与背景分离,从而对物体对应的高斯分布进行专注优化。通过引入对象感知损失,将高斯点置于被遮挡区域,确保不可见表面的覆盖并减少过拟合。此外,结合物理模拟仅需数秒即可完成重建优化,有效处理物体移除及剩余物体的链式运动,无需重新扫描。在合成与真实序列上的实验表明,TRAN-D显著优于现有基于高斯溅射(GS)的先进方法。相比基线,其在合成TRansPose序列上平均绝对误差降低超过39%;尽管仅使用一张图像更新,仍达到δ < 2.5厘米精度48.46%,是基线(使用六张图像)的1.5倍以上。代码与更多结果详见:https://jeongyun0609.github.io/TRAN-D/。

原文摘要 · Abstract (English)

Understanding the 3D geometry of transparent objects from RGB images is challenging due to their inherent physical properties, such as reflection and refraction. To address these difficulties, especially in scenarios with sparse views and dynamic environments, we introduce TRAN-D, a novel 2D Gaussian Splatting-based depth reconstruction method for transparent objects. Our key insight lies in separating transparent objects from the background, enabling focused optimization of Gaussians corresponding to the object. We mitigate artifacts with an object-aware loss that places Gaussians in obscured regions, ensuring coverage of invisible surfaces while reducing overfitting. Furthermore, we incorporate a physics-based simulation that refines the reconstruction in just a few seconds, effectively handling object removal and chain-reaction movement of remaining objects without the need for rescanning. TRAN-D is evaluated on both synthetic and real-world sequences, and it consistently demonstrated robust improvements over existing GS-based state-of-the-art methods. In comparison with baselines, TRAN-D reduces the mean absolute error by over 39% for the synthetic TRansPose sequences. Furthermore, despite being updated using only one image, TRAN-D reaches a δ < 2.5 cm accuracy of 48.46%, over 1.5 times that of baselines, which uses six images. Code and more results are available at https://jeongyun0609.github.io/TRAN-D/.

透明物体深度重建物理仿真动态更新

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。