构建物理驱动的透明液体数据集,助力机器人精准感知液态形状与体积。
Phys-Liquid: A Physics-Informed Dataset for Estimating 3D Geometry and Volume of Transparent Deformable Liquids
- 基于物理模拟生成97,200张带3D网格的液体图像
- 在多场景、多光照下实现几何与体积重建精度提升
- 适合机器人液体操作与视觉感知研究者使用
由于光学复杂性和容器运动引发的动态表面变形,估计透明可变形液体的几何与体积属性极具挑战。自主机器人执行精确液体操作(如分配、吸取、混合)时,不可避免地引发液体形变,导致状态评估困难。现有数据集缺乏涵盖多样动态场景的物理驱动仿真数据。为此,我们提出Phys-Liquid,一个包含97,200组仿真图像与对应3D网格的数据集,覆盖多个实验室场景、光照条件、液体颜色及容器旋转。为验证其真实性和有效性,我们设计四阶段重建与估计算法:液体分割、多视角掩码生成、3D网格重建与真实尺度校准。实验表明,该方法在液体几何与体积重建上显著优于现有基准。数据集与代码已公开于https://dualtransparency.github.io/Phys-Liquid/。
原文摘要 · Abstract (English)
Estimating the geometric and volumetric properties of transparent deformable liquids is challenging due to optical complexities and dynamic surface deformations induced by container movements. Autonomous robots performing precise liquid manipulation tasks, such as dispensing, aspiration, and mixing, must handle containers in ways that inevitably induce these deformations, complicating accurate liquid state assessment. Current datasets lack comprehensive physics-informed simulation data representing realistic liquid behaviors under diverse dynamic scenarios. To bridge this gap, we introduce Phys-Liquid, a physics-informed dataset comprising 97,200 simulation images and corresponding 3D meshes, capturing liquid dynamics across multiple laboratory scenes, lighting conditions, liquid colors, and container rotations. To validate the realism and effectiveness of Phys-Liquid, we propose a four-stage reconstruction and estimation pipeline involving liquid segmentation, multi-view mask generation, 3D mesh reconstruction, and real-world scaling. Experimental results demonstrate improved accuracy and consistency in reconstructing liquid geometry and volume, outperforming existing benchmarks. The dataset and associated validation methods facilitate future advancements in transparent liquid perception tasks. The dataset and code are available at https://dualtransparency.github.io/Phys-Liquid/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。