让物理模拟器无需预先知道材料属性,直接从点云推断并准确模拟。
Point Cloud Sequence Encoding for Material-conditioned Graph Network Simulators

- 用点云序列编码实现推理时的上下文学习,自适应未知材料参数。
- 零样本迁移在动态场景中表现优于基于网格的基线模型。
- 适合真实实验部署,无需重建网格,更贴近实际观测数据。
图网络模拟器(GNS)作为复杂物理仿真强大的替代方案,具备天然可微性且比传统求解器快数个数量级。然而,GNS通常依赖已知的材料参数(如刚度或粘度),严重限制了其在真实实验中的应用。尽管近期元学习方法通过从网格轨迹推断属性缓解了这一问题,但从观测场景重建网格仍具挑战。本文提出点云上下文处理框架PEACH,通过在点云序列上应用上下文学习,在推理阶段适配未见的物理属性。该方法依赖新颖的时空点云序列编码器,以及两种辅助监督形式以提升模拟保真度。实验表明,PEACH在复杂动态场景中实现了精准的零样本模拟到现实迁移。在多个模拟场景中,其预测精度甚至超越基于网格的基线模型,同时在真实世界部署中更具实用性。
原文摘要 · Abstract (English)
Graph Network Simulators (GNSs) have emerged as powerful surrogates for complex physics-based simulation, offering inherent differentiability and orders-of-magnitude speedups over traditional solvers. However, GNSs typically assume access to the underlying material parameters, such as stiffness or viscosity, severely limiting their utility in realistic experimental settings. While recent meta-learning approaches address the parameter dependency by inferring properties from mesh trajectories, reconstructing a mesh from an observed scene is challenging. In this work, we introduce Point Cloud Encoding for Accurate Context Handling (PEACH), a novel framework that applies in-context learning on point clouds to adapt a learned simulator to unseen physical properties during inference. Our approach relies on a novel spatio-temporal point cloud sequence encoder, as well as two forms of auxiliary supervision to help improve simulation fidelity. We demonstrate that PEACH is capable of accurate zero-shot sim-to-real transfer on a challenging, dynamic scene. Experiments on simulation scenes show that PEACH even outperforms mesh-based baselines on prediction accuracy, while being much more practical for real-world deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。