无需微调即可模拟新形状的物理系统,实时融合视觉与物理推理。
A Graph Neural Network approach to zero-shot Digital Twins

- 用图神经网络建模物理守恒律,实现几何无关的物理推理。
- 在两种不同物理场景中成功模拟未见过的新几何结构,延迟仅25毫秒/帧。
- 适合需要快速部署、跨场景泛化的工业仿真与增强现实应用。
传统预测型数字孪生通常保持几何刚性,当物理域或边界条件改变时需大量重训或微调。为此,我们提出一种新型零样本数字孪生框架,将实时视觉感知与几何无关、物理驱动的推理引擎无缝结合。核心是热力学信息图神经网络架构,基于度量-辛热力学形式,通过图消息传递局部强制能量守恒与非负熵产生。附加图神经网络可从稀疏初始视觉边界直接推断不可观测场(如应力张量、速度与能量分布),缓解数值启动瞬态。为弥合仿真到真实差距,采用连续闭环数据同化机制:利用深度分割网络与稀疏光流实时追踪宏观形变与自由表面流体边界,动态修正自回归仿真演进,消除数值漂移。我们在两个差异显著的物理场景中验证方法有效性:粘弹性梁的大变形与黏性流体的非线性晃动。统一框架在未见几何上实现了物理准确模拟,无需特定案例重训,运行延迟约25毫秒/帧,支持通过增强现实直接投影潜在机械变量。
原文摘要 · Abstract (English)
Traditional Predictive Digital Twins often remain geometrically rigid, requiring extensive retraining or fine-tuning whenever the underlying physical domain or boundary conditions change. To overcome this limitation, we present a novel framework for \textit{Zero-Shot Digital Twins} that seamlessly couples real-time visual perception with a geometry-agnostic, physics-informed reasoning engine. At the core of our architecture is the Thermodynamics-Informed Graph Neural Network architecture, a Geometric Deep Learning solver grounded in a metriplectic thermodynamic formalism that enforces energy conservation and non-negative entropy production locally through graph message passing. The framework integrates an auxiliary Graph Neural Network to infer unobservable fields (such as stress tensors or velocity and energy distributions) directly from sparse initial visual boundaries, mitigating numerical start-up transients. To bridge the sim-to-real gap, we implement a continuous closed-loop data assimilation mechanism; the pipeline tracks macroscopic deformations and free-surface fluid boundaries in real-time using deep segmentation networks combined with sparse optical flow, dynamically correcting the autoregressive simulation rollout and eliminating numerical drift. To test the validity of our approach, we demonstrate the extreme generalization capabilities of our approach across two disparate physical regimes: the large deformations of a viscoelastic beam and the non-linear sloshing of a viscous fluid. In both scenarios, the unified framework instantiates physically accurate simulations on novel, unseen geometries without case-specific retraining, operating well within real-time latency budgets (approximately 25 ms per frame) and enabling the direct projection of latent mechanical variables via Augmented Reality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。