arXiv:2509.10125eess.IV2025-09被引 3

用图神经网络实现软组织形变与受力的高效预测,支持实时手术模拟。

Soft Tissue Simulation and Force Estimation from Heterogeneous Structures using Equivariant Graph Neural Networks

  • 基于等变图神经网络,融合内部解剖结构信息进行点云建模。
  • 在旋转和不同密度场景下表现优异,形变误差低于1毫米。
  • 速度快于传统方法,适合交互式手术训练系统使用。

精确模拟软组织形变对术前规划、手术训练和实时触觉反馈至关重要。尽管有限元法(FEM)能提供高保真结果,但计算成本高且需复杂预处理。我们提出一种图神经网络(GNN)架构,从稀疏点云中同时预测组织表面形变和施加力。模型通过每个点下的二值组织剖面引入内部解剖信息,并利用E(n)-等变消息传递提升鲁棒性。我们采集了包含真实硅胶与骨样假体的实验数据,并补充了基于FEM生成的合成模拟数据。模型在标准测试中表现接近基线GNN,但在旋转和跨分辨率场景下显著优于基线,展现出对未见朝向和点密度的良好泛化能力。同时具备显著提速优势,适用于实时应用。在实验数据微调后,即使样本量有限且存在测量噪声,仍保持亚毫米级形变精度。结果表明,该方法为传统模拟提供了高效的数据驱动替代方案,可泛化于多种解剖构型,支持交互式手术环境。

原文摘要 · Abstract (English)

Accurately simulating soft tissue deformation is crucial for surgical training, pre-operative planning, and real-time haptic feedback systems. While physics-based models such as the finite element method (FEM) provide high-fidelity results, they are often computationally expensive and require extensive preprocessing. We propose a graph neural network (GNN) architecture that predicts both tissue surface deformation and applied force from sparse point clouds. The model incorporates internal anatomical information through binary tissue profiles beneath each point and leverages E(n)-equivariant message passing to improve robustness. We collected experimental data that comprises a real silicone and bone-like phantom, and complemented it with synthetic simulations generated using FEM. Our model achieves a comparable performance to a baseline GNN on standard test cases and significantly outperforms it in rotated and cross-resolution scenarios, showing a strong generalization to unseen orientations and point densities. It also achieves a significant speed improvement, offering a solution for real-time applications. When fine-tuned on experimental data, the model maintains sub-millimeter deformation accuracy despite limited sample size and measurement noise. The results demonstrate that our approach offers an efficient, data-driven alternative to traditional simulations, capable of generalizing across anatomical configurations and supporting interactive surgical environments.

软组织模拟图神经网络等变模型手术仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。