arXiv:2507.05315cs.LGcs.AI2025-07被引 2

用图神经网络预测软组织形变与受力,精度达0.35毫米以内

Conditional Graph Neural Network for Predicting Soft Tissue Deformation and Forces

  • 基于条件图神经网络,输入表面点与施力位置,直接预测形变和反作用力
  • 形变误差0.35±0.03毫米(最大30毫米),力误差0.37±0.05牛(最大7.5牛)
  • 结合仿真与实验数据,适合医疗虚拟手术、触觉反馈等需要真实软组织模拟的场景

虚拟环境中软组织模拟在医疗应用中日益重要,但其高度可变形性带来挑战。现有方法依赖组织分割、网格构建及刚度参数估计,且触觉反馈需精确力估算以增强沉浸感。本文提出一种新型数据驱动模型——条件图神经网络(cGNN),以表面点坐标和施力位置为输入,直接预测点的形变及所受力。模型在软组织仿体的实验表面追踪数据上训练,并通过迁移学习先用质点弹簧仿真数据预训练,再用实验数据微调,提升泛化能力。结果表明,对于最大30毫米的形变,预测距离误差为0.35±0.03毫米;对于最大7.5牛的力,绝对误差为0.37±0.05牛。该数据驱动方法为虚拟环境中的软组织模拟提供了有效解决方案,不仅适用于医学仿真,还可拓展至其他需真实软组织模拟的领域。

原文摘要 · Abstract (English)

Soft tissue simulation in virtual environments is becoming increasingly important for medical applications. However, the high deformability of soft tissue poses significant challenges. Existing methods rely on segmentation, meshing and estimation of stiffness properties of tissues. In addition, the integration of haptic feedback requires precise force estimation to enable a more immersive experience. We introduce a novel data-driven model, a conditional graph neural network (cGNN) to tackle this complexity. Our model takes surface points and the location of applied forces, and is specifically designed to predict the deformation of the points and the forces exerted on them. We trained our model on experimentally collected surface tracking data of a soft tissue phantom and used transfer learning to overcome the data scarcity by initially training it with mass-spring simulations and fine-tuning it with the experimental data. This approach improves the generalisation capability of the model and enables accurate predictions of tissue deformations and corresponding interaction forces. The results demonstrate that the model can predict deformations with a distance error of 0.35$\pm$0.03 mm for deformations up to 30 mm and the force with an absolute error of 0.37$\pm$0.05 N for forces up to 7.5 N. Our data-driven approach presents a promising solution to the intricate challenge of simulating soft tissues within virtual environments. Beyond its applicability in medical simulations, this approach holds the potential to benefit various fields where realistic soft tissue simulations are required.

软组织模拟图神经网络触觉反馈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。