arXiv:2601.13676cs.LG2026-01

用深度学习实现神经外科手术中脑组织的实时动态模拟。

Autoregressive deep learning for real-time simulation of soft tissue dynamics during virtual neurosurgery

  • 基于自回归架构,直接处理大规模网格数据进行脑组织变形预测。
  • 在15万节点网格上实现低于10毫秒/步的推理速度,误差降低至3.5毫米。
  • 适合需要高保真交互式训练的虚拟神经外科场景使用。

精准模拟脑组织形变是构建真实、可交互神经外科模拟器的关键,因需捕捉复杂非线性形变以确保工具-组织交互的真实性。然而,传统数值求解器难以满足实时性能要求。为此,我们提出一种基于深度学习的代理模型,高效模拟手术器械与虚拟脑结构持续交互引起的瞬态脑组织形变。该方法基于通用物理变压器,直接处理大规模网格数据,并在由非线性有限元仿真生成的海量数据集上训练,覆盖广泛的时序器械-组织交互场景。为减少自回归推理中的误差累积,我们在训练中引入随机教师强制策略:通过短时随机滚动,逐步减少真实输入比例,增加模型生成预测的比例。结果表明,所提代理模型在多种瞬态脑组织形变场景下均实现准确高效预测,支持高达15万节点的网格规模。所提出的随机教师强制技术显著提升长期滚动稳定性,最大预测误差由6.7毫米降至3.5毫米。我们将训练好的代理模型集成至交互式神经外科模拟环境,在消费级硬件上实现每步低于10毫秒的运行时间。该深度学习框架实现了快速、平滑且精确的动态脑组织形变生物力学模拟,为真实手术训练环境奠定基础。

原文摘要 · Abstract (English)

Accurate simulation of brain deformation is a key component for developing realistic, interactive neurosurgical simulators, as complex nonlinear deformations must be captured to ensure realistic tool-tissue interactions. However, traditional numerical solvers often fall short in meeting real-time performance requirements. To overcome this, we introduce a deep learning-based surrogate model that efficiently simulates transient brain deformation caused by continuous interactions between surgical instruments and the virtual brain geometry. Building on Universal Physics Transformers, our approach operates directly on large-scale mesh data and is trained on an extensive dataset generated from nonlinear finite element simulations, covering a broad spectrum of temporal instrument-tissue interaction scenarios. To reduce the accumulation of errors in autoregressive inference, we propose a stochastic teacher forcing strategy applied during model training. Specifically, training consists of short stochastic rollouts in which the proportion of ground truth inputs is gradually decreased in favor of model-generated predictions. Our results show that the proposed surrogate model achieves accurate and efficient predictions across a range of transient brain deformation scenarios, scaling to meshes with up to 150,000 nodes. The introduced stochastic teacher forcing technique substantially improves long-term rollout stability, reducing the maximum prediction error from 6.7 mm to 3.5 mm. We further integrate the trained surrogate model into an interactive neurosurgical simulation environment, achieving runtimes below 10 ms per simulation step on consumer-grade inference hardware. Our proposed deep learning framework enables rapid, smooth and accurate biomechanical simulations of dynamic brain tissue deformation, laying the foundation for realistic surgical training environments.

脑组织模拟自回归模型实时仿真神经外科

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。