arXiv:2603.06543cs.CV2026-03

用Transformer预测器官变形,支持手术切割,实时高效。

SurgFormer: Scalable Learning of Organ Deformation with Resection Support and Real-Time Inference

  • 多分辨率门控Transformer融合局部与全局信息,适应大网格
  • 在切除条件下实现准确变形预测,精度优于基线模型
  • 首个统一处理常规变形与切割场景的可学习体积模拟框架

我们提出SurgFormer,一种用于体网格上数据驱动软组织模拟的多分辨率门控Transformer。高保真生物力学求解器通常计算成本过高,无法用于交互式场景,因此我们基于求解器生成的数据训练SurgFormer,以接近实时的速度预测节点位移场。SurgFormer构建固定网格层次结构,采用重复的多分支模块,结合局部消息传递、粗粒度全局自注意力和逐点前馈更新,通过学习的每节点、每通道门控机制动态融合局部与长程信息,保持在大规模网格上的可扩展性。对于切割条件下的模拟,切除信息以学习的切割嵌入形式编码,并作为额外输入,实现标准变形预测与拓扑改变情况的统一建模。我们还引入两个遵循统一协议生成的外科模拟数据集,基于XFEM监督:胆囊切除切割数据集与阑尾切除操作及切割/未切割案例数据集。据我们所知,这是首个在同一体积管道中研究XFEM监督下切割条件变形的可学习体积代理模型。在多种基线对比中,SurgFormer在保持良好效率的同时取得强准确率,适合作为两类任务的实用骨干。

原文摘要 · Abstract (English)

We introduce SurgFormer, a multiresolution gated transformer for data driven soft tissue simulation on volumetric meshes. High fidelity biomechanical solvers are often too costly for interactive use, so we train SurgFormer on solver generated data to predict nodewise displacement fields at near real time rates. SurgFormer builds a fixed mesh hierarchy and applies repeated multibranch blocks that combine local message passing, coarse global self attention, and pointwise feedforward updates, fused by learned per node, per channel gates to adaptively integrate local and long range information while remaining scalable on large meshes. For cut conditioned simulation, resection information is encoded as a learned cut embedding and provided as an additional input, enabling a unified model for both standard deformation prediction and topology altering cases. We also introduce two surgical simulation datasets generated under a unified protocol with XFEM based supervision: a cholecystectomy resection dataset and an appendectomy manipulation and resection dataset with cut and uncut cases. To our knowledge, this is the first learned volumetric surrogate setting to study XFEM supervised cut conditioned deformation within the same volumetric pipeline as standard deformation prediction. Across diverse baselines, SurgFormer achieves strong accuracy with favorable efficiency, making it a practical backbone for both tasks. {Code, data, and project page: \href{https://mint-vu.github.io/SurgFormer/}{available here}}

医学模拟Transformer实时推理切割建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。