arXiv:2606.13188cs.CVcs.AI2026-06

直接从影像生成心脏网格,端到端省去繁琐后处理。

Transformer-Guided Graph Attention for Direct Cardiac Mesh Reconstruction: A Structural Digital Twin Framework

论文配图:Transformer-Guided Graph Attention for Direct Cardiac Mesh Reconstruction: A Structural Digital Twin Framework
图 1 · 摘自论文原文
  • 用3D Swin Transformer与图注意力网络联合建模,端到端生成心脏网格。
  • 平均切比雪夫距离1.8毫米,95%表面误差低于5毫米,无需后处理。
  • 适合临床部署,提升心脏数字孪生的几何精度与可用性。

构建个体化心脏模型是精准心脏病学的核心,但临床应用始终受限于网格生成速度慢、流程混乱且依赖专家。传统方法需先分割图像,再运行Marching Cubes,最后手动清理,耗时且不一致。本文提出全新思路:将分割与网格生成合并为单一端到端网络,直接从原始3D医学影像生成平滑、可模拟的心脏表面网格。核心采用3D Swin Transformer编码器-解码器提取体数据特征,并搭配图注意力网络(GAT)头,迭代变形模板网格以匹配患者心脏边界。在MM-WHS 2017基准上使用CT和MRI测试,分割性能优异(CT Dice 0.84,MRI Dice 0.83),但重点在于网格质量:平均切比雪夫距离为1.8毫米,95%分位数表面距离低于5毫米。所有网格均通过一次前向传播完成,无需Marching Cubes、平滑滤波或人工修正。我们认为,在心脏数字孪生流程中,几何保真度与拓扑正确性优于像素级分割精度。该方法消除后处理瓶颈,显著提升个体化心脏模拟的临床可及性。

原文摘要 · Abstract (English)

Building patient-specific cardiac models sits at the heart of precision cardiology, yet getting those models into clinical use keeps running into the same wall: mesh generation is slow, messy, and frustrating. The standard workflow -- segmenting the image, running Marching Cubes, and then manually cleaning up the result -- is time-consuming, inconsistent across operators, and demands specialist knowledge most clinical teams do not have. We take a fundamentally different approach. Instead of treating segmentation and mesh generation as two separate problems, we train a single end-to-end network that goes directly from a raw 3D medical image to a smooth, simulation-ready cardiac surface mesh. The core is a 3D Swin Transformer encoder-decoder that extracts volumetric features from CT or MRI volumes, paired with a Graph Attention Network (GAT) head that iteratively deforms a template mesh to fit the patient's cardiac boundary. We tested on the MM-WHS 2017 benchmark using both CT and MRI. Segmentation scores were competitive (Dice of 0.84 on CT, 0.83 on MRI), but the primary focus is mesh quality: mean Chamfer distance of 1.8 mm, with 95th-percentile surface distance below 5 mm. Every mesh is produced in a single forward pass -- no Marching Cubes, no smoothing filters, no manual cleanup. We argue that for cardiac digital twin pipelines, geometric fidelity and topological correctness matter more than pixel-level Dice scores. By removing the post-processing bottleneck, this approach makes patient-specific cardiac simulation substantially more accessible for clinical use.

心脏建模网格生成数字孪生Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。