arXiv:2507.15894eess.IVcs.AI2025-07

用生成模型自动生成带真实血流标注的心脏CT帧对,减少人工标注依赖。

Systole-Conditioned Generative Cardiac Motion

  • 基于条件变分自编码器生成3D血流场,以单帧CT为基础合成变形帧。
  • 生成的帧对包含密集3D流场标注,可直接用于训练高精度运动模型。
  • 适用于心脏功能分析与手术规划,适合医学影像算法研究者使用。

心脏计算机断层扫描(CT)中的精确运动估计对评估心脏功能和手术规划至关重要。数据驱动的方法已成为密集运动估计的标准,但其依赖大量带有密集真实运动标注的标签数据,而这些数据往往难以获取。为此,我们提出一种新方法,可合成具有真实感的成对心脏CT帧,并附带密集的3D流场标注。该方法利用条件变分自编码器(CVAE),引入新型多尺度特征条件机制,训练生成以单帧CT为条件的3D流场。将生成的流场应用于原始帧进行形变,即可创建模拟整个心动周期心肌变形的帧对。这些帧对提供完整的光学流真实标注,可用于训练和验证更复杂、更准确的心肌运动模型,显著降低对人工标注的依赖。代码及动画生成样本等资料详见项目页面:https://shaharzuler.github.io/GenerativeCardiacMotion_Page。

原文摘要 · Abstract (English)

Accurate motion estimation in cardiac computed tomography (CT) imaging is critical for assessing cardiac function and surgical planning. Data-driven methods have become the standard approach for dense motion estimation, but they rely on vast amounts of labeled data with dense ground-truth (GT) motion annotations, which are often unfeasible to obtain. To address this limitation, we present a novel approach that synthesizes realistically looking pairs of cardiac CT frames enriched with dense 3D flow field annotations. Our method leverages a conditional Variational Autoencoder (CVAE), which incorporates a novel multi-scale feature conditioning mechanism and is trained to generate 3D flow fields conditioned on a single CT frame. By applying the generated flow field to warp the given frame, we create pairs of frames that simulate realistic myocardium deformations across the cardiac cycle. These pairs serve as fully annotated data samples, providing optical flow GT annotations. Our data generation pipeline could enable the training and validation of more complex and accurate myocardium motion models, allowing for substantially reducing reliance on manual annotations. Our code, along with animated generated samples and additional material, is available on our project page: https://shaharzuler.github.io/GenerativeCardiacMotion_Page.

心脏影像生成模型运动估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。