提出可追踪解剖结构的手术预测图像生成方法
TraceTrans: Translation and Spatial Tracing for Surgical Prediction
- 用双解码器显式建模输入与输出间的空间对应关系
- 在整形与脑部MRI数据上实现高精度且可解释的术后预测
- 适合需要解剖准确性的临床手术效果预估场景
图像到图像翻译模型在跨视觉域图像转换中取得显著成果,并被越来越多地用于医疗任务,如预测术后结果和疾病进展。然而,现有方法主要关注匹配目标分布,常忽视源图像与生成图像之间的空间对应关系。这一局限可能导致结构不一致和幻觉,降低预测的可靠性与可解释性。临床应用中对解剖准确性的严苛要求更凸显了这一问题。本文提出TraceTrans,一种专为术后预测设计的可变形图像翻译模型,能在匹配目标分布的同时显式揭示与术前输入的空间对应关系。该框架采用编码器提取特征,双解码器分别预测空间形变场与合成目标图像。预测的形变场对生成结果施加空间约束,确保与源图像的解剖一致性。在医学美容与脑部MRI数据集上的大量实验表明,TraceTrans能够实现准确且可解释的术后预测,展现出可靠的临床应用潜力。
原文摘要 · Abstract (English)
Image-to-image translation models have achieved notable success in converting images across visual domains and are increasingly used for medical tasks such as predicting post-operative outcomes and modeling disease progression. However, most existing methods primarily aim to match the target distribution and often neglect spatial correspondences between the source and translated images. This limitation can lead to structural inconsistencies and hallucinations, undermining the reliability and interpretability of the predictions. These challenges are accentuated in clinical applications by the stringent requirement for anatomical accuracy. In this work, we present TraceTrans, a novel deformable image translation model designed for post-operative prediction that generates images aligned with the target distribution while explicitly revealing spatial correspondences with the pre-operative input. The framework employs an encoder for feature extraction and dual decoders for predicting spatial deformations and synthesizing the translated image. The predicted deformation field imposes spatial constraints on the generated output, ensuring anatomical consistency with the source. Extensive experiments on medical cosmetology and brain MRI datasets demonstrate that TraceTrans delivers accurate and interpretable post-operative predictions, highlighting its potential for reliable clinical deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。