arXiv:2507.00287cs.CVcs.AI2025-07被引 1

用CT生成合成X光片,自监督学习多视角对应关系

Self-Supervised Multiview Xray Matching

  • 用CT生成合成X光片,自动构建多视角对应矩阵
  • 在真实数据上提升多视角骨折检测准确率
  • 无需人工标注,适合医学影像跨视角分析

多视角X光片的精准解读对骨折、肌肉损伤等异常诊断至关重要。尽管单图AI分析已取得进展,现有方法在建立不同视角间鲁棒对应关系方面仍存挑战。本文提出一种新型自监督流程,通过未标注的CT体积自动生成数字重建放射图像(DRR),实现合成X光片间的多对多对应矩阵构建。采用基于Transformer的训练阶段,精确预测两幅或多幅X光片间的对应关系。此外,实验表明,利用合成视图间的对应关系进行预训练,可有效提升真实数据上的多视角骨折检测性能。在合成与真实X光数据集上的大量评估显示,引入对应关系显著提升了多视角骨折分类表现。

原文摘要 · Abstract (English)

Accurate interpretation of multi-view radiographs is crucial for diagnosing fractures, muscular injuries, and other anomalies. While significant advances have been made in AI-based analysis of single images, current methods often struggle to establish robust correspondences between different X-ray views, an essential capability for precise clinical evaluations. In this work, we present a novel self-supervised pipeline that eliminates the need for manual annotation by automatically generating a many-to-many correspondence matrix between synthetic X-ray views. This is achieved using digitally reconstructed radiographs (DRR), which are automatically derived from unannotated CT volumes. Our approach incorporates a transformer-based training phase to accurately predict correspondences across two or more X-ray views. Furthermore, we demonstrate that learning correspondences among synthetic X-ray views can be leveraged as a pretraining strategy to enhance automatic multi-view fracture detection on real data. Extensive evaluations on both synthetic and real X-ray datasets show that incorporating correspondences improves performance in multi-view fracture classification.

医学影像自监督学习多视角匹配X光分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。