arXiv:2604.07141cs.CV2026-04中稿 · IEEE Journal of Bi…

用CT和病历数据,提前精准分类肾结石类型

USCNet: Transformer-Based Multimodal Fusion with Segmentation Guidance for Urolithiasis Classification

  • 基于Transformer的多模态融合,结合影像与临床数据
  • 在自建数据集上分类准确率显著优于现有方法
  • 适合临床医生术前制定个性化治疗方案

肾结石是泌尿科最常见疾病之一,明确结石成分对制定个性化治疗方案和预防复发至关重要。现有分析依赖术后样本,难以实现术前快速分类。为此,我们提出尿路结石分割与分类网络(USCNet),通过整合计算机断层扫描(CT)图像与电子健康记录(EHR)临床数据,实现术前精准分类。USCNet采用基于Transformer的多模态融合框架,包含CT-EHR注意力模块与分割引导注意力模块,并引入动态损失函数以平衡分割与分类双重目标。在自建肾结石数据集上的实验表明,USCNet在各项评估指标上均表现优异,分类性能显著超越主流方法。该研究为肾结石的精确术前分类提供了可行方案,具有重要临床价值。源代码已公开:https://github.com/ZhangSongqi0506/KidneyStone。

原文摘要 · Abstract (English)

Kidney stone disease ranks among the most prevalent conditions in urology, and understanding the composition of these stones is essential for creating personalized treatment plans and preventing recurrence. Current methods for analyzing kidney stones depend on postoperative specimens, which prevents rapid classification before surgery. To overcome this limitation, we introduce a new approach called the Urinary Stone Segmentation and Classification Network (USCNet). This innovative method allows for precise preoperative classification of kidney stones by integrating Computed Tomography (CT) images with clinical data from Electronic Health Records (EHR). USCNet employs a Transformer-based multimodal fusion framework with CT-EHR attention and segmentation-guided attention modules for accurate classification. Moreover, a dynamic loss function is introduced to effectively balance the dual objectives of segmentation and classification. Experiments on an in-house kidney stone dataset show that USCNet demonstrates outstanding performance across all evaluation metrics, with its classification efficacy significantly surpassing existing mainstream methods. This study presents a promising solution for the precise preoperative classification of kidney stones, offering substantial clinical benefits. The source code has been made publicly available: https://github.com/ZhangSongqi0506/KidneyStone.

肾结石多模态融合Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。