用多视角视频上下文提升超声前列腺癌检测准确率
Compass: Prostate Cancer Detection Needs Multi-View Context

- 将超声视频流建模为图像序列,融合旋转扫描与穿刺帧信息
- 在多中心数据集上达到优于单帧分析和专家评分的检测性能
- 适合临床辅助诊断系统开发人员及医学影像研究者参考
人工智能对微超声(μUS)的分析在前列腺癌(PCa)检测中展现出潜力。然而,现有AI方法大多孤立分析单帧μUS图像。临床专家通常评估完整视频记录,利用三维上下文信息,相比单帧分析能提升检测效果。受此临床流程启发,我们提出Compass,一种新型AI方法,将μUS检查视为2D图像序列流。该模型联合整合前列腺旋转扫查视频与穿刺时获取的μUS帧,并利用基于探头旋转角度条件化的Transformer实现全研究范围内的证据聚合。最后,解码器头输出患者级别的帧级与研究级风险评分。模型在包含连续旋转扫描及穿刺视频的多中心临床试验数据集上训练与评估,性能优于文献中的基线AI方法及临床专家提供的风险评分,验证了多视角上下文对μUS PCa检测的价值,为辅助人类专家提供有力工具。代码已开源。
原文摘要 · Abstract (English)
Artificial intelligence (AI) analysis of micro-ultrasound ($μ$US) has shown promise for prostate cancer (PCa) detection. However, most existing AI methods focus on the analysis of single $μ$US images in isolation. By contrast, expert $μ$US readers typically assess a full recorded video study, which provides three-dimensional context, to improve PCa detection compared to single-frame analysis. Inspired by this clinical workflow, we propose Compass, a novel AI methodology which models a $μ$US study as a stream of 2D images. Compass jointly integrates rotational sweep videos of the prostate with $μ$US frames acquired at the moment of biopsy, and performs evidence aggregation across the study using a transformer conditioned on the probe's rotational angle. Finally, a decoder head predicts frame-level and study-level risk scores for the patient. The model is trained and evaluated using a multi-center clinical trial dataset of $μ$US studies, including continuous rotational scans of the prostate and videos captured during biopsy acquisition. We compare the proposed method to baseline AI methods from the literature and to risk scores provided by clinical experts. Our framework shows strong performance, highlighting the value of multi-view context for $μ$US PCa detection, and providing a potentially powerful tool to complement human expertise in $μ$US-based PCa diagnosis. Our code is available at: https://github.com/mharmanani/Compass.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。