用大模型+强化学习提升癌症病灶分割准确率
RADIANT-PET: Reasoning-Augmented PET/CT Lesion Segmentation with Large Language Models and Reinforcement Learning

- 先粗分割再用大模型分析病灶文本特征
- 结合报告后性能提升,假阳性减少37%
- 适合需要临床推理的医学影像研究者
PET/CT中病灶精准分割对肿瘤诊疗至关重要,但生理性放射性摄取和伪影常导致误判。我们提出RADIANT-PET框架,将高灵敏度体素级分割模型与病灶级大语言模型(LLM)判别相结合。通过宽松分割生成候选区域,并转化为包含摄取强度、形态及局部/全局解剖上下文的结构化文本描述。LLM据此判断是否为真病灶,可选地引入放射科报告作为临床参考。为增强病灶级推理能力,我们使用组相对策略优化(Group Relative Policy Optimization)对本地LLM进行强化学习训练,奖励正确分类与解剖位置一致。在AutoPET和俄亥俄州立大学测试队列中,RADIANT-PET持续优于强图像基线,尤其在提供放射科报告时提升显著。结果表明,基于大模型的病灶级推理在传统分割之上新增了临床逻辑层,有效抑制生理性假阳性并使体素预测更符合临床判断。项目代码库:https://github.com/jwang-580/RADIANT-PET。
原文摘要 · Abstract (English)
Accurate lesion segmentation in PET/CT is critical for oncology, yet remains challenging because physiologic tracer uptake and artifacts can mimic malignant signal. We present RADIANT-PET, a reasoning-augmented framework that couples a high-sensitivity voxel-level segmentation model with lesion-level large language model (LLM) adjudication. Candidate uptake regions are generated with a deliberately permissive segmentation stage, then converted into structured textual descriptions that summarize uptake intensity, morphology, and regional and global anatomical context. An LLM classifies each candidate as true lesion vs. false positive, optionally leveraging the radiology report as additional clinical context. To strengthen lesion-level reasoning, we further optimize a local LLM via reinforcement learning using Group Relative Policy Optimization, rewarding correct lesion classification and anatomically concordant site assignment. Across AutoPET and an OSU test cohort, RADIANT-PET consistently outperforms strong image-only baselines, with the largest improvements observed when radiology reports are provided. Overall, these results demonstrate that LLM-based lesion-level reasoning adds a novel reasoning layer beyond conventional segmentation, suppressing physiologic false positives and aligning voxel-level predictions with clinical interpretation. The project repository is available at: https://github.com/jwang-580/RADIANT-PET.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。