arXiv:2509.20707cs.AI2025-09被引 1

用大模型自动评估放疗方案,结果可解释且准确率100%。

An Automated Retrieval-Augmented Generation LLaMA-4 109B-based System for Evaluating Radiotherapy Treatment Plans

  • 结合检索与大模型推理,实现协议自适应评估
  • 在614份计划上达成毫厘不差的剂量预测与约束检查
  • 适合放疗医生快速审核方案,减少人工负担

目的:开发基于LLaMA-4 109B的检索增强生成(RAG)系统,实现放疗计划的自动化、协议感知且可解释的评估。方法与材料:构建包含614份放疗计划的多协议数据集,涵盖四个病灶部位,并建立包含标准化剂量指标和协议约束的知识库。RAG系统包含三个核心模块:优化于五种SentenceTransformer骨干网络的检索引擎、基于队列相似性的百分位预测组件、以及临床约束检查器。这些工具由大语言模型通过多步提示驱动的推理流程协调,生成简洁且有依据的评估结果。结果:通过高斯过程优化检索超参数,采用标量损失函数融合均方根误差(RMSE)、平均绝对误差(MAE)及临床合理精度阈值。最优配置(all-MiniLM-L6-v2)在5百分点范围内达到完美最近邻准确率,且MAE低于2点。端到端测试中,RAG系统在百分位估计与约束识别上与独立检索和约束检查模块计算结果完全一致(100%吻合),验证了各步骤可靠执行。结论:研究证明将群体基准评分与模块化工具增强推理相结合,在放射治疗中具备可行性,系统输出可追溯、少幻觉、跨协议鲁棒性强。未来方向包括临床医生主导验证,以及改进领域适配的检索模型以提升实际应用整合。

原文摘要 · Abstract (English)

Purpose: To develop a retrieval-augmented generation (RAG) system powered by LLaMA-4 109B for automated, protocol-aware, and interpretable evaluation of radiotherapy treatment plans. Methods and Materials: We curated a multi-protocol dataset of 614 radiotherapy plans across four disease sites and constructed a knowledge base containing normalized dose metrics and protocol-defined constraints. The RAG system integrates three core modules: a retrieval engine optimized across five SentenceTransformer backbones, a percentile prediction component based on cohort similarity, and a clinical constraint checker. These tools are directed by a large language model (LLM) using a multi-step prompt-driven reasoning pipeline to produce concise, grounded evaluations. Results: Retrieval hyperparameters were optimized using Gaussian Process on a scalarized loss function combining root mean squared error (RMSE), mean absolute error (MAE), and clinically motivated accuracy thresholds. The best configuration, based on all-MiniLM-L6-v2, achieved perfect nearest-neighbor accuracy within a 5-percentile-point margin and a sub-2pt MAE. When tested end-to-end, the RAG system achieved 100% agreement with the computed values by standalone retrieval and constraint-checking modules on both percentile estimates and constraint identification, confirming reliable execution of all retrieval, prediction and checking steps. Conclusion: Our findings highlight the feasibility of combining structured population-based scoring with modular tool-augmented reasoning for transparent, scalable plan evaluation in radiation therapy. The system offers traceable outputs, minimizes hallucination, and demonstrates robustness across protocols. Future directions include clinician-led validation, and improved domain-adapted retrieval models to enhance real-world integration.

放疗评估大模型RAG可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。