arXiv:2604.16333cs.LGcs.AI2026-04

融合多模态数据与多智能体推理,识别膝骨关节炎症状与结构损伤的不一致。

A Discordance-Aware Multimodal Framework with Multi-Agent Clinical Reasoning

论文配图:A Discordance-Aware Multimodal Framework with Multi-Agent Clinical Reasoning
图 1 · 摘自论文原文
  • 构建多模态专家模型,融合影像、生物标志物与临床数据
  • 通过残差模型计算疼痛-结构不一致得分,量化症状与损伤差异
  • 多智能体系统生成可解释的分型与个性化管理建议

膝骨关节炎常表现出影像学显示的结构损伤与患者自报症状(如疼痛)之间的不一致,这种差异使临床判断和患者分层变得复杂,现有决策支持系统对此建模不足。本文提出一种关注不一致性的多模态框架,结合机器学习预测模型与基于工具的多智能体推理系统。基于FNIH骨关节炎生物标志物联盟的基线数据,训练多模态模型以预测两类进展任务:仅关节间隙狭窄进展与非进展,以及仅疼痛进展与非进展。预测系统包含三个模态专用专家:使用人口统计学、放射学、MRI衍生标量及生物标志物特征的CatBoost表格模型;基于ResNet18主干网络提取的MRI图像嵌入;以及采用相同架构生成的X射线嵌入。专家预测通过堆叠集成融合。残差模型基于结构特征估计预期疼痛,从而计算观察到的症状与预期之间的疼痛-结构不一致分数。多智能体推理层分析这些信号,分配具有临床意义的骨关节炎表型,并生成表型特定的管理建议。

原文摘要 · Abstract (English)

Knee osteoarthritis frequently exhibits discordance between structural damage observed in imaging and patient-reported symptoms such as pain. This mismatch complicates clinical interpretation and patient stratification and remains insufficiently modeled in existing decision support systems. We propose a discordance aware multimodal framework that combines machine learning prediction models with a tool grounded multi agent reasoning system. Using baseline data from the FNIH Osteoarthritis Biomarkers Consortium, we trained multimodal models to predict two progression tasks, joint space loss only progression versus non progression, and pain only progression versus non progression. The predictive system integrates three modality specific experts: a CatBoost tabular model using demographic, radiographic, MRI-derived scalar, and biomarker features; MRI image embeddings extracted using a ResNet18 backbone; and Xray embeddings derived from the same architecture. Expert predictions are fused using a stacking ensemble. Residual based models estimate expected pain from structural features, enabling the computation of a pain structure discordance score between observed and expected symptoms. A multi-agent reasoning layer interprets these signals to assign clinically interpretable OA phenotypes and generate phenotype specific management recommendations.

多模态临床推理骨关节炎不一致检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。