研究发现，精准干预医疗AI对话中的脆弱节点可提升诊断准确率40%。
Examining the Vulnerability of Multi-Agent Medical Systems to Human Interventions for Clinical Reasoning
- 定位AI医疗系统对话中的易受干扰时刻，作为干预切入点。
- 正确干预使诊断准确率最高提升40%，错误干预则降6%并增加误判。
- 揭示了AI与真实医生在认知偏见上的相似性，适合临床AI安全研究者参考。
人类在故障点的干预可能改变多智能体医疗系统的诊断准确性。我们定义故障点为AI代理对话中推理最易受外部影响的时刻。基于MedQA数据集，本研究通过模拟医患对话，评估干预对推理路径和准确率的影响。正确干预方法使基线诊断准确率最高提升40%，而错误或带有偏见的干预导致性能下降最多6%，并加剧诊断漂移与不确定性。此外，分析还揭示了模拟代理环境中的认知偏差行为与真实临床实践的高度相似性，如过早闭合和易受误导线索影响。总体表明，识别并引导故障点，可成为提升多智能体医疗系统诊断鲁棒性的有效机制。
原文摘要 · Abstract (English)
Human interventions at fault points can alter the diagnostic accuracy of multi-agent medical systems. We defined fault points as moments in AI agent conversations, in which an agent's reasoning became most vulnerable to external influence. Using the MedQA dataset, this study analyzed simulated doctor-patient conversations to measure how interventions shifted reasoning and accuracy. Correct intervention methods showed an improvement in baseline diagnostic accuracy of up to 40%, while incorrect or bias-related interventions degraded performance by up to 6% and increased diagnostic drift and uncertainty. Beyond performance changes, our analysis revealed behavioral similarities between cognitive biases in simulated agent environments and real-world clinical practice. Examples included premature closure and susceptibility to misleading cues. Overall, these findings demonstrate that identifying and guiding fault points with human interventions may provide a mechanism for improving diagnostic robustness in multi-agent medical systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。