用AI助手打造沉浸式手术训练沙盒,减轻医生认知负担
SurgBox: Agent-Driven Operating Room Sandbox with Surgery Copilot
- 基于大模型与检索增强生成,模拟多种手术角色
- 实测验证可显著提升手术认知能力与决策支持
- 适合外科培训与术中辅助,尤其神经外科场景
神经外科等手术操作复杂且风险高,对医疗团队的认知能力要求极高。尽管刻意训练可提升认知水平,但因患者安全顾虑,真实手术训练机会有限。为此,我们提出SurgBox——一个由智能体驱动的手术仿真沙盒框架,旨在系统性提升外科医生在沉浸式模拟中的认知能力。SurgBox利用定制化的检索增强生成(RAG)大语言模型,真实还原各类手术角色,构建可用于刻意练习的高仿真训练环境。特别地,我们设计了Surgery Copilot,一个主动协调手术信息流、支持临床决策的AI助手,有效降低术中团队的认知负荷。通过引入新颖的长短期记忆机制,该助手可在即时操作支持与全面手术知识间实现平衡。基于真实神经外科手术记录的大量实验验证了SurgBox在提升认知能力与辅助决策方面的有效性。本框架为训练与术中支持提供一体化解决方案,有望推动外科教育与实践革新,改善手术结果与医疗质量。代码已开源:https://github.com/franciszchen/SurgBox。
原文摘要 · Abstract (English)
Surgical interventions, particularly in neurology, represent complex and high-stakes scenarios that impose substantial cognitive burdens on surgical teams. Although deliberate education and practice can enhance cognitive capabilities, surgical training opportunities remain limited due to patient safety concerns. To address these cognitive challenges in surgical training and operation, we propose SurgBox, an agent-driven sandbox framework to systematically enhance the cognitive capabilities of surgeons in immersive surgical simulations. Specifically, our SurgBox leverages large language models (LLMs) with tailored Retrieval-Augmented Generation (RAG) to authentically replicate various surgical roles, enabling realistic training environments for deliberate practice. In particular, we devise Surgery Copilot, an AI-driven assistant to actively coordinate the surgical information stream and support clinical decision-making, thereby diminishing the cognitive workload of surgical teams during surgery. By incorporating a novel Long-Short Memory mechanism, our Surgery Copilot can effectively balance immediate procedural assistance with comprehensive surgical knowledge. Extensive experiments using real neurosurgical procedure records validate our SurgBox framework in both enhancing surgical cognitive capabilities and supporting clinical decision-making. By providing an integrated solution for training and operational support to address cognitive challenges, our SurgBox framework advances surgical education and practice, potentially transforming surgical outcomes and healthcare quality. The code is available at https://github.com/franciszchen/SurgBox.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。