用大模型自动识别医疗通讯中的紧急情况,准确率超99%。
A Machine Learning Approach for Emergency Detection in Medical Scenarios Using Large Language Models
- 基于大模型和提示工程构建紧急事件检测系统
- 3B和7B参数模型准确率达99.6%与99.7%
- 适合医疗预警系统开发与安全研究者
通过数字通信渠道快速识别医疗紧急情况,是现代医疗交付中的关键挑战,尤其在远程医疗日益普及的背景下。本文提出一种利用大语言模型(LLMs)和提示工程实现医疗通信中紧急事件自动检测的新方法。我们使用多个LLaMA模型变体(1B、3B、7B参数)开发并评估了一个综合性系统,用于将医疗场景分类为紧急或非紧急情况。方法结合了系统提示与提示内训练策略,并在不同硬件配置下进行测试。结果表明,经过优化提示工程后,LLaMA 2(7B)模型达到99.7%准确率,LLaMA 3.2(3B)模型达到99.6%准确率。通过系统测试提示中的训练示例,发现包含10个示例场景时分类性能最优。各平台处理速度差异显著,每请求耗时0.05至2.2秒。该系统在降低高风险误判(漏报)方面表现突出,对患者安全至关重要。代码与评估框架已公开于GitHub,便于后续研究与开发。
原文摘要 · Abstract (English)
The rapid identification of medical emergencies through digital communication channels remains a critical challenge in modern healthcare delivery, particularly with the increasing prevalence of telemedicine. This paper presents a novel approach leveraging large language models (LLMs) and prompt engineering techniques for automated emergency detection in medical communications. We developed and evaluated a comprehensive system using multiple LLaMA model variants (1B, 3B, and 7B parameters) to classify medical scenarios as emergency or non-emergency situations. Our methodology incorporated both system prompts and in-prompt training approaches, evaluated across different hardware configurations. The results demonstrate exceptional performance, with the LLaMA 2 (7B) model achieving 99.7% accuracy and the LLaMA 3.2 (3B) model reaching 99.6% accuracy with optimal prompt engineering. Through systematic testing of training examples within the prompts, we identified that including 10 example scenarios in the model prompts yielded optimal classification performance. Processing speeds varied significantly between platforms, ranging from 0.05 to 2.2 seconds per request. The system showed particular strength in minimizing high-risk false negatives in emergency scenarios, which is crucial for patient safety. The code implementation and evaluation framework are publicly available on GitHub, facilitating further research and development in this crucial area of healthcare technology.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。