本地运行的AI系统用预审问答精准回应患者术前问题,兼顾隐私与节能。
A Locally Executable AI System for Improving Preoperative Patient Communication: A Multi-Domain Clinical Evaluation
- 用高精度句子编码器分类输入,返回医生审核过的原文问答,不生成新内容。
- 在牙科和胃镜两领域测试中准确率达98.3%,误差仅7次,接近GPT-4o表现。
- 能耗仅为生成式模型的1/170,延迟低于0.1秒,适合资源受限的医院部署。
等待侵入性手术的患者常有未解答的术前疑问;但时间紧迫与隐私限制使个性化咨询难实现。我们提出LENOHA(低功耗、无幻觉、不遗漏架构),一种以安全为先、本地优先的系统,通过高精度句子变换器分类器路由输入,并返回临床医生审核过的FAQ原文答案,彻底避免临床路径中的自由文本生成。我们在两个领域(拔牙与胃镜)使用专家评审验证集(每域400条)进行阈值设定,及独立测试集(每域200条)评估。四个编码器中,E5-large-instruct(560M)整体准确率为0.983(95%置信区间0.964–0.991),AUC达0.996,共7次错误,与GPT-4o表现统计上无差异;Gemini在此测试集上零错误。能效监测显示,非生成式临床路径每输入耗电约1.0 mWh,而本地8B小语言模型生成一句闲聊需约168 mWh,差距达170倍,同时保持单台本地GPU上约0.10秒延迟。结果表明,通过直接返回经审核的原文答案,该临床路径有效规避了近前沿判别与生成引发的错误,支持隐私保护、可持续性及带宽受限环境下的公平部署。
原文摘要 · Abstract (English)
Patients awaiting invasive procedures often have unanswered pre-procedural questions; however, time-pressured workflows and privacy constraints limit personalized counseling. We present LENOHA (Low Energy, No Hallucination, Leave No One Behind Architecture), a safety-first, local-first system that routes inputs with a high-precision sentence-transformer classifier and returns verbatim answers from a clinician-curated FAQ for clinical queries, eliminating free-text generation in the clinical path. We evaluated two domains (tooth extraction and gastroscopy) using expert-reviewed validation sets (n=400/domain) for thresholding and independent test sets (n=200/domain). Among the four encoders, E5-large-instruct (560M) achieved an overall accuracy of 0.983 (95% CI 0.964-0.991), AUC 0.996, and seven total errors, which were statistically indistinguishable from GPT-4o on this task; Gemini made no errors on this test set. Energy logging shows that the non-generative clinical path consumes ~1.0 mWh per input versus ~168 mWh per small-talk reply from a local 8B SLM, a ~170x difference, while maintaining ~0.10 s latency on a single on-prem GPU. These results indicate that near-frontier discrimination and generation-induced errors are structurally avoided in the clinical path by returning vetted FAQ answers verbatim, supporting privacy, sustainability, and equitable deployment in bandwidth-limited environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。