arXiv:2606.29580cs.CL2026-06被引 1

离线运行的医疗问答系统,帮坦桑尼亚助产护士快速获取权威指南。

MAM-AI: An On-Device Medical Retrieval-Augmented Generation System for Nurses and Midwives in Zanzibar

  • 在安卓设备上本地运行,用300M嵌入模型匹配87份指南文本
  • 40亿参数小模型虽不完美,但通过提示词优化提升安全性和准确性
  • 专为网络差地区设计,知识库质量直接影响答案是否具体可执行

孕产妇和新生儿死亡率在撒哈拉以南非洲仍居高位,当地助产护理常由缺乏国际标准培训的护士提供,且临床时查阅权威指南困难:指南冗长,网络连接不稳定。我们提出MAM-AI,一个专为坦桑尼亚护士-助产士设计的离线医学问答助手,运行于普通安卓设备上。用户问题经300M参数的EmbeddingGemma嵌入后,与包含63,650段落的87份指南文档集匹配,再由40亿参数int4量化版Gemma 4 E4B生成带引用的答案,全程无数据外传。评估采用分层方法(检索器、生成器在理想上下文、端到端、延迟)并由经过医师评分验证的LLM裁判打分。结果显示:本地检索已基本解决——300M嵌入模型在七种检索器中排名第三,性能媲美云端系统;而40亿参数生成器仍存疑——加入检索内容未提升答案质量,该规模下无法同时做到有用且安全;两个同规模候选中,更实用的会犯真实危险错误,故选择较忠实源的版本,其忠实度达前沿模型水平,再通过重设计提示词将回避率从33%降至3%。知识库质量起决定性作用:当存在正确段落时,答案具体可行;否则即变得模糊。MAM-AI是全面评估过的开源研究原型,系统、知识库、基准与评估工具均已公开发布。

原文摘要 · Abstract (English)

Maternal and newborn mortality remain among the highest in sub-Saharan Africa, where midwifery care is often delivered by nurses who lack midwifery training to international standards, and consulting authoritative guidance at the point of care is hard: the guidelines are long and connectivity is intermittent. We present MAM-AI, a medical question-answering assistant for nurse-midwives in Zanzibar that runs entirely on a commodity Android device: a question is embedded (EmbeddingGemma, 300M) and matched against a curated corpus of 87 guideline documents (63,650 passages), then answered with citations by a 4B int4 generator (Gemma 4 E4B), fully offline, with no query leaving the device. We evaluate the exact deployed configuration with a layered methodology -- retriever, generator under oracle context, end-to-end, and latency -- scored by LLM judges validated against physician rubrics. The evaluation relocates the hard problem. On-device retrieval is essentially solved: the 300M embedder ranks third of seven retrievers and rivals cloud systems, so the passages the system needs are usually found. The small generator is what remains in doubt: adding retrieved context does not improve its answers, and at 4B it cannot be both helpful and safe at once -- of two same-size candidates, the more helpful one commits genuine dangerous errors, so we deploy the other, which is about twice as faithful to its sources (as faithful as a frontier model), and recover its helpfulness with a redesigned prompt that cuts deflection from 33% to 3%. Corpus quality is decisive for the same reason: where the corpus holds the right passage the answer is specific and actionable, and where it does not it goes vague. MAM-AI is a thoroughly evaluated, open-source research prototype, not a fielded product; the system, knowledge base, benchmarks, and evaluation harness are released.

医疗AI离线推理助产护理本地化部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。