本地部署的智能问诊系统,用大模型+动画形象实现隐私保护问诊。
The Locally Deployable Virtual Doctor: LLM Based Human Interface for Automated Anamnesis and Database Conversion
- 用微调的大模型与扩散动画结合,本地完成问诊对话。
- 在真实和合成数据上训练,对未知患者表现稳定。
- 适合对数据隐私要求高的医院或基层医疗场景。
大型语言模型的进展使高水准对话能力可在低算力下实现,支持临床环境中的本地部署。本研究提出MedChat,一个本地可运行的虚拟医生框架,将基于LLM的医疗聊天机器人与基于扩散模型的虚拟形象结合,实现自动化、结构化问诊。聊天机器人通过真实与合成医疗对话混合语料微调,并采用低秩适配优化效率;数据库接口实现患者数据与推理过程完全隔离,保障安全。虚拟形象由潜空间条件扩散模型生成,基于研究者视频数据训练,并与梅尔频率音频特征同步,实现自然语音与面部动作匹配。相比云端系统,该工作首次验证了全离线、本地部署的LLM-扩散框架在临床问诊中的可行性。自编码器与扩散网络收敛平稳,系统实现稳定微调并具备强泛化能力。所提方案为资源有限且注重隐私的医疗场景提供了高效、安全的AI辅助问诊基础。
原文摘要 · Abstract (English)
Recent advances in large language models made it possible to achieve high conversational performance with substantially reduced computational demands, enabling practical on-site deployment in clinical environments. Such progress allows for local integration of AI systems that uphold strict data protection and patient privacy requirements, yet their secure implementation in medicine necessitates careful consideration of ethical, regulatory, and technical constraints. In this study, we introduce MedChat, a locally deployable virtual physician framework that integrates an LLM-based medical chatbot with a diffusion-driven avatar for automated and structured anamnesis. The chatbot was fine-tuned using a hybrid corpus of real and synthetically generated medical dialogues, while model efficiency was optimized via Low-Rank Adaptation. A secure and isolated database interface was implemented to ensure complete separation between patient data and the inference process. The avatar component was realized through a conditional diffusion model operating in latent space, trained on researcher video datasets and synchronized with mel-frequency audio features for realistic speech and facial animation. Unlike existing cloud-based systems, this work demonstrates the feasibility of a fully offline, locally deployable LLM-diffusion framework for clinical anamnesis. The autoencoder and diffusion networks exhibited smooth convergence, and MedChat achieved stable fine-tuning with strong generalization to unseen data. The proposed system thus provides a privacy-preserving, resource-efficient foundation for AI-assisted clinical anamnesis, also in low-cost settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。