Tianyi是76亿参数的中医专用大模型，助力临床诊疗与知识应用。
Tianyi: A Traditional Chinese Medicine all-rounder language model and its Real-World Clinical Practice
- 基于中医经典与临床数据训练，采用渐进式学习融合系统性知识
- 在真实临床任务中表现优于现有模型，支持辨证论治与处方生成
- 适合中医研究者、临床医生及AI医疗开发者使用
天然药物，尤其是中医药（TCM），因其在缓解症状和治疗疾病方面的潜力正获得全球认可。中医药拥有系统的理论体系和丰富的实践经验，但其有效应用依赖于精准的辨证、治则确定和处方制定，需多年临床积累。尽管已有基于机器学习和深度学习的辅助决策系统，但受限于数据不足和单一目标，难以落地。近年来，大语言模型（LLMs）展现出处理复杂任务的潜力，但在中医药领域缺乏专业性，且存在模型过大难部署、幻觉等问题。为此，我们提出76亿参数的中医全能大模型Tianyi，通过预训练与微调覆盖经典文献、专家论著、临床记录及知识图谱等多元中医语料，以渐进学习方式整合相互关联的系统性知识。同时构建了TCMEval评估基准，涵盖中医考试、临床任务、领域问答和真实世界试验，全面评估模型表现。大量实验表明，Tianyi在中医临床实践与研究中具有显著潜力，有效弥合了中医知识与实际应用之间的鸿沟。
原文摘要 · Abstract (English)
Natural medicines, particularly Traditional Chinese Medicine (TCM), are gaining global recognition for their therapeutic potential in addressing human symptoms and diseases. TCM, with its systematic theories and extensive practical experience, provides abundant resources for healthcare. However, the effective application of TCM requires precise syndrome diagnosis, determination of treatment principles, and prescription formulation, which demand decades of clinical expertise. Despite advancements in TCM-based decision systems, machine learning, and deep learning research, limitations in data and single-objective constraints hinder their practical application. In recent years, large language models (LLMs) have demonstrated potential in complex tasks, but lack specialization in TCM and face significant challenges, such as too big model scale to deploy and issues with hallucination. To address these challenges, we introduce Tianyi with 7.6-billion-parameter LLM, a model scale proper and specifically designed for TCM, pre-trained and fine-tuned on diverse TCM corpora, including classical texts, expert treatises, clinical records, and knowledge graphs. Tianyi is designed to assimilate interconnected and systematic TCM knowledge through a progressive learning manner. Additionally, we establish TCMEval, a comprehensive evaluation benchmark, to assess LLMs in TCM examinations, clinical tasks, domain-specific question-answering, and real-world trials. The extensive evaluations demonstrate the significant potential of Tianyi as an AI assistant in TCM clinical practice and research, bridging the gap between TCM knowledge and practical application.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。