给大模型注入领域知识,让通用模型变专业助手。
Injecting Domain-Specific Knowledge into Large Language Models: A Comprehensive Survey
- 四种方法:动态注入、静态嵌入、模块化适配器、提示优化。
- 不同方法在灵活性与效率间权衡,提升专业任务表现。
- 适合想让模型懂医疗、法律等领域的研究者参考。
大型语言模型(LLMs)在自然语言理解、文本摘要和机器翻译等任务中表现出色,但其通用性限制了在医疗、化学、法律分析等需要专业知识领域的应用效果。为此,研究者探索了多种将领域知识融入大模型的方法。本文综述了四类核心方法:动态知识注入、静态知识嵌入、模块化适配器和提示优化。这些方法通过不同机制赋予模型领域专长,权衡灵活性、可扩展性与效率。我们比较了各类方法的优劣,评估了领域专用模型相对于通用模型的表现,指出了当前面临的挑战与机遇。此外,还汇总了常用数据集与评测基准。为追踪最新进展,我们维护一个开源项目:https://github.com/abilliyb/Knowledge_Injection_Survey_Papers,持续收录该领域研究成果。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated remarkable success in various tasks such as natural language understanding, text summarization, and machine translation. However, their general-purpose nature often limits their effectiveness in domain-specific applications that require specialized knowledge, such as healthcare, chemistry, or legal analysis. To address this, researchers have explored diverse methods to enhance LLMs by integrating domain-specific knowledge. In this survey, we provide a comprehensive overview of these methods, which we categorize into four key approaches: dynamic knowledge injection, static knowledge embedding, modular adapters, and prompt optimization. Each approach offers unique mechanisms to equip LLMs with domain expertise, balancing trade-offs between flexibility, scalability, and efficiency. We discuss how these methods enable LLMs to tackle specialized tasks, compare their advantages and disadvantages, evaluate domain-specific LLMs against general LLMs, and highlight the challenges and opportunities in this emerging field. For those interested in delving deeper into this area, we also summarize the commonly used datasets and benchmarks. To keep researchers updated on the latest studies, we maintain an open-source at: https://github.com/abilliyb/Knowledge_Injection_Survey_Papers, dedicated to documenting research in the field of specialized LLM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。