让大模型持续学习领域新知,无需重训
MARK: Memory Augmented Refinement of Knowledge
- 用三类智能代理管理动态知识,实现记忆更新
- 显著减少幻觉,提升医疗法律等领域的准确率
- 适合需要长期记忆与个性化的AI助手场景
大型语言模型在专业任务中表现优异,但难以在不进行昂贵微调的情况下跟上不断变化的领域知识。领域知识包括:不可变事实(如‘石头是固体’)和普遍接受的原则(如伦理标准);以及由业务需求和现实变化塑造的动态洞察。然而,领域专家的深层理解与系统知识之间常存在显著差距,影响信息检索与应用的准确性。本文提出记忆增强型知识精炼框架MARK,通过结构化动态记忆使大模型无需重训练即可持续学习。MARK采用三类专用代理:残差精炼记忆代理负责存储与检索领域特定洞察以保持上下文连贯性;用户问题精炼记忆代理捕获用户提供的事实、缩写与术语以提升理解;大模型响应精炼记忆代理提取响应中的关键要素用于优化与个性化。这些代理分析存储的记忆,识别模式,解决矛盾,提升响应准确性。时间因素如近期性与频率优先级确保相关知识保留,过时内容被剔除。MARK在多个方面增强大模型能力:建立真实参考策略以减少幻觉;支持医疗、法律、制造等领域的专有知识适应;提升虚拟助手的个性化水平,使其能记住用户偏好并提供一致回应。
原文摘要 · Abstract (English)
Large Language Models (LLMs) assist in specialized tasks but struggle to align with evolving domain knowledge without costly fine-tuning. Domain knowledge consists of: Knowledge: Immutable facts (e.g., 'A stone is solid') and generally accepted principles (e.g., ethical standards); Refined Memory: Evolving insights shaped by business needs and real-world changes. However, a significant gap often exists between a domain expert's deep, nuanced understanding and the system's domain knowledge, which can hinder accurate information retrieval and application. Our Memory-Augmented Refinement of Knowledge (MARK) framework enables LLMs to continuously learn without retraining by leveraging structured refined memory, inspired by the Society of Mind. MARK operates through specialized agents, each serving a distinct role: Residual Refined Memory Agent: Stores and retrieves domain-specific insights to maintain context over time; User Question Refined Memory Agent: Captures user-provided facts, abbreviations, and terminology for better comprehension; LLM Response Refined Memory Agent: Extracts key elements from responses for refinement and personalization. These agents analyse stored refined memory, detect patterns, resolve contradictions, and improve response accuracy. Temporal factors like recency and frequency prioritize relevant information while discarding outdated insights. MARK enhances LLMs in multiple ways: Ground Truth Strategy: Reduces hallucinations by establishing a structured reference; Domain-Specific Adaptation: Essential for fields like healthcare, law, and manufacturing, where proprietary insights are absent from public datasets; Personalized AI Assistants: Improves virtual assistants by remembering user preferences, ensuring coherent responses over time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。