用知识图谱和多智能体系统生成更真实的历史人物传记。
AIstorian lets AI be a historian: A KG-powered multi-agent system for accurate biography generation
- 基于知识图谱的检索增强生成与多智能体纠错机制。
- 事实准确率提升3.8倍,幻觉率降低47.6%。
- 适合历史研究、文献生成与高可信度文本创作人群。
华为长期致力于探索AI在历史研究中的应用。人物传记作为抽象摘要的一种特殊形式,在历史研究中至关重要,但现有大语言模型(LLMs)难以应对风格一致性、事实准确性及跨文档信息碎片化等挑战。本文提出AIstorian,一种端到端的智能体系统,融合知识图谱(KG)驱动的检索增强生成(RAG)与抗幻觉多智能体架构。具体而言,AIstorian采用基于上下文学习的分块策略和基于知识图谱的索引,实现精准高效的参考检索;同时通过多智能体协同完成实时幻觉检测与按错误类型修正。此外,为使LLM掌握特定历史写作风格,采用两阶段训练方法:先结合数据增强的监督微调,再进行风格偏好优化。在真实历史人物‘进士’数据集上的大量实验表明,AIstorian相比基线模型,事实准确率提升3.8倍,幻觉率降低47.6%。数据与代码已开源:https://github.com/ZJU-DAILY/AIstorian。
原文摘要 · Abstract (English)
Huawei has always been committed to exploring the AI application in historical research. Biography generation, as a specialized form of abstractive summarization, plays a crucial role in historical research but faces unique challenges that existing large language models (LLMs) struggle to address. These challenges include maintaining stylistic adherence to historical writing conventions, ensuring factual fidelity, and handling fragmented information across multiple documents. We present AIstorian, a novel end-to-end agentic system featured with a knowledge graph (KG)-powered retrieval-augmented generation (RAG) and anti-hallucination multi-agents. Specifically, AIstorian introduces an in-context learning based chunking strategy and a KG-based index for accurate and efficient reference retrieval. Meanwhile, AIstorian orchestrates multi-agents to conduct on-the-fly hallucination detection and error-type-aware correction. Additionally, to teach LLMs a certain language style, we finetune LLMs based on a two-step training approach combining data augmentation-enhanced supervised fine-tuning with stylistic preference optimization. Extensive experiments on a real-life historical Jinshi dataset demonstrate that AIstorian achieves a 3.8x improvement in factual accuracy and a 47.6% reduction in hallucination rate compared to existing baselines. The data and code are available at: https://github.com/ZJU-DAILY/AIstorian.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。