Kongzi模型提升历史推理准确性,解决长链条事实错误问题。
Kongzi: A Historical Large Language Model with Fact Enhancement
- 融合高质量历史数据与事实强化学习策略
- 在历史问答和叙事生成中准确率显著优于现有模型
- 适合历史研究、学术写作等专业领域使用
最新大语言模型(LLMs)已从纯自然语言理解扩展至复杂推理任务。然而,当前推理模型在长推理链中常出现事实性错误,这对历史推理构成挑战,限制了大模型在知识密集型任务中的应用。历史研究不仅需要准确呈现事实,还需建立跨时间关联,并从零散且模糊的史料中推导出连贯结论。为此,我们提出Kongzi,一种专为历史分析设计的大语言模型。通过整合经过筛选的高质量历史数据及新颖的事实强化学习策略,Kongzi展现出强大的事实对齐能力与深度推理性能。在历史问答与叙事生成等任务上的大量实验表明,Kongzi在事实准确性和推理深度上均优于现有模型。该工作有效应对了历史文本特有的挑战,为专业领域内准确可靠的大型语言模型发展树立了新标准。
原文摘要 · Abstract (English)
The capabilities of the latest large language models (LLMs) have been extended from pure natural language understanding to complex reasoning tasks. However, current reasoning models often exhibit factual inaccuracies in longer reasoning chains, which poses challenges for historical reasoning and limits the potential of LLMs in complex, knowledge-intensive tasks. Historical studies require not only the accurate presentation of factual information but also the ability to establish cross-temporal correlations and derive coherent conclusions from fragmentary and often ambiguous sources. To address these challenges, we propose Kongzi, a large language model specifically designed for historical analysis. Through the integration of curated, high-quality historical data and a novel fact-reinforcement learning strategy, Kongzi demonstrates strong factual alignment and sophisticated reasoning depth. Extensive experiments on tasks such as historical question answering and narrative generation demonstrate that Kongzi outperforms existing models in both factual accuracy and reasoning depth. By effectively addressing the unique challenges inherent in historical texts, Kongzi sets a new standard for the development of accurate and reliable LLMs in professional domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。