让大模型系统化组织知识并计算分析,生成深度洞察报告
KnowCoder-V2: Deep Knowledge Analysis
- 先离线构建结构化知识库,再在线执行复杂知识计算
- 在30多个数据集上验证,生成报告质量显著优于主流框架
- 通过统一代码生成连接知识组织与推理,适合复杂分析任务
深度知识分析任务需从海量数据中系统提取并关联知识,经逻辑推理发现洞察。现有深度研究框架面临三大挑战:缺乏知识的系统组织与管理;仅支持在线操作,难以高效处理共享大规模知识的任务;无法执行复杂知识计算,限制深入分析能力。为此,本文提出知识型深度研究(KDR)框架,引入独立的知识组织阶段,将大规模领域相关数据离线转化为系统化知识。基于此知识,扩展深度研究以支持在线复杂知识计算。为进一步提升大模型在该框架下的能力,提出 extbf{췜},一种通过统一代码生成连接知识组织与推理的大模型。在知识组织阶段,生成预定义类的实例化代码,将数据转为知识对象;在知识计算阶段,生成分析代码并在知识对象上执行,获得深度分析结果。在六个知识分析任务、超过三十个数据集上的实验表明,췜有效。集成至KDR框架后,其生成报告的洞察性远超主流深度研究框架。
原文摘要 · Abstract (English)
Deep knowledge analysis tasks always involve the systematic extraction and association of knowledge from large volumes of data, followed by logical reasoning to discover insights. However, to solve such complex tasks, existing deep research frameworks face three major challenges: 1) They lack systematic organization and management of knowledge; 2) They operate purely online, making it inefficient for tasks that rely on shared and large-scale knowledge; 3) They cannot perform complex knowledge computation, limiting their abilities to produce insightful analytical results. Motivated by these, in this paper, we propose a \textbf{K}nowledgeable \textbf{D}eep \textbf{R}esearch (\textbf{KDR}) framework that empowers deep research with deep knowledge analysis capability. Specifically, it introduces an independent knowledge organization phase to preprocess large-scale, domain-relevant data into systematic knowledge offline. Based on this knowledge, it extends deep research with an additional kind of reasoning steps that perform complex knowledge computation in an online manner. To enhance the abilities of LLMs to solve knowledge analysis tasks in the above framework, we further introduce \textbf{\KCII}, an LLM that bridges knowledge organization and reasoning via unified code generation. For knowledge organization, it generates instantiation code for predefined classes, transforming data into knowledge objects. For knowledge computation, it generates analysis code and executes on the above knowledge objects to obtain deep analysis results. Experimental results on more than thirty datasets across six knowledge analysis tasks demonstrate the effectiveness of \KCII. Moreover, when integrated into the KDR framework, \KCII can generate high-quality reports with insightful analytical results compared to the mainstream deep research framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。