arXiv:2501.08120cs.AIcond-mat.dis-nn2025-01被引 28

用图结构动态扩展知识,实现跨领域自主推理。

In-situ graph reasoning and knowledge expansion using Graph-PReFLexOR

  • 基于图结构与符号抽象,构建可递归优化的推理框架。
  • 30亿参数模型在材料设计等任务中展现深度推理能力。
  • 适合需要跨学科创新的科研人员和智能系统开发者。

自动化科学发现推动了从符号逻辑到现代AI的发展,在推理与模式识别方面开辟新前沿。变压器模型具备潜在关系,但需任务约束才能显现,类似测量过程。仅靠概率选择无法满足结构化要求,需确保一致性与普适性原则。我们提出Graph-PReFLexOR(基于图的偏好式递归语言建模用于探索性推理优化),结合图推理与符号抽象,动态扩展领域知识。受强化学习启发,将推理视为结构化映射:任务生成知识图、抽象模式,最终输出答案。受范畴论启发,以节点表示概念,边表示关系,支持层次化推理与同构表示下的自适应学习。应用包括假设生成、材料设计及创造性推理,如发现‘灵薄之地’与材料科学间的关联。提出‘知识花园生长’策略,促进跨领域洞察融合。30亿参数的Graph-PReFLexOR模型在多项任务中表现卓越,验证其深层推理与适应能力,为透明、多学科的AI驱动发现奠定基础,有望发展通用自主推理解决方案。

原文摘要 · Abstract (English)

The pursuit of automated scientific discovery has fueled progress from symbolic logic to modern AI, forging new frontiers in reasoning and pattern recognition. Transformers function as potential systems, where every possible relationship remains latent potentiality until tasks impose constraints, akin to measurement. Yet, refining their sampling requires more than probabilistic selection: solutions must conform to specific structures or rules, ensuring consistency and the invocation of general principles. We present Graph-PReFLexOR (Graph-based Preference-based Recursive Language Modeling for Exploratory Optimization of Reasoning), a framework that combines graph reasoning with symbolic abstraction to dynamically expand domain knowledge. Inspired by reinforcement learning, Graph-PReFLexOR defines reasoning as a structured mapping, where tasks yield knowledge graphs, abstract patterns, and ultimately, final answers. Inspired by category theory, it encodes concepts as nodes and their relationships as edges, supporting hierarchical inference and adaptive learning through isomorphic representations. Demonstrations include hypothesis generation, materials design, and creative reasoning, such as discovering relationships between mythological concepts like 'thin places' with materials science. We propose a 'knowledge garden growth' strategy that integrates insights across domains, promoting interdisciplinary connections. Results with a 3-billion-parameter Graph-PReFLexOR model show superior reasoning depth and adaptability, underscoring the potential for transparent, multidisciplinary AI-driven discovery. It lays the groundwork for general autonomous reasoning solutions.

自主推理知识图谱跨学科生成式AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。