arXiv:2509.24836cs.AIcs.CL2025-09ACL被引 1

通过量化逻辑密度提升大模型推理能力,不增数据量也能显著增强思维深度。

Logical Structure as Knowledge: Enhancing LLM Reasoning via Structured Logical Knowledge Density Estimation

  • 将自然语言拆解为可执行谓词与逻辑基元,计算其逻辑知识密度
  • 实验显示高逻辑密度样本能显著提升模型推理准确率与泛化能力
  • 适合关注模型思维质量而非数据规模的研究者与开发者

大型语言模型的推理能力越来越依赖于训练数据质量,而非单纯的参数规模。然而,现有以数据为中心的方法常将质量等同于事实性或多样性,忽略了训练样本内部的逻辑复杂性。本文提出自然语言中蕴含着由蕴含关系与逻辑拓扑构成的结构化逻辑知识。为此,我们引入结构化逻辑知识密度(SLKD)这一新指标,通过将自然语言分解为可执行谓词和逻辑基元来衡量其逻辑信息含量。分析发现当前数据集中逻辑信号普遍稀疏。因此,我们提出一种基于密度感知的重识别优化策略,优先选择高密度逻辑样本以增强模型推理能力。大量实验证明,该方法在不增加数据总量的前提下显著提升了推理性能与泛化能力。进一步在强化学习框架中验证,结果表明提升逻辑密度比扩大数据规模更关键,是释放大模型认知潜力的核心路径。代码已发布于附录C。

原文摘要 · Abstract (English)

The reasoning capabilities of Large Language Models (LLMs) are increasingly attributed to training data quality rather than mere parameter scaling. However, existing data-centric paradigms often equate quality with factuality or diversity and ignore the internal logical complexity of training samples. In this work, we propose that natural language harbors Structured Logical Knowledge manifested through entailment relationships and logical topologies. To quantify this, we introduce Structured Logical Knowledge Density (SLKD), a novel metric that measures logical information content by decomposing natural language into executable predicates and logical primitives. Our analysis reveals a significant logical disparity in current datasets where sparse logical signals predominate. Consequently, we propose a density aware re-cognizing optimization strategy that prioritizes high-density logical samples to enhance with the LLM's reasoning ability. Extensive experiments demonstrate that our approach enhances reasoning performance and generalization without increasing total data volume. These results, further validated within a reinforcement learning framework, suggest that elevating logical density is more critical than expanding data scale for realizing the full cognitive potential of LLMs. The released code is available in the Appendix C.

逻辑推理知识密度大模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。