arXiv:2606.00532cs.AI2026-06

KACE通过分层知识组织,让大模型数学推理更高效准确。

KACE: Knowledge-Adaptive Context Engineering for Mathematical Reasoning

  • 用难度与领域分层的卡片树分离知识存储与使用
  • AIME 2025上达62.2%准确率,比固定Best-of-5提升10.4点
  • 适合需要高精度数学推理且资源受限的应用场景

上下文工程可在不更新权重的情况下提升大语言模型性能,但数学推理面临关键瓶颈:不断增长的提示导致上下文膨胀,限制可利用的指导信息量。现有方法常混淆存储与使用,因而受限于提示长度。本文提出知识自适应上下文工程(KACE),通过难度与领域组织实现存储与使用的分离。离线阶段,自反思学习循环将训练轨迹提炼为认知树——按问题难度和认知领域分层的知识卡片库,每张卡片归属其对应失败类型。推理时,分层自我一致性结合逐层一致门动态分类问题为简单、中等或困难。简单问题无需检索,困难问题仅调用匹配分支。该分层机制在相当计算量下达到或超越Best-of-N效果,问题难度分类达78%成对一致性。主要贡献在于构建并使用基于难度与领域分层的知识库,借助分层自我一致性实现高效推理。在AIME 2025上,KACE取得62.2%准确率,相比固定Best-of-5自洽提升10.4个百分点,相较最强学习型上下文基线Tiered + GEPA提升5.6个百分点。在MATH-HARD与OlymMATH可验证子集上亦有稳定提升。

原文摘要 · Abstract (English)

Context engineering can improve large language models without updating their weights, but mathematical reasoning exposes a key limitation: feedback accumulated in one growing prompt causes context bloat and limits the amount of learned guidance that can be used. Existing methods often conflate storage, what is learned across runs, with usage, what is included for a particular problem, and therefore inherit this prompt-size ceiling. We introduce Knowledge-Adaptive Context Engineering (KACE), which separates storage from usage through difficulty- and domain-based organization. Offline, a self-reflective learning loop distills training traces into an epistemic tree: a knowledge base of typed cards stratified by problem difficulty and epistemic domain. Each card is assigned to the difficulty-domain node corresponding to the failure from which it originated. At evaluation time, tiered self-consistency with per-tier agreement gates dynamically classifies each problem as easy, medium, or hard. Easy problems exit without retrieved cards, while harder problems retrieve only the matching branch of the tree. This tiered scheme matches or exceeds Best-of-N while using comparable compute, and it classifies problem difficulty with 78 percent pairwise concordance. The main empirical contribution is the construction and use of a difficulty- and domain-stratified knowledge base enabled by tiered self-consistency. On AIME 2025, KACE achieves 62.2 percent accuracy, a 10.4-point absolute gain over fixed Best-of-5 self-consistency at a comparable solver-call budget and a 5.6-point gain over the strongest learned-context baseline, Tiered + GEPA. We also observe consistent gains on MATH-HARD and the verifiable subset of OlymMATH.

数学推理知识工程上下文优化分层推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。