arXiv:2606.05025cs.LGcs.AI2026-06

让小模型学会跨领域一致推理,解决大模型的思维捷径问题。

Invariant Gradient Alignment for Robust Reasoning Distillation

论文配图:Invariant Gradient Alignment for Robust Reasoning Distillation
图 1 · 摘自论文原文
  • 构建语义不同但逻辑相同的题目组,用梯度对齐训练小模型。
  • 在4个数据集上比基线最高提升14.3个百分点,推理一致性提升四倍。
  • 适合做知识蒸馏、需要鲁棒推理的场景,如医疗或法律AI。

大型语言模型存在思维捷径问题:当输入的语义表面与训练数据不同时,即使逻辑结构相同也会失效,影响链式思维推理的知识蒸馏效果。本文提出不变梯度对齐(IGA)训练框架,通过三个创新实现跨领域逻辑一致性:(i) 构建逻辑同分异构集,即在数学、医学、法律、科学等不同语义领域中共享相同逻辑结构的问题组;(ii) 设计可微的连续梯度冲突掩码,抑制跨域梯度方差大的参数维度,保留不变方向;(iii) 将掩码后的梯度截断奇异值分解投影回LoRA低秩流形,保持参数效率。理论上,IGA 的分布外泛化界优于经验风险最小化(ERM),且随同分异构领域数量改善,收敛速率与标准SGD相当。实验表明,IGA在四个基准上超越八种基线,准确率最高提升14.3个百分点,逻辑一致性分数从0.142降至0.031,实现四倍提升。

原文摘要 · Abstract (English)

Large language models (LLMs) suffer from shortcut learning: they systematically fail on out-of-distribution (OOD) inputs whose semantic surface differs from training data, even when the logical structure is identical. This undermines knowledge distillation pipelines that transfer chain-of-thought reasoning to smaller students. We introduce Invariant Gradient Alignment (IGA), a training framework that aligns gradient updates across semantically diverse but logically isomorphic examples via three innovations: (i) Logical Isomer Sets, groups of problems sharing identical logical structure across distinct semantic domains (mathematics, medicine, law, science); (ii) a differentiable \emph{Continuous Gradient Conflict Mask}, that suppresses parameter dimensions with high cross-domain gradient variance while preserving invariant directions; and (iii) a truncated SVD projection of the masked gradient back onto the LoRA low-rank manifold, maintaining parameter efficiency throughout. Theoretically, IGA yields tighter OOD generalization bounds than ERM, scaling with the number of isomer domains, and converges at the standard SGD rate under mild regularity. Empirically, IGA outperforms eight baselines across four benchmarks with accuracy gains up to 14.3 pp over ERM-SFT and a Logical Consistency Score of 0.031 versus 0.142 -- a fourfold improvement in representational invariance.

知识蒸馏逻辑推理鲁棒性LoRA

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。