arXiv:2502.16169cs.AI2025-02ACL被引 20

测试大模型在噪声数据下的归纳推理能力,发现其易受模式干扰而失效。

Patterns Over Principles: The Fragility of Inductive Reasoning in LLMs under Noisy Observations

  • 通过多样化观测与反馈引导,提升模型推理稳定性
  • 噪声下模型准确率变化小但一致性不足(仅70%一致)
  • 揭示模型依赖记忆模式而非真正抽象,适合研究推理脆弱性者

归纳推理是人类认知的核心,使我们能从有限数据中泛化,但大型语言模型(LLMs)尚未完全实现此能力。尽管现代LLMs在推理任务中表现优异,其在不完美观测下的规则抽象稳定性仍缺乏深入探索。为此,本文提出鲁棒规则归纳任务,评估模型从含噪样本中推断规则的能力,并引入样本驱动的规则精炼(SRR)方法,通过观测多样性与执行引导反馈增强推理稳定性。在算术、密码学和列表函数任务上的实验表明:(1)SRR在噪声下性能衰减最小;(2)尽管准确率波动小,模型一致性差(如仅70%一致得分);(3)反事实任务差距显示,模型更依赖记忆模式而非真正抽象。研究挑战了现有模型的推理鲁棒性,揭示其易受假设漂移与模式过拟合影响,为构建类人归纳系统提供关键实证支持。代码与数据见https://github.com/HKUST-KnowComp/Robust-Rule-Induction。

原文摘要 · Abstract (English)

Inductive reasoning, a cornerstone of human cognition, enables generalization from limited data but hasn't yet been fully achieved by large language models (LLMs). While modern LLMs excel at reasoning tasks, their ability to maintain stable and consistent rule abstraction under imperfect observations remains underexplored. To fill this gap, in this work, we introduce Robust Rule Induction, a task that evaluates LLMs' capability in inferring rules from data that are fused with noisy examples. To address this task, we further propose Sample-steered Rule Refinement (SRR), a method enhancing reasoning stability via observation diversification and execution-guided feedback. Experiments across arithmetic, cryptography, and list functions reveal: (1) SRR outperforms other methods with minimal performance degradation under noise; (2) Despite slight accuracy variation, LLMs exhibit instability under noise (e.g., 0% accuracy change with only 70% consistent score); (3) Counterfactual task gaps highlight LLMs' reliance on memorized patterns over genuine abstraction. Our findings challenge LLMs' reasoning robustness, revealing susceptibility to hypothesis drift and pattern overfitting, while providing empirical evidence critical for developing human-like inductive systems. Code and data are available at https://github.com/HKUST-KnowComp/Robust-Rule-Induction.

归纳推理模型脆弱性噪声鲁棒性规则学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。