arXiv:2512.12608cs.CLcs.AI2025-12被引 3

让大模型像人一样学习罕见问题,记住关键经验并发现多样解法。

Human-Inspired Learning for Large Language Models via Obvious Record and Maximum-Entropy Method Discovery

  • 用符号记忆存储因果关系,单次经验也能持久保留。
  • 通过最大熵筛选不同思路,发现更多稀有但有效的解法。
  • 适合处理罕见场景,如硬件异常或物联网设备故障。

大语言模型在海量语料中擅长提取共性模式,但在稀有、低资源或从未见过的场景(如特定硬件部署问题或异常物联网设备行为)上表现不佳,因这些情况在训练数据中极为稀少。此外,模型主要依赖隐式参数记忆,难以显式获取、回忆和优化方法,导致其更像直觉驱动的预测器而非有意识的方法学习者。受人类从稀有经验中学习的启发,本文提出一种融合两种互补机制的人类启发式学习框架。第一,显式记录因果关系(或问题-解决方案)作为符号记忆,实现单次或罕见经历的持续学习。第二,最大熵方法发现机制优先保留语义差异大的方法,从而捕捉通常被下一个词预测忽略的多样化、非主流策略。在包含60个语义多样的问题-解决方案对的基准上验证表明,该熵引导方法在未见问题覆盖度和内部多样性上显著优于随机基线,证实其能发现更具泛化能力与人类启发性的方法。

原文摘要 · Abstract (English)

Large Language Models (LLMs) excel at extracting common patterns from large-scale corpora, yet they struggle with rare, low-resource, or previously unseen scenarios-such as niche hardware deployment issues or irregular IoT device behaviors-because such cases are sparsely represented in training data. Moreover, LLMs rely primarily on implicit parametric memory, which limits their ability to explicitly acquire, recall, and refine methods, causing them to behave predominantly as intuition-driven predictors rather than deliberate, method-oriented learners. Inspired by how humans learn from rare experiences, this paper proposes a human-inspired learning framework that integrates two complementary mechanisms. The first, Obvious Record, explicitly stores cause--result (or question--solution) relationships as symbolic memory, enabling persistent learning even from single or infrequent encounters. The second, Maximum-Entropy Method Discovery, prioritizes and preserves methods with high semantic dissimilarity, allowing the system to capture diverse and underrepresented strategies that are typically overlooked by next-token prediction. Verification on a benchmark of 60 semantically diverse question--solution pairs demonstrates that the proposed entropy-guided approach achieves stronger coverage of unseen questions and significantly greater internal diversity than a random baseline, confirming its effectiveness in discovering more generalizable and human-inspired methods.

大模型学习稀有场景符号记忆最大熵

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。