arXiv:2512.20884cs.AI2025-12

让大模型主动分享知识,用概率框架解决智能体认知不对称问题

The Silent Scholar Problem: A Probabilistic Framework for Breaking Epistemic Asymmetry in LLM Agents

  • 用贝塔-伯努利分布建模信念,引入遗忘因子量化认知不确定性
  • 在信念均值0.5时交换信息能最大提升学习效率,显著优于随机策略
  • 适合需要协作进化的大模型系统,可直接用于强化学习奖励设计

由大语言模型和检索增强生成(RAG)驱动的自主智能体虽擅长获取数字内容,但存在单向接收的局限,我们称之为认知不对称。这种孤立导致重复推理,阻碍集体智能发展。现有自我反思机制多为启发式且私密,缺乏概率基础来衡量确定性或解释外部交互。为此,我们提出一个形式化的概率框架,使智能体具备非利他性动机进行双向知识交换。通过引入遗忘因子γ,用贝塔-伯努利分布建模智能体对命题的信念,将认知不确定性定义为信念方差。由此形成双重交互驱动力:维持确定性的稳态需求,以及针对最大模糊点(期望信念θ=0.5)的最优学习策略。在此框架下,公开贡献被重构为最优主动学习——分享解决方案以获取反馈,是降低自身不确定性的最高效方式。为保证可扩展性,引入认知缓存机制,利用遗忘因子动态优先处理非平稳知识分布的活跃头部。最后,我们证明累积的信念状态可作为可验证的奖励信号用于人类反馈强化学习(RLHF),并作为高质量数据过滤器用于监督微调(SFT)。模拟结果表明,该不确定性驱动策略在异构(齐普夫分布)环境中显著优于随机基线,并保持对概念漂移的高适应性。

原文摘要 · Abstract (English)

Autonomous agents powered by LLMs and Retrieval-Augmented Generation (RAG) are proficient consumers of digital content but remain unidirectional, a limitation we term epistemic asymmetry. This isolation leads to redundant reasoning and stagnates collective intelligence. Current self-reflection frameworks remain largely heuristic and private, lacking a probabilistic foundation to quantify certainty or justify external interaction.To bridge this gap, we propose a formal probabilistic framework that provides agents with a non-altruistic motive for bidirectional knowledge exchange. We model an agent's belief in a proposition using a Beta-Bernoulli distribution with a forgetting factor ($γ$). This allows us to isolate epistemic uncertainty as the variance of belief, establishing a dual drive for interaction: A homeostatic motive: The need to maintain certainty against the temporal decay introduced by $γ$. An optimal learning strategy: Targeting points of maximum ambiguity ($\mathbb{E}[θ]=0.5$) to maximize information gain. Under this framework, public contribution is reframed as optimal active learning: sharing solutions to elicit feedback is the most efficient method for an agent to reduce its own uncertainty. To ensure scalability, we introduce epistemic caching, which leverages the forgetting factor to dynamically prioritize resources for the active head of non-stationary knowledge distributions. Finally, we demonstrate how these accumulated belief states serve as verifiable reward signals for Reinforcement Learning from Human Feedback (RLHF) and high-quality data filters for Supervised Fine-Tuning (SFT). Simulation results validate that this uncertainty-driven strategy significantly outperforms random baselines in heterogeneous (Zipfian) environments, maintaining high adaptability to concept drift.

大模型智能体认知建模主动学习协作推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。