arXiv:2604.03925cs.CLcs.AI2026-04被引 2

不需训练就能让大模型像人一样逐步更新偏好,适合隐私敏感场景。

AdaptFuse: Training-Free Sequential Preference Learning via Externalized Bayesian Inference

  • 用符号模块外化贝叶斯推理,大模型只负责语义理解。
  • 交互轮次越多准确率越高,三类推荐任务均超越基线。
  • 无需存储用户数据,适合注重隐私的应用场景。

大语言模型在多轮用户交互中难以积累证据,无法按贝叶斯推理方式更新信念。现有方法需在敏感交互数据上微调,限制了其在隐私敏感场景的应用。我们提出 AdaptFuse,一种无需训练的框架:将概率计算完全外化,由符号模块维护离散假设集上的贝叶斯后验,冻结的大模型通过多样本狄利克雷聚合提供语义推理。两者通过熵自适应融合,依据预测置信度自动加权,随证据累积逐步减少对大模型的依赖。我们在航班推荐、酒店推荐和网络购物三个领域,基于 Gemma 2 9B、Llama 3 8B、Qwen 2.5 7B 进行评估,结果表明 AdaptFuse 在所有任务中持续优于提示基线与微调的贝叶斯教学模型,准确率随交互轮次单调提升。这证明,合理的推理时算法可替代微调实现个性化推荐,且无需存储或训练敏感用户数据。所有代码与材料将开源。

原文摘要 · Abstract (English)

Large language models struggle to accumulate evidence across multiple rounds of user interaction, failing to update their beliefs in a manner consistent with Bayesian inference. Existing solutions require fine-tuning on sensitive user interaction data, limiting their applicability in privacy-conscious settings. We propose AdaptFuse, a training-free framework that externalizes probabilistic computation entirely from the LLM: a symbolic module maintains a Bayesian posterior over a discrete hypothesis set, while a frozen LLM contributes semantic reasoning via multi-sample Dirichlet aggregation. The two signals are combined through entropy-adaptive fusion, which automatically weights each source by its predictive confidence, shifting reliance from the LLM to the symbolic posterior as evidence accumulates. We evaluate across three domains: flight recommendation, hotel recommendation, and web shopping; on Gemma 2 9B, Llama 3 8B, and Qwen 2.5 7B. AdaptFuse consistently outperforms both prompting baselines and fine-tuned Bayesian Teaching models on all tasks, with accuracy improving monotonically over interaction rounds. These results demonstrate that principled inference-time algorithms can substitute for fine-tuning in personalized recommendation, without storing or training on sensitive user data. All the code and materials will be open-sourced.

贝叶斯推理推荐系统零样本隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。