arXiv:2605.24657cs.AIcs.SE2026-05

让大模型夜间学习用户交互,比反复提醒更省记忆空间且效果更好。

Beyond Inference-Only Deployment: Comparing Weight-Based Consolidation Against Cascading Compaction

  • 用反思与低秩微调将用户交互知识整合进模型权重
  • 知识保留率从36.8%提升至80.4%,提升43.6个百分点
  • 适合需要长期个性化的大模型应用开发者

主流大模型平台采用仅推理部署模式:模型不更新用户权重。用户需重复输入偏好和修正信息,基于上下文的替代方案占用上下文空间,且在级联压缩下性能下降。本文评估了一种替代方案:通过单张消费级显卡上的反思、合成与LoRA微调,实现夜间交互知识的权重整合。在十组真实软件开发对话(共1,146个测试问题,三种记忆类型)中,三轮级联压缩仅保留36.8%±3.0%的知识(介于无上下文的11.8%基准与全上下文90.1%上限之间),而知识整合保留80.4%±1.3%,提升43.6个百分点(配对t检验,t(9)=14.8,p<0.001),显著优于压缩方法,尤其在程序性修正(36.3%→74.6%)和项目事实(31.5%→78.2%)上优势明显。此外发现:平均每标记验证交叉熵与大模型评分准确性呈负相关(r=-0.51),而中位数则高度一致(r=+0.99),表明在容忍表面形式变化的评估中,均值易误导,稳健统计量才是可靠信号。持久个性化需突破仅推理部署,转向将知识固化到权重的架构。

原文摘要 · Abstract (English)

Major LLM platforms deploy models in an inference-only configuration: the model serves requests but never updates per-user weights. Users must repeatedly re-teach preferences, corrections, and project context, and context-based workarounds consume context-window space and degrade under cascading compaction. We evaluate an alternative: nightly consolidation of interaction knowledge into model weights via reflection, synthesis, and Low-Rank Adaptation (LoRA) fine-tuning on a single consumer GPU. Across ten realistic software development conversations (n = 10, 1,146 test questions across three memory types), three cycles of cascading compaction retain 36.8 +/- 3.0% of knowledge (between an 11.8% no-context floor and a 90.1% full-context ceiling), while consolidation retains 80.4 +/- 1.3% -- a 43.6 pp gain (paired t(9) = 14.8, p < 0.001) that more than doubles what compaction preserves, with the largest gains on procedural corrections (36.3% -> 74.6%) and episodic project facts (31.5% -> 78.2%). As a methodological aside, mean per-token validation cross-entropy is negatively correlated with LLM-judged accuracy (r = -0.51) while median per-token validation cross-entropy tracks accuracy almost exactly (r = +0.99): under evaluators that tolerate surface-form variation, the mean is misleading and a heavy-tail-robust statistic is the faithful signal. Persistent personalization requires moving beyond inference-only deployment toward architectures that consolidate knowledge into weights.

大模型个性化权重整合知识保留

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。