arXiv:2607.14371cs.LGecon.TH2026-07被引 1

对比微调与上下文学习,揭示用户个性化策略的资源博弈规律。

Supervised Fine-Tuning vs. In-Context Learning: An Equilibrium Analysis of LLM Personalization under Congestion

论文配图:Supervised Fine-Tuning vs. In-Context Learning: An Equilibrium Analysis of LLM Personalization under Congestion
图 1 · 摘自论文原文
  • 构建可计算的框架分析用户在资源竞争下的个性化决策
  • 发现预训练覆盖度和信号噪声比决定方法优劣,但拥堵会反转结果
  • 平台同时提供两种方法反而能提升利润,适合服务设计者参考

大语言模型革新了人工智能服务,但个性化虽能提升性能,却消耗稀缺计算资源,用户间存在共享竞争。何时应投入昂贵的监督微调(SFT),何时选择轻量的上下文学习(ICL)?其他用户的个性化行为带来的拥堵如何改变激励?平台应如何设计多种个性化算法?我们提出一个可处理的LLM服务框架,刻画用户面临的统计-经济权衡。分析揭示若干意外发现:首先,ICL与SFT在不同条件下占优,取决于预训练覆盖度与数据信噪比,但拥堵可能逆转其排序;其次,均衡资源消耗呈现显著非单调性:提高预训练精度降低拥堵,而更广覆盖度或更难任务反而可能增加拥堵;第三,证明平台同时提供两种个性化方法不会损害其最大收益,即使增加计算负载。基于GPT-2在线性回归任务上的实验验证了理论预测。补充研究表明,21家主流平台中同时提供SFT与ICL的比例从2021年的9.5%升至2025年的71.4%,符合我们的平台设计推论。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have revolutionized AI services, but a critical tension emerges: while personalization improves model performance, it consumes scarce computational resources that users must share. When should a user invest in expensive Supervised Fine-Tuning (SFT) versus lightweight In-Context Learning (ICL)? How does congestion from other users' personalization choices reshape these incentives? And what strategies should platforms adopt when offering multiple personalization algorithms? We develop a tractable framework for LLM serving that captures the statistical-economic trade-offs users face. Our analysis yields several surprising insights. First, we show that ICL and SFT dominate in different regimes, determined by an interplay between pretraining coverage and data signal-to-noise ratios, but congestion can flip these rankings. Second, equilibrium resource consumption exhibits pronounced non-monotonicity: improving pretraining precision reduces the congestion, while broader pretraining coverage and harder tasks sometimes increase it. Third, we prove that offering both personalization methods never hurts the platform's maximal profits, despite potentially increasing computational load. Experiments with GPT-2 on linear regression tasks validate our theoretical predictions about algorithm performance. Complementing these results, our review of documentation from 21 major AI platforms shows that the share offering both SFT and ICL increased from 9.5% in 2021 to 71.4% in 2025, consistent with our platform-design implications.

大模型个性化资源优化平台设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。