arXiv:2605.21063cs.CL2026-05

提出新评测框架,精准测试大模型对用户隐性风格偏好的适配能力。

APM: Evaluating Style Personalization in LLMs with Arbitrary Preference Mappings

论文配图:APM: Evaluating Style Personalization in LLMs with Arbitrary Preference Mappings
图 1 · 摘自论文原文
  • 用随机映射解耦用户属性与响应特征,避免模型依赖刻板印象。
  • 路由方法表现最佳,检索增强仅在强基座模型上有效,提示优化效果有限。
  • 适合关注个性化生成真实效果的研究者和开发者参考。

主流大模型回复常遵循默认风格,而用户对语气、简洁度和正式程度等偏好往往未明确表达。评估个性化方法能否捕捉这些隐性偏好极具挑战:用户仅提供提示而非参考回复,风格偏好无法客观验证,且无参考的LLM评判可能将个性化误判为通用质量提升。为此,我们提出任意偏好映射(APM)基准,通过隐藏的随机映射矩阵 $\mathbf{C}$ 将用户属性(如热情)与响应特质(如说服力)解耦。由于 $\mathbf{C}$ 无语义内容且每轮重采样,模型无法依赖刻板关联,必须从对话历史中推断偏好。基于此无偏评估方法,我们测试了检索增强、提示优化与路由三种个性化策略在 Llama-3.1-8B 与 Qwen-3.5-27B 上的表现。结果表明,路由最为可靠;检索增强仅在更强基座模型上见效;软提示优化未能显著优于非个性化基线。大规模评估显示,在真实场景下个性化仍具挑战,但所提方法展现潜力。

原文摘要 · Abstract (English)

Typical LLM responses tend to follow a default style, even though users often have distinct preferences regarding tone, verbosity, and formality that they do not explicitly state in their prompts. Evaluating whether personalization methods can adapt to these implicit preferences is challenging, since users typically provide prompts rather than reference responses, style preferences are not factually verifiable, and reference-free LLM judges may conflate personalization with general response quality. To address these challenges, we introduce the Arbitrary Preference Mapping (APM) benchmark, which decouples user attributes (e.g. enthusiastic) from response principles (e.g. persuasive) via a hidden, randomized mapping $\mathbf{C}$ that maps user attributes to preferences about response traits. Because $\mathbf{C}$ carries no semantic content and is resampled across runs, models cannot exploit stereotypical associations and must infer preferences from conversation history. Using this unbiased evaluation methodology, we adapt retrieval-augmented, prompt-optimization, and routing personalization methods and evaluate them on Llama-3.1-8B and Qwen-3.5-27B. Our results show that routing is the most reliable approach, while RAG only improves with the stronger base LLM, and soft prompt optimization fails to improve significantly over a non-personalized baseline. Our extensive evaluation reveals that in this realistic setting, personalization remains challenging, but our adapted methods show promise.

风格个性化评测基准大模型评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。