arXiv:2505.17571cs.CL2025-05被引 6

用推理模型提升个性化生成,解决输出不一致难题

Reasoning Meets Personalization: Unleashing the Potential of Large Reasoning Model for Personalized Generation

  • 设计分层思维模板引导推理模型生成结构化结果
  • 在检索密集任务中性能超越通用大模型37.2%以上
  • 适合需要精准个性化输出的智能交互场景

个性化是现代智能系统的关键任务,广泛应用于与大语言模型(LLMs)的交互中。尽管推理能力的提升显著增强了LLMs在数学和编程等任务中的表现,但其在个性化任务中的潜力仍待挖掘。本文首次系统评估了大推理模型(LRMs)在个性化任务中的表现。令人意外的是,尽管生成更多标记(tokens),LRMs在检索密集型场景中并未持续优于通用大模型,其优势逐渐消失。分析揭示三大限制:思维发散、响应格式错位、检索信息利用无效。为此,我们提出强化推理个性化(Reinforced Reasoning for Personalization, extsc{R2P})框架,引入分层推理思维模板以指导生成结构化输出;设计推理过程干预方法以强制遵循预设推理模式,增强对齐性;提出交叉引用机制确保一致性。大量实验表明,该方法显著优于现有技术。

原文摘要 · Abstract (English)

Personalization is a critical task in modern intelligent systems, with applications spanning diverse domains, including interactions with large language models (LLMs). Recent advances in reasoning capabilities have significantly enhanced LLMs, enabling unprecedented performance in tasks such as mathematics and coding. However, their potential for personalization tasks remains underexplored. In this paper, we present the first systematic evaluation of large reasoning models (LRMs) for personalization tasks. Surprisingly, despite generating more tokens, LRMs do not consistently outperform general-purpose LLMs, especially in retrieval-intensive scenarios where their advantages diminish. Our analysis identifies three key limitations: divergent thinking, misalignment of response formats, and ineffective use of retrieved information. To address these challenges, we propose Reinforced Reasoning for Personalization (\model), a novel framework that incorporates a hierarchical reasoning thought template to guide LRMs in generating structured outputs. Additionally, we introduce a reasoning process intervention method to enforce adherence to designed reasoning patterns, enhancing alignment. We also propose a cross-referencing mechanism to ensure consistency. Extensive experiments demonstrate that our approach significantly outperforms existing techniques.

个性化生成推理模型大模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。