让大模型像人一样多角度思考,生成更符合用户偏好的回答。
Pathways of Thoughts: Multi-Directional Thinking for Long-form Personalized Question Answering
- 通过动态选择推理、修正、个性化等操作,探索多种思考路径。
- 在LaMP-QA上相对基线最高提升10.8%,人类评估偏好率66%。
- 无需微调即可适配任意大模型,适合需要深度个性化的问答场景。
个性化在搜索与推荐中研究充分,但在长而嘈杂的隐式上下文中推断用户偏好并生成准确且契合期望的回答仍具挑战。为此,我们提出路径之思(PoT),一种适用于任何大语言模型的推理阶段方法,无需任务特定微调。PoT将思维建模为迭代决策过程,动态选择推理、修订、个性化和澄清等认知操作,探索多种推理轨迹,生成涵盖不同视角的候选响应。随后根据推断的用户偏好聚合并重加权这些候选结果,融合多元推理路径的优势,生成最终个性化响应。在LaMP-QA基准上的实验表明,PoT持续优于多个竞争基线,相对提升最高达10.8%。人工评估进一步验证了效果,标注者在66%的案例中更偏好PoT,15%为平局。
原文摘要 · Abstract (English)
Personalization is well studied in search and recommendation, but personalized question answering remains underexplored due to challenges in inferring preferences from long, noisy, implicit contexts and generating responses that are both accurate and aligned with user expectations. To address this, we propose Pathways of Thoughts (PoT), an inference-stage method that applies to any large language model (LLM) without task-specific fine-tuning. PoT models the thinking as an iterative decision process, where the model dynamically selects among cognitive operations such as reasoning, revision, personalization, and clarification. This enables exploration of multiple reasoning trajectories, producing diverse candidate responses that capture different perspectives. PoT then aggregates and reweights these candidates according to inferred user preferences, yielding a final personalized response that benefits from the complementary strengths of diverse reasoning paths. Experiments on the LaMP-QA benchmark show that PoT consistently outperforms competitive baselines, achieving up to a 10.8\% relative improvement. Human evaluation further validates these improvements, with annotators preferring PoT in 66\% of cases compared to the best-performing baseline and reporting ties in 15\% of cases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。