让大模型根据任务自动切换视角,提升主观题回答质量。
Perspective Transition of Large Language Models for Solving Subjective Tasks
- 通过上下文学习动态选择直接、角色或第三人称视角
- 在12个主观任务上超越固定视角方法,最高提升18.3%
- 适合需要多角度推理的开放性问题场景
大型语言模型(LLMs)在自然语言处理中取得显著进展,但在主观任务上的表现仍受限。视角选择对理解上下文和生成恰当回应至关重要:有时从专家视角更优,可激发领域知识;有时第三人称视角更准确,能全面理解问题并减少偏见。本文提出基于上下文学习的视角转换方法(RPT),使模型在直接、角色与第三人称视角间动态选择,以最优方式应对不同主观问题。在包含GPT-4、GPT-3.5、Llama-3和Qwen-2在内的多种闭源与开源模型上,对12个主观任务进行实验,结果表明该方法优于链式思维提示等固定视角方法,凸显了模型适应性视角对生成精细化、情境化回应的重要性。
原文摘要 · Abstract (English)
Large language models (LLMs) have revolutionized the field of natural language processing, enabling remarkable progress in various tasks. Different from objective tasks such as commonsense reasoning and arithmetic question-answering, the performance of LLMs on subjective tasks is still limited, where the perspective on the specific problem plays crucial roles for better interpreting the context and giving proper response. For example, in certain scenarios, LLMs may perform better when answering from an expert role perspective, potentially eliciting their relevant domain knowledge. In contrast, in some scenarios, LLMs may provide more accurate responses when answering from a third-person standpoint, enabling a more comprehensive understanding of the problem and potentially mitigating inherent biases. In this paper, we propose Reasoning through Perspective Transition (RPT), a method based on in-context learning that enables LLMs to dynamically select among direct, role, and third-person perspectives for the best way to solve corresponding subjective problem. Through extensive experiments on totally 12 subjective tasks by using both closed-source and open-source LLMs including GPT-4, GPT-3.5, Llama-3, and Qwen-2, our method outperforms widely used single fixed perspective based methods such as chain-of-thought prompting and expert prompting, highlights the intricate ways that LLMs can adapt their perspectives to provide nuanced and contextually appropriate responses for different problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。