研究对话中角色信息可见性如何影响个人化生成效果。
Stranger, Fan, or Peer? A Systematic Study on the Role of Interlocutor in Persona-Based Dialogue Generation

- 分离训练、推理、评估阶段的角色信息可见性,系统分析其影响
- 训练时可见性决定模型是否真正表达个性而非复制文本
- 不对称可见性会导致目标内容泄露,易被识别
基于个人特征的对话系统通常以说话人背景信息为条件,但对话涉及至少两个参与者,且各方对彼此背景信息的可见性在训练、推理和评估阶段可能不同。以往研究常忽视这一差异,掩盖了仅在分阶段设置可见性时才会显现的机制。本文在包含说话人背景与对话数据的语料上,通过大语言模型作为判别器进行作者识别,系统考察目标说话人与对话伙伴在训练和推理中是否可见对方背景信息的影响。结果发现:(i)训练阶段的可见性比推理阶段更关键,决定模型是通过对话展现个性还是简单复制背景文本;(ii)在训练中允许对话伙伴看到目标背景信息,能减少模型复制目标文本的行为,而仅在推理时改变可见性影响较弱且不一致;(iii)在非对称披露场景下(仅对话伙伴可见目标背景),目标内容更易泄露至对话中,且当对话伙伴发言可见时,此类痕迹更易被判别器识别。结果表明,背景信息泄露是可见性配置方式的产物,必须区分三个阶段。
原文摘要 · Abstract (English)
Persona-based dialogue systems are usually conditioned on speaker biography, but dialogues involve at least two participants, and who has access to whose biography can vary across training, inference, and evaluation. Prior work often neglected these aspects, obscuring mechanisms that only appear when biography visibility is toggled separately across training, inference, and evaluation, a three-stage factorisation that prior work has largely treated as a single factor. We study this factorisation on a dataset of dialogues paired with speaker's biographies, varying whether the target and interlocutor speakers see each other's biographies during training and inference, and using an LLM as a judge to perform author identification. We find that (i) training-time visibility, more than inference-time visibility, determines whether models express persona traits through dialogue or fall back on copying biographical text (a known problem/phenomenon in persona-based generation); (ii) models trained with interlocutor-biography visibility copy less target-biographical text than models trained without it, while changing visibility only at inference time has a less consistent effect; and (iii) under asymmetric disclosure, where only the interlocutor sees the target biography, target content leaks into interlocutor turns more often, and dialogues containing such traces are easier for the judge to identify, especially when interlocutor turns are visible. These results suggest that biography leakage into generated turns is an artefact of how interlocutor visibility is configured across training and inference, and separating the three stages is necessary.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。