让大模型疲劳可被感知并干预,提升对话稳定性
Chatsparent: An Interactive System for Detecting and Mitigating Cognitive Fatigue in LLMs
- 通过注意力衰减等信号实时检测模型认知疲劳
- 疲劳时输出质量下降,干预后可恢复稳定
- 适合关注模型可靠性与交互体验的研究者
大语言模型越来越多地被用作聊天机器人,但现有界面几乎无摩擦:用户在无缝对话中难以察觉模型是否出现漂移、幻觉或失效。这种缺乏透明度助长了盲目信任,导致输出不稳定或重复。我们提出 Chatsparent——一个交互式演示系统,用于发现并缓解认知疲劳这一故障模式,即模型在自回归生成过程中逐渐丧失连贯性。该系统通过实时监测注意力-提示衰减、嵌入漂移和熵塌陷等分词级信号,构建统一的疲劳指数。当疲劳阈值被触发时,界面允许用户激活轻量级干预措施,如注意力重置、熵正则化解码和自我反思检查点。演示实时展示文本与疲劳信号,使用户能观察疲劳何时发生、如何影响输出质量,以及干预如何恢复稳定性。通过将被动对话变为交互式诊断体验,本系统帮助用户更好地理解大模型行为,同时提升推理阶段的可靠性。
原文摘要 · Abstract (English)
LLMs are increasingly being deployed as chatbots, but today's interfaces offer little to no friction: users interact through seamless conversations that conceal when the model is drifting, hallucinating or failing. This lack of transparency fosters blind trust, even as models produce unstable or repetitive outputs. We introduce an interactive demo that surfaces and mitigates cognitive fatigue, a failure mode where LLMs gradually lose coherence during auto-regressive generation. Our system, Chatsparent, instruments real-time, token-level signals of fatigue, including attention-to-prompt decay, embedding drift, and entropy collapse, and visualizes them as a unified fatigue index. When fatigue thresholds are crossed, the interface allows users to activate lightweight interventions such as attention resets, entropy-regularized decoding, and self-reflection checkpoints. The demo streams live text and fatigue signals, allowing users to observe when fatigue arises, how it affects output quality, and how interventions restore stability. By turning passive chatbot interaction into an interactive diagnostic experience, our system empowers users to better understand LLM behavior while improving reliability at inference time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。