让对话系统同时懂情绪和伦理风险,动态调整回应策略。
EthicMind: A Risk-Aware Framework for Ethical-Emotional Alignment in Multi-Turn Dialogue

- 在每轮对话中同步分析伦理风险与用户情绪,规划回应策略。
- 高风险与道德模糊场景下,伦理引导与情感互动更一致。
- 无需训练新模型,推理时即可实现动态平衡,适合敏感对话场景。
智能对话系统日益应用于情感与伦理敏感场景,若在共情或伦理判断上出错,可能造成严重伤害。现有对话模型通常孤立处理共情与伦理安全,难以随交互过程中的伦理风险和用户情绪变化调整行为。本文将对话中的伦理-情绪对齐问题建模为显式的逐轮决策问题,提出 extsc{EthicMind}——一种推理时运行的风险感知框架。每轮对话中, extsc{EthicMind} 联合分析伦理风险信号与用户情绪,制定高层响应策略,并生成兼顾伦理引导与情感共鸣的上下文相关回复,无需额外模型训练。为评估复杂伦理情境下的对齐表现,我们引入分风险层级、多轮次的评估协议,结合上下文感知的用户模拟。实验表明, extsc{EthicMind} 在高风险及道德模糊场景中,相比基线模型展现出更一致的伦理引导与情感参与度。
原文摘要 · Abstract (English)
Intelligent dialogue systems are increasingly deployed in emotionally and ethically sensitive settings, where failures in either emotional attunement or ethical judgment can cause significant harm. Existing dialogue models typically address empathy and ethical safety in isolation, and often fail to adapt their behavior as ethical risk and user emotion evolve across multi-turn interactions. We formulate ethical-emotional alignment in dialogue as an explicit turn-level decision problem, and propose \textsc{EthicMind}, a risk-aware framework that implements this formulation in multi-turn dialogue at inference time. At each turn, \textsc{EthicMind} jointly analyzes ethical risk signals and user emotion, plans a high-level response strategy, and generates context-sensitive replies that balance ethical guidance with emotional engagement, without requiring additional model training. To evaluate alignment behavior under ethically complex interactions, we introduce a risk-stratified, multi-turn evaluation protocol with a context-aware user simulation procedure. Experimental results show that \textsc{EthicMind} achieves more consistent ethical guidance and emotional engagement than competitive baselines, particularly in high-risk and morally ambiguous scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。