让AI能对话式解释决策,适配不同用户理解水平。
Conversational Explanations: Discussing Explainable AI with Non-AI Experts
- 用自生成对话数据+去重惩罚和幻觉检测提升解释多样性与真实性。
- 自动评估中指标比基线提升超80%,人类评测显示理解与信任显著增强。
- 首次实现对静态解释后的自由提问实时对话,适合非专家使用。
可解释人工智能(XAI)旨在揭示AI模型的决策过程。现有方法多提供一次性、静态解释,难以适应用户知识水平与信息需求差异。对话式解释被提出以定制化XAI输出,但受限于训练数据稀缺。使用合成数据训练面临两大挑战:数据多样性不足与生成内容幻觉。为此,我们引入重复惩罚机制促进数据多样性,并采用幻觉检测器过滤虚假对话回合。我们在提出的fEw-shot Multi-round ConvErsational Explanation(EMCEE)系统上进行了自动与人工评估(N=60)。自动评估显示,相比基线,EMCEE在BLEU上提升81.6%,在ROUGE上提升80.5%;且有效缓解了合成数据导致的性能退化问题。人工评估表明,相较于基线与对照组,用户在理解力、接受度、信任感及协作意愿上均有显著提升。细粒度分析进一步证实,基于自生成合成数据训练可提升模型生成更真实、易懂回答的能力,从而改善交互效果。据我们所知,EMCEE是首个能在静态解释后响应自由提问的对话式解释方法。
原文摘要 · Abstract (English)
Explainable AI (XAI) aims to provide insights into the decisions made by AI models. To date, most XAI approaches provide only one-time, static explanations, which cannot cater to users' diverse knowledge levels and information needs. Conversational explanations have been proposed as an effective method to customize XAI explanations. However, building conversational explanation systems is hindered by the scarcity of training data. Training with synthetic data faces two main challenges: lack of data diversity and hallucination in the generated data. To alleviate these issues, we introduce a repetition penalty to promote data diversity and exploit a hallucination detector to filter out untruthful synthetic conversation turns. We conducted both automatic and human evaluations on the proposed system, fEw-shot Multi-round ConvErsational Explanation (EMCEE). For automatic evaluation, EMCEE achieves relative improvements of 81.6% in BLEU and 80.5% in ROUGE compared to the baselines. EMCEE also mitigates the degeneration of data quality caused by training on synthetic data. In human evaluations (N=60), EMCEE outperforms baseline models and the control group in improving users' comprehension, acceptance, trust, and collaboration with static explanations by large margins. Through a fine-grained analysis of model responses, we further demonstrate that training on self-generated synthetic data improves the model's ability to generate more truthful and understandable answers, leading to better user interactions. To the best of our knowledge, this is the first conversational explanation method that can answer free-form user questions following static explanations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。