越懂模型,越不信任:解释可视化反而暴露偏见,降低信任
Your Model Is Unfair, Are You Even Aware? Inverse Relationship Between Comprehension and Trust in Explainability Visualizations of Biased ML Models
- 设计更清晰的可视化让非专家更好理解模型
- 理解越深,感知到的偏见越多,信任反而下降
- 优化可视化可减少偏见感知,提升信任,适合政策制定者
依赖机器学习的系统日益普及,但其中的偏见问题也愈发显著。研究显示,偏见严重影响利益相关者对系统的信任与使用方式,且不同背景用户对同一系统信任度不同。因此,模型行为的解释方式在理解和信任中起关键作用。本文调研了多种可解释性可视化方法,构建设计特征分类体系,并通过用户实验评估五种前沿工具(LIME、SHAP、CP、Anchors、ELI5)对非专家用户的影响。结果显示:理解程度与信任呈负相关——理解越深,信任越低。原因在于更清晰的可视化增强了用户对偏见的感知,进而降低信任。通过操控可视化设计,我们证实该关系具有因果性(p < 0.001):控制理解度和偏见感知,能显著提升理解、加剧偏见感知并削弱信任;反之,通过改进模型公平性或调整可视化设计来降低偏见感知,即使理解度高,也能显著提升信任。本研究深化了对理解与信任关系的理解,系统揭示了可视化在负责任机器学习应用中的关键作用。
原文摘要 · Abstract (English)
Systems relying on ML have become ubiquitous, but so has biased behavior within them. Research shows that bias significantly affects stakeholders' trust in systems and how they use them. Further, stakeholders of different backgrounds view and trust the same systems differently. Thus, how ML models' behavior is explained plays a key role in comprehension and trust. We survey explainability visualizations, creating a taxonomy of design characteristics. We conduct user studies to evaluate five state-of-the-art visualization tools (LIME, SHAP, CP, Anchors, and ELI5) for model explainability, measuring how taxonomy characteristics affect comprehension, bias perception, and trust for non-expert ML users. Surprisingly, we find an inverse relationship between comprehension and trust: the better users understand the models, the less they trust them. We investigate the cause and find that this relationship is strongly mediated by bias perception: more comprehensible visualizations increase people's perception of bias, and increased bias perception reduces trust. We confirm this relationship is causal: Manipulating explainability visualizations to control comprehension, bias perception, and trust, we show that visualization design can significantly (p < 0.001) increase comprehension, increase perceived bias, and reduce trust. Conversely, reducing perceived model bias, either by improving model fairness or by adjusting visualization design, significantly increases trust even when comprehension remains high. Our work advances understanding of how comprehension affects trust and systematically investigates visualization's role in facilitating responsible ML applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。