让小白也能看懂AI决策,用三种方法解释模型结果
Explaining AI Without Code: A User Study on Explainable AI
- 在无代码平台中集成三种可解释性技术,支持非专业用户理解模型
- 20人测试显示,新手任务完成率超80%,对解释效果评价高
- 兼顾新手易用性和专家深度需求,适合教育、医疗等场景应用
机器学习在医疗、金融等敏感领域应用日益广泛,但其决策过程缺乏透明度。可解释人工智能(XAI)旨在揭示模型预测逻辑,但多数方法需技术背景,难以惠及普通用户。尤其在无代码机器学习平台中,解释功能常被忽视。本文在开源无代码平台DashAI中设计并实现一个以用户为中心的XAI模块,整合部分依赖图(PDP)、特征重要性置换(PFI)与KernelSHAP三种技术,应用于表格分类任务。通过20名参与者(含新手与专家)的用户研究发现:(i)所有解释任务的成功率均达80%以上;(ii)新手在解释满意度量表(ESS,Cronbach's α=0.74)上认为解释有用、准确且可信,而专家更关注解释完整性与充分性;(iii)解释显著提升对自动化系统的可预测感与信任度(信任量表TiA,α=0.60),且新手的信任感高于专家。结果表明,未来无代码平台中的可解释性需同时满足易用性与深度要求。
原文摘要 · Abstract (English)
The increasing use of Machine Learning (ML) in sensitive domains such as healthcare, finance, and public policy has raised concerns about the transparency of automated decisions. Explainable AI (XAI) addresses this by clarifying how models generate predictions, yet most methods demand technical expertise, limiting their value for novices. This gap is especially critical in no-code ML platforms, which seek to democratize AI but rarely include explainability. We present a human-centered XAI module in DashAI, an open-source no-code ML platform. The module integrates three complementary techniques, which are Partial Dependence Plots (PDP), Permutation Feature Importance (PFI), and KernelSHAP, into DashAI's workflow for tabular classification. A user study (N = 20; ML novices and experts) evaluated usability and the impact of explanations. Results show: (i) high task success ($\geq80\%$) across all explainability tasks; (ii) novices rated explanations as useful, accurate, and trustworthy on the Explanation Satisfaction Scale (ESS, Cronbach's $α$ = 0.74, a measure of internal consistency), while experts were more critical of sufficiency and completeness; and (iii) explanations improved perceived predictability and confidence on the Trust in Automation scale (TiA, $α$ = 0.60), with novices showing higher trust than experts. These findings highlight a central challenge for XAI in no-code ML, making explanations both accessible to novices and sufficiently detailed for experts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。