分析用户在使用可解释AI工具时遇到的七大难题,揭示最严重问题。
From Questions to Insights: Exploring XAI Challenges Reported on Stack Overflow Questions
- 手动分析663个技术问答,梳理出7类常见挑战。
- 模型集成和解释不一致问题最普遍,集成问题最严重。
- 从业者建议提升解释一致性与简化集成流程。
可解释人工智能(XAI)技术虽被广泛用于解析模型表现,但用户在实际应用中仍面临诸多挑战,常在技术问答平台如Stack Overflow上寻求帮助。本研究通过手工分析663条相关提问,识别出七类核心挑战,其中模型集成与解释不一致问题最为普遍。进一步分析发现,模型集成问题在答案采纳率上关联最强,显示其严重性;而从业者反馈指出,解释不一致对实际使用影响最大。多数从业者建议提升解释一致性并简化集成流程。研究结果有助于改进XAI工具的可用性,并为未来研究提供基准。
原文摘要 · Abstract (English)
The lack of interpretability is a major barrier that limits the practical usage of AI models. Several eXplainable AI (XAI) techniques (e.g., SHAP, LIME) have been employed to interpret these models' performance. However, users often face challenges when leveraging these techniques in real-world scenarios and thus submit questions in technical Q&A forums like Stack Overflow (SO) to resolve these challenges. We conducted an exploratory study to expose these challenges, their severity, and features that can make XAI techniques more accessible and easier to use. Our contributions to this study are fourfold. First, we manually analyzed 663 SO questions that discussed challenges related to XAI techniques. Our careful investigation produced a catalog of seven challenges (e.g., disagreement issues). We then analyzed their prevalence and found that model integration and disagreement issues emerged as the most prevalent challenges. Second, we attempt to estimate the severity of each XAI challenge by determining the correlation between challenge types and answer metadata (e.g., the presence of accepted answers). Our analysis suggests that model integration issues is the most severe challenge. Third, we attempt to perceive the severity of these challenges based on practitioners' ability to use XAI techniques effectively in their work. Practitioners' responses suggest that disagreement issues most severely affect the use of XAI techniques. Fourth, we seek agreement from practitioners on improvements or features that could make XAI techniques more accessible and user-friendly. The majority of them suggest consistency in explanations and simplified integration. Our study findings might (a) help to enhance the accessibility and usability of XAI and (b) act as the initial benchmark that can inspire future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。