用可视化面板展示多个AI模型的预测差异,帮用户看清谁在分歧、谁在共识。
AI-Spectra: A Visual Dashboard for Model Multiplicity to Enhance Informed and Transparent Decision-Making
- 用定制化切尔诺夫人脸图展示多模型输出,快速感知差异
- 在MNIST数据集上验证,多模型结果存在显著分歧但可识别共识
- 适合需要透明决策的场景,如医疗或金融审核
我们提出AI-Spectra,一种利用模型多样性的交互式系统。模型多样性指多个略有不同的AI模型对同一任务产生同样有效的预测结果,相当于同时拥有多个“专家顾问”并可能持有不同意见。面对多个可能相异的结果,用户难以判断,既可能因认知负荷过重而困惑,也可能误信单一模型。AI-Spectra通过可视化仪表板,呈现各模型生成何种结果,降低用户识别模型共识与分歧的认知负担。我们采用定制版切尔诺夫人脸(Chernoff Bots)实现多维信息表达,使用户能快速理解复杂模型配置并比较跨模型预测。设计基于人机交互与信息可视化经典原则。通过在MNIST数据集上训练多种变体模型进行数字识别的实验验证方法有效性。本工作推动了通过策略性使用多模型提升AI系统透明度、可信度与有效性的讨论。
原文摘要 · Abstract (English)
We present an approach, AI-Spectra, to leverage model multiplicity for interactive systems. Model multiplicity means using slightly different AI models yielding equally valid outcomes or predictions for the same task, thus relying on many simultaneous "expert advisors" that can have different opinions. Dealing with multiple AI models that generate potentially divergent results for the same task is challenging for users to deal with. It helps users understand and identify AI models are not always correct and might differ, but it can also result in an information overload when being confronted with multiple results instead of one. AI-Spectra leverages model multiplicity by using a visual dashboard designed for conveying what AI models generate which results while minimizing the cognitive effort to detect consensus among models and what type of models might have different opinions. We use a custom adaptation of Chernoff faces for AI-Spectra; Chernoff Bots. This visualization technique lets users quickly interpret complex, multivariate model configurations and compare predictions across multiple models. Our design is informed by building on established Human-AI Interaction guidelines and well know practices in information visualization. We validated our approach through a series of experiments training a wide variation of models with the MNIST dataset to perform number recognition. Our work contributes to the growing discourse on making AI systems more transparent, trustworthy, and effective through the strategic use of multiple models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。