arXiv:2601.22653cs.HCcs.AI2026-01

让安全分析员更信任AI助手,关键在解释方式的设计。

Human-Centered Explainability in AI-Enhanced UI Security Interfaces: Designing Trustworthy Copilots for Cybersecurity Analysts

  • 测试四种解释方式在安全界面的效果
  • 自然语言+信心可视化最提升判断准确率
  • 为安全团队设计可信AI工具提供指南

人工智能协作者正越来越多地被集成到企业级网络安全平台中,以协助分析师进行威胁检测、优先级排序和修复。然而,这些系统的效果不仅取决于底层模型的准确性,还取决于用户对其输出的理解与信任程度。现有算法可解释性研究多关注模型内部机制,却很少关注高风险决策场景下解释如何在用户界面中呈现。本文通过混合方法研究了AI驱动安全仪表盘中的解释设计策略,构建了解释风格分类体系,并基于安全从业者开展受控实验,对比自然语言理由、置信度可视化、反事实解释及混合方法的效果。研究发现,解释方式显著影响用户信任校准、决策准确性和认知负荷。本文贡献包括:(1)提供了安全协作者解释界面可用性的实证证据;(2)提出了将可解释性整合进企业用户界面的设计指南;(3)建立了一个与安全运营中心(SOCs)分析师需求对齐的解释策略框架。该工作推动了网络安全领域以人为本的AI工具设计,并对其他高风险领域具有广泛启示。

原文摘要 · Abstract (English)

Artificial intelligence (AI) copilots are increasingly integrated into enterprise cybersecurity platforms to assist analysts in threat detection, triage, and remediation. However, the effectiveness of these systems depends not only on the accuracy of underlying models but also on the degree to which users can understand and trust their outputs. Existing research on algorithmic explainability has largely focused on model internals, while little attention has been given to how explanations should be surfaced in user interfaces for high-stakes decision-making contexts [8], [5], [6]. We present a mixed-methods study of explanation design strategies in AI-driven security dashboards. Through a taxonomy of explanation styles and a controlled user study with security practitioners, we compare natural language rationales, confidence visualizations, counterfactual explanations, and hybrid approaches. Our findings show that explanation style significantly affects user trust calibration, decision accuracy, and cognitive load. We contribute (1) empirical evidence on the usability of explanation interfaces for security copilots, (2) design guidelines for integrating explainability into enterprise UIs, and (3) a framework for aligning explanation strategies with analyst needs in security operations centers (SOCs). This work advances the design of human-centered AI tools in cybersecurity and provides broader implications for explainability in other high-stakes domains.

AI可解释性人机协作网络安全用户界面

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。