arXiv:2508.18188cs.CVcs.AI2025-08被引 1

让视觉AI决策过程可解释,支持实时监控与异常检测。

Explain and Monitor Deep Learning Models for Computer Vision using Obz AI

  • 构建端到端的可解释性与可观测性软件平台
  • 支持特征分析和模型运行时持续监控
  • 适合需要透明化部署的医疗、安防等场景

深度学习已彻底改变计算机视觉领域,在分类、分割等任务上表现卓越。当前基于CNN和视觉变换器(ViTs)的主流模型常被视为“黑箱”,缺乏决策过程的透明度。尽管可解释人工智能(XAI)已有进展,但在实际视觉系统部署中仍鲜有应用。主要瓶颈在于缺少将XAI技术与知识管理、监控框架整合的软件工具。为此,我们开发了Obz AI——一个完整的软件生态,旨在实现视觉AI系统的前沿可解释性与可观测性。Obz AI提供从Python客户端库到全栈分析仪表盘的无缝集成流程,使机器学习工程师能够轻松引入先进XAI方法,提取并分析特征以检测异常,并实现模型的实时持续监控。通过揭示深度模型的决策机制,Obz AI推动了视觉AI系统的可观测性与负责任部署。

原文摘要 · Abstract (English)

Deep learning has transformed computer vision (CV), achieving outstanding performance in classification, segmentation, and related tasks. Such AI-based CV systems are becoming prevalent, with applications spanning from medical imaging to surveillance. State of the art models such as convolutional neural networks (CNNs) and vision transformers (ViTs) are often regarded as ``black boxes,'' offering limited transparency into their decision-making processes. Despite a recent advancement in explainable AI (XAI), explainability remains underutilized in practical CV deployments. A primary obstacle is the absence of integrated software solutions that connect XAI techniques with robust knowledge management and monitoring frameworks. To close this gap, we have developed Obz AI, a comprehensive software ecosystem designed to facilitate state-of-the-art explainability and observability for vision AI systems. Obz AI provides a seamless integration pipeline, from a Python client library to a full-stack analytics dashboard. With Obz AI, a machine learning engineer can easily incorporate advanced XAI methodologies, extract and analyze features for outlier detection, and continuously monitor AI models in real time. By making the decision-making mechanisms of deep models interpretable, Obz AI promotes observability and responsible deployment of computer vision systems.

可解释AI视觉模型模型监控软件平台

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。