用因果推理分析模型对复杂成像干扰的敏感性,提升真实场景部署可靠性。
Causality-Driven Audits of Model Robustness
- 基于因果模型显式建模成像因素及其交互作用
- 仅用观测数据即可可靠估计各因素对模型性能的因果效应
- 适合关注模型在真实环境鲁棒性与安全性的研究者
深度神经网络(DNN)的鲁棒性审计有助于发现模型在现实成像条件下因复杂干扰导致的性能下降问题。这些干扰通常由环境、传感器或处理流程中多个相互作用的因素共同引起,形成难以分类的复杂图像畸变。若审计仅针对孤立的成像效应,结果难以迁移至真实场景。为此,本文提出一种新的因果驱动鲁棒性审计方法,利用因果推断量化成像过程中导致复杂畸变的各因素对DNN性能的影响。该方法通过因果模型显式编码领域相关因素及其交互假设,并在自然图像与渲染图像上跨多个视觉任务进行广泛实验,证明仅使用观测数据即可可靠估计每个因素的因果效应。这些因果效应直接关联模型敏感性与特定领域的可观测成像特性,从而降低模型在该领域部署时意外失效的风险。
原文摘要 · Abstract (English)
Robustness audits of deep neural networks (DNN) provide a means to uncover model sensitivities to the challenging real-world imaging conditions that significantly degrade DNN performance in-the-wild. Such conditions are often the result of multiple interacting factors inherent to the environment, sensor, or processing pipeline and may lead to complex image distortions that are not easily categorized. When robustness audits are limited to a set of isolated imaging effects or distortions, the results cannot be (easily) transferred to real-world conditions where image corruptions may be more complex or nuanced. To address this challenge, we present a new alternative robustness auditing method that uses causal inference to measure DNN sensitivities to the factors of the imaging process that cause complex distortions. Our approach uses causal models to explicitly encode assumptions about the domain-relevant factors and their interactions. Then, through extensive experiments on natural and rendered images across multiple vision tasks, we show that our approach reliably estimates causal effects of each factor on DNN performance using only observational domain data. These causal effects directly tie DNN sensitivities to observable properties of the imaging pipeline in the domain of interest towards reducing the risk of unexpected DNN failures when deployed in that domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。