让模型既准又可解释,还能实时响应人工干预。
SynCB: A Synergy Concept-Based Model with Dynamic Routing Between Concepts and Complementary Neural Branches
- 用动态路由选择概念分支或神经分支处理每条数据
- 在5个数据集上准确率最高提升3.9个百分点
- 适合需要可解释性与人工介入的高风险场景
基于概念(CB)的模型具有可解释性并支持测试时的人工干预,而标准神经网络虽性能强但缺乏透明度。以往工作尝试将概念与其他表示融合以提升精度,常牺牲人工干预能力。本文提出协同概念模型(SynCB),结合概念分支与互补神经分支,并引入可训练的路由模块,动态决定每个输入使用哪个分支。不同于先前融合残差与概念预测的方式,SynCB保持双分支独立,通过路由模块协调。两分支共享主干网络,实现信息交互。为增强干预响应性,还设计了测试时干预策略及其对应损失函数。在五个数据集和概念基准上,SynCB持续获得更高任务准确率,较全神经基线最高提升3.9个百分点,干预性能超越最强对手达6.43个百分点。
原文摘要 · Abstract (English)
Concept-based (CB) models provide interpretability and support test-time human intervention, while standard neural networks (NN) offer strong task performance but little transparency. Prior work has explored hybrid formulations that integrate concepts and additional representations to improve accuracy, often at the cost of human interventions. We introduce the \emph{Synergy Concept-Based Model (SynCB)} framework, that combines a CB branch with a complementary neural branch, and a trainable routing module that dynamically selects which branch to use for each input. Unlike prior models, which fuse residual and concept-based predictions, SynCB keeps the two branches distinct and coordinates them through the routing module. Moreover, both branches are learned jointly, allowing information sharing between the complementary neural branch and CB branches through their common backbone. To improve responsiveness to interventions, we further introduce a test-time intervention policy and a corresponding loss. Across five datasets and CB benchmarks, SynCB consistently achieves higher task accuracy while remaining more responsive to human interventions, surpassing the full neural baseline by up to 3.9 percentage points and exceeding the strongest competitor in intervention performance by up to 6.43 percentage points.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。