arXiv:2604.06022cs.CL2026-04ACL被引 1

双头模型提升错误信息检测,通过注意力重构和知识增强实现更准更可解释的判断。

BiMind: A Dual-Head Reasoning Model with Attention-Geometry Adapter for Incorrect Information Detection

论文配图:BiMind: A Dual-Head Reasoning Model with Attention-Geometry Adapter for Incorrect Information Detection
图 1 · 摘自论文原文
  • 分两路推理:一路分析文本内部逻辑,一路结合外部知识
  • 新指标VoX量化知识对每条判断的贡献,最高提升2.3个点准确率
  • 适合需要高可信度内容审核的场景,如新闻平台、政策传播

错误信息严重破坏内容的真实性与完整性,现有检测方法难以在注意力坍缩背景下同时兼顾文本内容验证与外部知识补充。为此,我们提出双头推理框架BiMind,将内容内生推理与知识增强推理解耦。核心创新包括:(i) 注意力几何适配器,通过标记条件偏移重塑注意力得分,缓解注意力坍缩;(ii) 自检索知识机制,利用kNN构建领域语义记忆,并通过特征级线性调制注入邻近信息;(iii) 不确定性感知融合策略,包含熵门控融合与可训练一致性头,由对称KL散度正则项稳定。为量化知识贡献,我们引入新指标Value-of-eXperience(VoX),衡量知识增强推理带来的逐实例逻辑得分增益。在公开数据集上的实验表明,BiMind优于先进方法,并提供何时何故知识起作用的可解释诊断。

原文摘要 · Abstract (English)

Incorrect information poses significant challenges by disrupting content veracity and integrity, yet most detection approaches struggle to jointly balance textual content verification with external knowledge modification under collapsed attention geometries. To address this issue, we propose a dual-head reasoning framework, BiMind, which disentangles content-internal reasoning from knowledge-augmented reasoning. In BiMind, we introduce three core innovations: (i) an attention geometry adapter that reshapes attention logits via token-conditioned offsets and mitigates attention collapse; (ii) a self-retrieval knowledge mechanism, which constructs an in-domain semantic memory through kNN retrieval and injects retrieved neighbors via feature-wise linear modulation; (iii) the uncertainty-aware fusion strategies, including entropy-gated fusion and a trainable agreement head, stabilized by a symmetric Kullback-Leibler agreement regularizer. To quantify the knowledge contributions, we define a novel metric, Value-of-eXperience (VoX), to measure instance-wise logit gains from knowledge-augmented reasoning. Experiment results on public datasets demonstrate that our BiMind model outperforms advanced detection approaches and provides interpretable diagnostics on when and why knowledge matters.

错误检测双头模型知识增强可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。