arXiv:2503.03417cs.CLcs.AI2025-03ACL被引 5

测试嵌入模型对谣言修改的鲁棒性,提出有效提升方法。

When Claims Evolve: Evaluating and Enhancing the Robustness of Embedding Models Against Misinformation Edits

  • 构建自然修改生成框架,评估嵌入模型在多阶段检索中的表现。
  • 标准模型在修改后性能下降明显,大模型蒸馏模型更鲁棒但耗时高。
  • 训练与推理阶段优化可提升17%域内鲁棒性,10%跨域泛化能力。

在线虚假信息仍是重大挑战,事实核查者越来越多依赖句子嵌入模型进行相关核查文档的检索。然而,用户在浏览过程中常对声明进行修改,当前检索用的嵌入模型是否对此类修改具备鲁棒性尚不明确。为此,我们提出一种扰动框架,生成合法且自然的声明变体,用于评估多种句子嵌入模型在多阶段检索流水线中的表现,并检验各类缓解策略的有效性。评估结果显示,标准嵌入模型在修改后的声明上性能显著下降,而大语言模型蒸馏的嵌入模型虽具更好鲁棒性,但计算成本更高。尽管强重排序器能缓解性能下降,仍无法完全弥补第一阶段检索的差距。为解决此问题,我们评估了训练与推理阶段的缓解方法,证明其可使域内鲁棒性提升最多达17个百分点,跨域泛化能力提升10个百分点。总体而言,研究结果为声明匹配系统提供了实际改进方案,有助于更可靠地核查不断演变的虚假信息。代码与数据见:https://github.com/JabezNzomo99/claim-matching-robustness。

原文摘要 · Abstract (English)

Online misinformation remains a critical challenge, and fact-checkers increasingly rely on claim matching systems that use sentence embedding models to retrieve relevant fact-checks. However, as users interact with claims online, they often introduce edits, and it remains unclear whether current embedding models used in retrieval are robust to such edits. To investigate this, we introduce a perturbation framework that generates valid and natural claim variations, enabling us to assess the robustness of a wide-range of sentence embedding models in a multi-stage retrieval pipeline and evaluate the effectiveness of various mitigation approaches. Our evaluation reveals that standard embedding models exhibit notable performance drops on edited claims, while LLM-distilled embedding models offer improved robustness at a higher computational cost. Although a strong reranker helps to reduce the performance drop, it cannot fully compensate for first-stage retrieval gaps. To address these retrieval gaps, we evaluate train- and inference-time mitigation approaches, demonstrating that they can improve in-domain robustness by up to 17 percentage points and boost out-of-domain generalization by 10 percentage points. Overall, our findings provide practical improvements to claim-matching systems, enabling more reliable fact-checking of evolving misinformation. Code and data are available at https://github.com/JabezNzomo99/claim-matching-robustness.

嵌入模型谣言检测鲁棒性检索系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。