arXiv:2502.05803cs.IR2025-02中稿 · ECIR 2025, 15 page…被引 7

通过索引压缩提升事实核查中的证据检索速度,实现超10倍加速。

FlashCheck: Exploration of Efficient Evidence Retrieval for Fast Fact-Checking

  • 构建精简事实索引并结合向量量化,优化大规模知识源检索效率。
  • 在HoVer和WiCE数据集上实现CPU上10.0倍、GPU上20.0倍提速。
  • 适用于实时核查场景,开源2024总统辩论真实指控数据集。

数字工具的进展导致虚假信息泛滥。尽管事实核查旨在应对这一问题,但人工核查耗时且难以扩展。自动化核查需高效以实现实时、源头打击。现有核查流程主要由知识检索与验证两部分组成,但多数研究聚焦于验证环节,而忽略从维基百科等大型数据源中高效检索证据的问题,限制了其在实时场景的应用。本文探索从维基百科等大规模语料中构建紧凑的事实索引方法,以提升检索阶段效率,并研究向量量化对密集检索流程的加速作用。我们在HoVer和WiCE数据集上评估方法的有效性与效率,同时在2024年美国总统辩论中测试实际应用价值,并公开发布包含标注的指控集合。通过结合索引事实、密集检索与索引压缩,相比传统管道,在CPU上实现最高10.0倍加速,在GPU上超过20.0倍加速。

原文摘要 · Abstract (English)

The advances in digital tools have led to the rampant spread of misinformation. While fact-checking aims to combat this, manual fact-checking is cumbersome and not scalable. It is essential for automated fact-checking to be efficient for aiding in combating misinformation in real-time and at the source. Fact-checking pipelines primarily comprise a knowledge retrieval component which extracts relevant knowledge to fact-check a claim from large knowledge sources like Wikipedia and a verification component. The existing works primarily focus on the fact-verification part rather than evidence retrieval from large data collections, which often face scalability issues for practical applications such as live fact-checking. In this study, we address this gap by exploring various methods for indexing a succinct set of factual statements from large collections like Wikipedia to enhance the retrieval phase of the fact-checking pipeline. We also explore the impact of vector quantization to further improve the efficiency of pipelines that employ dense retrieval approaches for first-stage retrieval. We study the efficiency and effectiveness of the approaches on fact-checking datasets such as HoVer and WiCE, leveraging Wikipedia as the knowledge source. We also evaluate the real-world utility of the efficient retrieval approaches by fact-checking 2024 presidential debate and also open source the collection of claims with corresponding labels identified in the debate. Through a combination of indexed facts together with Dense retrieval and Index compression, we achieve up to a 10.0x speedup on CPUs and more than a 20.0x speedup on GPUs compared to the classical fact-checking pipelines over large collections.

事实核查检索加速向量量化实时检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。