arXiv:2410.01794cs.CL2024-10被引 25

Loki是一款开源工具,帮人高效验证信息真伪。

Loki: An Open-Source Tool for Fact Verification

  • 将核实任务拆成五步流程,辅助人工判断
  • 支持快速检索证据,兼顾准确与成本
  • 适合记者、内容审核等普通用户使用

我们提出Loki,一款开源工具,用于应对虚假信息泛滥的问题。Loki采用以人为本的设计理念,在事实核查质量与人力成本之间取得平衡。其将核查任务分解为五个步骤:将长文本拆分为独立陈述、评估陈述的核查价值、生成查询语句、检索证据以及验证陈述。Loki不完全自动化,而是在每一步提供关键信息以辅助人工决策,尤其适用于记者、内容审核员等普通用户。系统在延迟、鲁棒性和成本效率方面经过优化,达到可商用水平。Loki采用MIT许可证,已在GitHub公开。我们还提供了演示视频展示系统功能。

原文摘要 · Abstract (English)

We introduce Loki, an open-source tool designed to address the growing problem of misinformation. Loki adopts a human-centered approach, striking a balance between the quality of fact-checking and the cost of human involvement. It decomposes the fact-checking task into a five-step pipeline: breaking down long texts into individual claims, assessing their check-worthiness, generating queries, retrieving evidence, and verifying the claims. Instead of fully automating the claim verification process, Loki provides essential information at each step to assist human judgment, especially for general users such as journalists and content moderators. Moreover, it has been optimized for latency, robustness, and cost efficiency at a commercially usable level. Loki is released under an MIT license and is available on GitHub. We also provide a video presenting the system and its capabilities.

事实核查开源工具信息验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。