arXiv:2506.20876cs.CL2025-06ACL被引 2

医学事实核查需交互沟通,而非直接端到端判断。

Decide less, communicate more: On the construct validity of end-to-end fact-checking in medicine

  • 专家验证社交媒体医疗传言时,需主动沟通澄清模糊信息。
  • 真实医疗声明常与临床试验匹配困难,且真伪判断主观性强。
  • 适合医学信息传播、人机协作研究者参考。

技术进步推动了自动事实核查的进展,尤其在高风险的医疗决策领域引发关注。尽管循证医学关乎每个人,但其高度专业性导致公众医学素养不足,难以有效理解医学文献。这催生了端到端事实核查代理的需求:将声明与现有医学文献比对并返回有证据支持的结论。然而此类系统仍少被使用。本文基于专家输入,首次研究临床专家如何合成医学证据来验证社交媒体中的真实声明。在探索理想基准的过程中,揭示了医疗端到端核查的核心挑战:现实声明难以关联到临床试验;声明表述模糊且意图错配;真伪标签本身具有主观性。我们主张,事实核查应作为交互式沟通问题,而非端到端流程。

原文摘要 · Abstract (English)

Technological progress has led to concrete advancements in tasks that were regarded as challenging, such as automatic fact-checking. Interest in adopting these systems for public health and medicine has grown due to the high-stakes nature of medical decisions and challenges in critically appraising a vast and diverse medical literature. Evidence-based medicine connects to every individual, and yet the nature of it is highly technical, rendering the medical literacy of majority users inadequate to sufficiently navigate the domain. Such problems with medical communication ripen the ground for end-to-end fact-checking agents: check a claim against current medical literature and return with an evidence-backed verdict. And yet, such systems remain largely unused. In this position paper, developed with expert input, we present the first study examining how clinical experts verify real claims from social media by synthesizing medical evidence. In searching for this upper-bound, we reveal fundamental challenges in end-to-end fact-checking when applied to medicine: Difficulties connecting claims in the wild to scientific evidence in the form of clinical trials; ambiguities in underspecified claims mixed with mismatched intentions; and inherently subjective veracity labels. We argue that fact-checking should be approached as an interactive communication problem, rather than an end-to-end process.

医学信息事实核查人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。