让复杂说法分层解析,自动提炼观点与证据分布
Beyond True or False: Retrieval-Augmented Hierarchical Analysis of Nuanced Claims
- 用检索增强生成构建说法的层级结构,逐层拆解核心要素
- 可识别各子方面支持/反对观点及其在文献中的占比数据
- 适合科研、政策分析等需深度评估复杂陈述的场景
个体或组织提出的主张往往具有细微差异,难以简单归为完全‘真’或‘假’,尤其在科学和政治领域常见。例如‘疫苗A比疫苗B更好’这一说法,可拆解为有效性、安全性、可及性等子维度,每个维度更易验证。为此,我们提出ClaimSpect框架,基于检索增强生成技术,自动构建主张的层级结构,并注入语料库中的具体视角。该框架通过分层检索相关文本段落,发现新子维度,同时量化不同观点(如支持、中立、反对)在文献中的出现频率。我们在自建数据集上对多种真实世界的科学与政治主张进行了测试,验证了其在分解复杂主张和呈现语料内观点分布上的鲁棒性与准确性。通过案例研究与人工评估,其性能优于多个基线模型。
原文摘要 · Abstract (English)
Claims made by individuals or entities are oftentimes nuanced and cannot be clearly labeled as entirely "true" or "false" -- as is frequently the case with scientific and political claims. However, a claim (e.g., "vaccine A is better than vaccine B") can be dissected into its integral aspects and sub-aspects (e.g., efficacy, safety, distribution), which are individually easier to validate. This enables a more comprehensive, structured response that provides a well-rounded perspective on a given problem while also allowing the reader to prioritize specific angles of interest within the claim (e.g., safety towards children). Thus, we propose ClaimSpect, a retrieval-augmented generation-based framework for automatically constructing a hierarchy of aspects typically considered when addressing a claim and enriching them with corpus-specific perspectives. This structure hierarchically partitions an input corpus to retrieve relevant segments, which assist in discovering new sub-aspects. Moreover, these segments enable the discovery of varying perspectives towards an aspect of the claim (e.g., support, neutral, or oppose) and their respective prevalence (e.g., "how many biomedical papers believe vaccine A is more transportable than B?"). We apply ClaimSpect to a wide variety of real-world scientific and political claims featured in our constructed dataset, showcasing its robustness and accuracy in deconstructing a nuanced claim and representing perspectives within a corpus. Through real-world case studies and human evaluation, we validate its effectiveness over multiple baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。