通过句子元素图提升长文本事实性验证的准确性与效率
ElementCheck: Complexity-Aware Long-Form Text Factuality Evaluation via Sentence Elements

- 按可验证连接提取实体对构成元素图,动态判断句子复杂度
- 在五个模型上均提升验证准确率,且成本可控
- 适合需要高精度事实核查的生成式AI应用
现有长文本事实性评估依赖分解-检索-验证流程,但存在断言分解噪声和固定验证粒度问题。本文提出ElementCheck,一种基于复杂度感知的框架,通过提取原始句子中显式可验证连接的实体对作为元素,构建元素图。图结构提供复杂度信号:简单句直接验证,复杂句则进行元素级精炼与验证。为支持细粒度评估,我们构建新基准FastFact-Sent,将FastFact-Bench中的独立断言映射回原句。在FastFact-Sent及两个领域专用基准上的实验表明,ElementCheck在五种主干模型上均稳定提升事实性验证性能,同时保持良好的准确率-成本权衡。进一步分析显示,复杂度感知验证减少了不必要的重复验证,并在不同模型间保持稳定性。
原文摘要 · Abstract (English)
Existing long-form factuality evaluation relies on the decompose-retrieve-verify pipeline. However, the pipeline suffers from noise from claim decomposition and fixed verification granularity, resulting in unreliable results. We propose ElementCheck, a complexity-aware framework that verifies long-form outputs via sentence elements. Instead of uniformly decomposing sentences into atomic sub-claims, ElementCheck extracts entity pairs that are explicitly linked through verifiable connections in the original sentence as elements, and organizes these into an element graph. The graph topology provides a structural signal for estimating sentence complexity, enabling direct verification for simple sentences and targeted element-level refinement and verification for complex ones. To support fine-grained evaluation, we construct a new benchmark \textbf{FastFact-Sent} by mapping isolated claims from FastFact-Bench back to their source sentences. Experiments on FastFact-Sent and two domain-specific benchmarks show ElementCheck consistently improves factuality verification across five backbone models while maintaining a favorable accuracy-cost trade-off. Further analyses demonstrate that complexity-aware verification reduces unnecessary re-verification and maintains stability across different backbones. The code is available at \href{https://github.com/gudehhh666/elementcheck.git}{Here}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。