用可解释的连续评分,帮用户识别网页内容的可信度。
TRACE: Transparent Web Reliability Assessment with Contextual Explanations
- 基于14万条文本训练的模型,给出0.1到1.0的连续可信度分。
- 在多个回归指标上优于小规模大模型和规则方法。
- 提供上下文解释,适合关注信息真实性的人使用。
在人工智能生成虚假信息泛滥的背景下,现有工具难以为用户提供细致、透明的内容可信度评估。它们常以二元(真/假)判断为主,缺乏上下文依据,使用户易受误导。本文提出TRACE:一种带上下文解释的透明可信度评估框架,能对网页内容进行细粒度连续评分(0.1–1.0)并生成解释。核心是经过大规模数据微调的TrueGL-1B模型,其训练数据来自超过14万篇文章,采用人机协作与数据污染范式标注了35种连续可信度分数,填补了中间范围标签的空白。在评估中,TrueGL-1B在均方误差(MAE)、均方根误差(RMSE)和决定系数(R²)等关键回归指标上持续优于其他小型语言模型和基于规则的方法。模型高精度与可解释性使可信信息更易获取。代码与模型已公开于github.com/zade90/TrueGL。
原文摘要 · Abstract (English)
In an era of AI-generated misinformation flooding the web, existing tools struggle to empower users with nuanced, transparent assessments of content credibility. They often default to binary (true/false) classifications without contextual justifications, leaving users vulnerable to disinformation. We address this gap by introducing TRACE: Transparent Reliability Assessment with Contextual Explanations, a unified framework that performs two key tasks: (1) it assigns a fine-grained, continuous reliability score (from 0.1 to 1.0) to web content, and (2) it generates a contextual explanation for its assessment. The core of TRACE is the TrueGL-1B model, fine-tuned on a novel, large-scale dataset of over 140,000 articles. This dataset's primary contribution is its annotation with 35 distinct continuous reliability scores, created using a Human-LLM co-creation and data poisoning paradigm. This method overcomes the limitations of binary-labeled datasets by populating the mid-ranges of reliability. In our evaluation, TrueGL-1B consistently outperforms other small-scale LLM baselines and rule-based approaches on key regression metrics, including MAE, RMSE, and R2. The model's high accuracy and interpretable justifications make trustworthy information more accessible. To foster future research, our code and model are made publicly available here: github.com/zade90/TrueGL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。