用AI自动识别并消除新闻中的偏见,提升报道公正性。
Neutralizing the Narrative: AI-Powered Debiasing of Online News Articles
- 用大模型分段检测新闻偏见,结合人工验证建立标准答案
- GPT-4o Mini在检测和去偏上表现最佳,效果经人工复核确认
- 发现媒体偏见随政治与社会事件变化,适合媒体机构与研究者参考
新闻报道中的偏见严重影响公众认知,尤其涉及犯罪、政治和社会议题。传统依赖人工审核的方法存在主观性强、难以扩展的问题。本文提出一个基于先进大语言模型(LLMs)的AI框架,使用GPT-4o、GPT-4o Mini、Gemini Pro、Gemini Flash、Llama 8B和Llama 3B,系统识别并缓解新闻文章中的偏见。我们收集了2013至2023年间来自五个政治立场各异新闻源的超3万篇犯罪相关文章构成数据集。方法分为两阶段:(1) 偏见检测,各LLM在段落级评分并提供理由,通过人工评估确立真实标签;(2) 使用GPT-4o Mini进行迭代去偏,经自动化重评与人工审核验证。实证结果表明,GPT-4o Mini在偏见检测准确率与去偏效果上均最优。此外,分析揭示媒体偏见存在时间和地域差异,与社会政治动态及现实事件密切相关。本研究推动了可扩展的计算去偏方法,促进新闻报道的公平与问责。
原文摘要 · Abstract (English)
Bias in news reporting significantly impacts public perception, particularly regarding crime, politics, and societal issues. Traditional bias detection methods, predominantly reliant on human moderation, suffer from subjective interpretations and scalability constraints. Here, we introduce an AI-driven framework leveraging advanced large language models (LLMs), specifically GPT-4o, GPT-4o Mini, Gemini Pro, Gemini Flash, Llama 8B, and Llama 3B, to systematically identify and mitigate biases in news articles. To this end, we collect an extensive dataset consisting of over 30,000 crime-related articles from five politically diverse news sources spanning a decade (2013-2023). Our approach employs a two-stage methodology: (1) bias detection, where each LLM scores and justifies biased content at the paragraph level, validated through human evaluation for ground truth establishment, and (2) iterative debiasing using GPT-4o Mini, verified by both automated reassessment and human reviewers. Empirical results indicate GPT-4o Mini's superior accuracy in bias detection and effectiveness in debiasing. Furthermore, our analysis reveals temporal and geographical variations in media bias correlating with socio-political dynamics and real-world events. This study contributes to scalable computational methodologies for bias mitigation, promoting fairness and accountability in news reporting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。