arXiv:2508.09450cs.CL2025-08EMNLP被引 1

发现大模型生成图表摘要时会放大国家经济偏见,高收入国描述更积极。

From Charts to Fair Narratives: Uncovering and Mitigating Geo-Economic Biases in Chart-to-Text

  • 分析6000个图表-国家组合,测试大模型对不同收入国家的描述差异。
  • 高收入国家获更积极描述,即使仅改变国家属性,偏差明显存在。
  • 提示词去偏方法效果有限,需更强健的纠偏策略,适合关注公平性的研究者。

图表常用于数据探索与信息传达,但从图表中提取要点并以自然语言表达仍具挑战。图到文任务旨在通过生成文本摘要实现自动化。尽管大型视觉语言模型(VLMs)在该领域取得显著进展,但其输出中的潜在偏见却极少被关注。本文研究VLM在生成图表摘要时如何放大地理经济偏见,可能引发社会危害。我们对来自六种主流私有及开源模型的6,000个图表-国家配对进行了大规模评估,分析国家经济地位如何影响生成摘要的情感倾向。结果表明,现有VLM在高收入国家上倾向于生成更积极的描述,即使仅改变国家属性。如GPT-4o-mini、Gemini-1.5-Flash和Phi-3.5等模型均表现出不同程度的偏见。我们进一步探索基于提示词的推理时去偏技术,使用正向干扰项,但发现其仅部分有效,凸显问题复杂性及对更鲁棒去偏策略的需求。代码与数据集已公开。

原文摘要 · Abstract (English)

Charts are very common for exploring data and communicating insights, but extracting key takeaways from charts and articulating them in natural language can be challenging. The chart-to-text task aims to automate this process by generating textual summaries of charts. While with the rapid advancement of large Vision-Language Models (VLMs), we have witnessed great progress in this domain, little to no attention has been given to potential biases in their outputs. This paper investigates how VLMs can amplify geo-economic biases when generating chart summaries, potentially causing societal harm. Specifically, we conduct a large-scale evaluation of geo-economic biases in VLM-generated chart summaries across 6,000 chart-country pairs from six widely used proprietary and open-source models to understand how a country's economic status influences the sentiment of generated summaries. Our analysis reveals that existing VLMs tend to produce more positive descriptions for high-income countries compared to middle- or low-income countries, even when country attribution is the only variable changed. We also find that models such as GPT-4o-mini, Gemini-1.5-Flash, and Phi-3.5 exhibit varying degrees of bias. We further explore inference-time prompt-based debiasing techniques using positive distractors but find them only partially effective, underscoring the complexity of the issue and the need for more robust debiasing strategies. Our code and dataset are publicly available here.

大模型偏见图表生成公平性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。