用大模型分析历史压迫,跨国家可比且关注身份排斥
Assessing Historical Structural Oppression Worldwide via Rule-Guided Prompting of Large Language Models
- 用规则引导提示词让大模型评估身份性历史压迫
- 在多语言新冠研究数据上验证了模型可识别细微压迫
- 适合做社会公平、公共健康等跨文化研究的学者
传统衡量历史结构性压迫的方法因各国独特排挤、殖民与社会地位历史而难以跨国家比较,且常依赖侧重物质资源的结构化指数,忽略基于身份的生活经验排斥。本文提出新框架,利用大语言模型(LLMs)生成多样地理政治背景下生活化的历史劣势评分。基于多语言新冠全球研究中的自报族裔言论,设计规则引导的提示策略,促使模型产出可解释、理论支持的压迫估计。在多个先进LLM上系统评估该策略,结果表明:在明确规则引导下,大模型能捕捉国家内部复杂的身份性历史压迫。该方法为系统性排斥提供互补测量工具,实现跨文化、可扩展的理解视角,适用于数据驱动研究与公共卫生场景。为支持可复现评估,我们开源了用于评估LLMs压迫测量能力的基准数据集(https://github.com/chattergpt/HSO-Bench)。
原文摘要 · Abstract (English)
Traditional efforts to measure historical structural oppression struggle with cross-national validity due to the unique, locally specified histories of exclusion, colonization, and social status in each country, and often have relied on structured indices that privilege material resources while overlooking lived, identity-based exclusion. We introduce a novel framework for oppression measurement that leverages Large Language Models (LLMs) to generate context-sensitive scores of lived historical disadvantage across diverse geopolitical settings. Using unstructured self-identified ethnicity utterances from a multilingual COVID-19 global study, we design rule-guided prompting strategies that encourage models to produce interpretable, theoretically grounded estimations of oppression. We systematically evaluate these strategies across multiple state-of-the-art LLMs. Our results demonstrate that LLMs, when guided by explicit rules, can capture nuanced forms of identity-based historical oppression within nations. This approach provides a complementary measurement tool that highlights dimensions of systemic exclusion, offering a scalable, cross-cultural lens for understanding how oppression manifests in data-driven research and public health contexts. To support reproducible evaluation, we release an open-sourced benchmark dataset for assessing LLMs on oppression measurement (https://github.com/chattergpt/HSO-Bench).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。