提出可自适应的偏见检测框架,支持多文化场景下性别、阶级等偏见识别。
ASCenD-BDS: Adaptable, Stochastic and Context-aware framework for Detection of Bias, Discrimination and Stereotyping
- 基于类别、子类、语义扩展等构建动态生成机制
- 在印度语境下验证,涵盖10类31子类,生成超800个语义模板
- 适合本地化偏见评估,尤其适用于多文化社会的AI伦理审查
大型语言模型的快速发展带来了自然语言处理的变革,但也引发了其在跨语言与跨文化应用中固有偏见的担忧。本文提出ASCenD-BDS框架(可自适应、随机性、上下文感知的偏见、歧视与刻板印象检测框架),用于检测性别、种姓、年龄、残疾、社会经济地位、语言差异等多维度偏见。现有方法依赖固定数据集(如Civil Comments、WinoGender、CrowS Pairs、BBQ等)生成测试场景,但存在场景有限的问题。本框架通过引入自适应性、随机性和上下文感知特性,突破了这一限制。上下文可定制至特定国家或文化(如组织内部文化)。本文以印度为例,基于2011年印度人口普查数据建立分类体系,采用类别、子类、语义扩展(STEM)、X因子、同义词等模块构建框架。由圣狐咨询公司团队开发出超过800个语义扩展模板,涵盖10大类、31个独特子类。该框架已在SFCLabs中作为产品开发进行验证。
原文摘要 · Abstract (English)
The rapid evolution of Large Language Models (LLMs) has transformed natural language processing but raises critical concerns about biases inherent in their deployment and use across diverse linguistic and sociocultural contexts. This paper presents a framework named ASCenD BDS (Adaptable, Stochastic and Context-aware framework for Detection of Bias, Discrimination and Stereotyping). The framework presents approach to detecting bias, discrimination, stereotyping across various categories such as gender, caste, age, disability, socioeconomic status, linguistic variations, etc., using an approach which is Adaptive, Stochastic and Context-Aware. The existing frameworks rely heavily on usage of datasets to generate scenarios for detection of Bias, Discrimination and Stereotyping. Examples include datasets such as Civil Comments, Wino Gender, WinoBias, BOLD, CrowS Pairs and BBQ. However, such an approach provides point solutions. As a result, these datasets provide a finite number of scenarios for assessment. The current framework overcomes this limitation by having features which enable Adaptability, Stochasticity, Context Awareness. Context awareness can be customized for any nation or culture or sub-culture (for example an organization's unique culture). In this paper, context awareness in the Indian context has been established. Content has been leveraged from Indian Census 2011 to have a commonality of categorization. A framework has been developed using Category, Sub-Category, STEM, X-Factor, Synonym to enable the features for Adaptability, Stochasticity and Context awareness. The framework has been described in detail in Section 3. Overall 800 plus STEMs, 10 Categories, 31 unique SubCategories were developed by a team of consultants at Saint Fox Consultancy Private Ltd. The concept has been tested out in SFCLabs as part of product development.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。