arXiv:2603.07368cs.CLcs.AI2026-03被引 7

用数学映射和外部知识结合,让大模型输出更公平。

Position: LLMs Must Use Functor-Based and RAG-Driven Bias Mitigation for Fairness

  • 用范畴论的函数映射消除语义偏见,保持意思不变
  • 通过检索增强生成注入多元新知识,打破固有刻板印象
  • 适合关注模型公平性与可解释性的研究者使用

大型语言模型中的偏见常表现为性别、种族和地域等人口属性与职业或社会角色之间的系统性扭曲关联,强化有害刻板印象。本文主张采用双重策略缓解此类偏见:一是利用范畴论的函子变换,在保持语义完整性的前提下,将存在偏见的语义域映射为无偏的标准形式;二是结合检索增强生成(RAG),在推理阶段动态引入多样且最新的外部知识,直接对抗模型参数中根深蒂固的偏见。该综合框架融合结构化去偏与上下文知识校准,具备生成公平输出的能力。对现有文献的综述验证了两种方法各自的有效性,而针对潜在质疑的回应进一步证明了该整合策略的稳健性。因此,实现大模型公平性需兼具范畴论的数学严谨性与RAG的动态适应性。

原文摘要 · Abstract (English)

Biases in large language models (LLMs) often manifest as systematic distortions in associations between demographic attributes and professional or social roles, reinforcing harmful stereotypes across gender, ethnicity, and geography. This position paper advocates for addressing demographic and gender biases in LLMs through a dual-pronged methodology, integrating category-theoretic transformations and retrieval-augmented generation (RAG). Category theory provides a rigorous, structure-preserving mathematical framework that maps biased semantic domains to unbiased canonical forms via functors, ensuring bias elimination while preserving semantic integrity. Complementing this, RAG dynamically injects diverse, up-to-date external knowledge during inference, directly countering ingrained biases within model parameters. By combining structural debiasing through functor-based mappings and contextual grounding via RAG, we outline a comprehensive framework capable of delivering equitable and fair model outputs. Our synthesis of the current literature validates the efficacy of each approach individually, while addressing potential critiques demonstrates the robustness of this integrated strategy. Ensuring fairness in LLMs, therefore, demands both the mathematical rigor of category-theoretic transformations and the adaptability of retrieval augmentation.

大模型公平性去偏技术检索增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。