arXiv:2509.08858cs.CYcs.LG2025-09AAAI被引 11

让大模型对齐更公平:用多元参与打破少数人掌控

Decentralising LLM Alignment: A Case for Context, Pluralism, and Participation

  • 提出上下文、多元与参与三原则,推动对齐去中心化
  • 不同使用场景需差异化对齐策略,避免一刀切
  • 适合关注AI伦理与民主治理的研究者和从业者

大型语言模型(LLMs)的对齐方法被广泛认为是ChatGPT等产品商业成功的关键,其作用在于引导模型输出更符合用户预期的内容。然而,现有对齐技术主要反映少数主导群体的规范偏好,实质上将特定价值观强加于广大用户。基于权力/知识关系理论,本文指出当前对齐实践将知识生产与治理权集中在既有优势机构手中。为此,我们主张通过上下文、多元性和参与性实现对齐的去中心化。同时强调在制定对齐策略时必须明确使用场景,将三大特征落实到具体案例中。本文贡献包括:(1)阐明上下文、多元与参与在去中心化对齐中的作用;(2)提供具体实施例;(3)揭示不同使用场景下对齐的复杂需求。最终,本文将大模型对齐视为抵抗认识论不公与民主侵蚀的潜在阵地,但也承认这些策略无法替代更广泛的社会变革。

原文摘要 · Abstract (English)

Large Language Models (LLMs) alignment methods have been credited with the commercial success of products like ChatGPT, given their role in steering LLMs towards user-friendly outputs. However, current alignment techniques predominantly mirror the normative preferences of a narrow reference group, effectively imposing their values on a wide user base. Drawing on theories of the power/knowledge nexus, this work argues that current alignment practices centralise control over knowledge production and governance within already influential institutions. To counter this, we propose decentralising alignment through three characteristics: context, pluralism, and participation. Furthermore, this paper demonstrates the critical importance of delineating the context-of-use when shaping alignment practices by grounding each of these features in concrete use cases. This work makes the following contributions: (1) highlighting the role of context, pluralism, and participation in decentralising alignment; (2) providing concrete examples to illustrate these strategies; and (3) demonstrating the nuanced requirements associated with applying alignment across different contexts of use. Ultimately, this paper positions LLM alignment as a potential site of resistance against epistemic injustice and the erosion of democratic processes, while acknowledging that these strategies alone cannot substitute for broader societal changes.

大模型对齐去中心化伦理治理多元参与

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。