为大模型多智能体系统设计了沟通公平性评估框架。
Interactional Fairness in LLM Multi-Agent Systems: An Evaluation Framework
- 从组织心理学引入人际与信息公平性,构建可量化评估框架。
- 语气和解释质量影响决策,即使结果相同。
- 适用于需要公平交互的AI协作场景研究者。
随着大语言模型(LLMs)在多智能体系统中的广泛应用,公平性问题需从资源分配与程序设计扩展至智能体间的沟通公平性。本文借鉴组织心理学,提出一个包含人际公平(IF)与信息公平(InfF)的新型评估框架,将非意识智能体的公平性重构为可社会解读的信号。通过改编组织公正研究中的成熟工具——Colquitt组织公正量表与关键事件技术,将公平性视为智能体交互的行为属性进行测量。在资源协商任务的受控模拟中开展初步验证,系统操纵语气、解释质量、结果不平等及任务框架(协作或竞争),考察IF对行为的影响。结果表明,在客观结果不变时,语气和理由质量显著影响接受度;且IF与InfF的影响随情境变化而不同。该工作为多智能体系统的公平性审计与规范敏感对齐奠定了基础。
原文摘要 · Abstract (English)
As large language models (LLMs) are increasingly used in multi-agent systems, questions of fairness should extend beyond resource distribution and procedural design to include the fairness of how agents communicate. Drawing from organizational psychology, we introduce a novel framework for evaluating Interactional fairness encompassing Interpersonal fairness (IF) and Informational fairness (InfF) in LLM-based multi-agent systems (LLM-MAS). We extend the theoretical grounding of Interactional Fairness to non-sentient agents, reframing fairness as a socially interpretable signal rather than a subjective experience. We then adapt established tools from organizational justice research, including Colquitt's Organizational Justice Scale and the Critical Incident Technique, to measure fairness as a behavioral property of agent interaction. We validate our framework through a pilot study using controlled simulations of a resource negotiation task. We systematically manipulate tone, explanation quality, outcome inequality, and task framing (collaborative vs. competitive) to assess how IF influences agent behavior. Results show that tone and justification quality significantly affect acceptance decisions even when objective outcomes are held constant. In addition, the influence of IF vs. InfF varies with context. This work lays the foundation for fairness auditing and norm-sensitive alignment in LLM-MAS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。