arXiv:2510.22017cs.LGcs.CY2025-10

将机构信任引入强化学习,提升政策在社区的接受度。

Do You Trust the Process?: Modeling Institutional Trust for Community Adoption of Reinforcement Learning Policies

  • 用深度确定性策略梯度建模资源分配,融合社区信任变化
  • 信任机制使政策更公平,尤其在目标不确定时效果显著
  • 外部配额可改善公平性但降低组织效率,揭示权衡关系

许多政府机构正采用人工智能政策进行决策,其中强化学习被用于设计公民预期会遵守的政策。然而,先前研究表明,若缺乏机构信任,公民不会遵循政府制定的政策。本文针对人道主义工程中的资源分配问题,提出一种考虑机构信任的强化学习算法。采用深度确定性策略梯度方法学习资源分配策略,并模拟执行过程中社区成员信任水平的变化。研究发现,将信任纳入算法可提升政策成功率,尤其当组织目标不明确时。保守的信任估计能提高公平性和平均信任度,但削弱组织成效。进一步引入外部实体设定配额机制,当组织服务人数不足时降低其效用,可在某些情况下提升公平性与信任,但会减少组织成功。本工作强调了机构信任在算法设计中的关键作用,并揭示组织成功与社区福祉间的矛盾。

原文摘要 · Abstract (English)

Many governmental bodies are adopting AI policies for decision-making. In particular, Reinforcement Learning has been used to design policies that citizens would be expected to follow if implemented. Much RL work assumes that citizens follow these policies, and evaluate them with this in mind. However, we know from prior work that without institutional trust, citizens will not follow policies put in place by governments. In this work, we develop a trust-aware RL algorithm for resource allocation in communities. We consider the case of humanitarian engineering, where the organization is aiming to distribute some technology or resource to community members. We use a Deep Deterministic Policy Gradient approach to learn a resource allocation that fits the needs of the organization. Then, we simulate resource allocation according to the learned policy, and model the changes in institutional trust of community members. We investigate how this incorporation of institutional trust affects outcomes, and ask how effectively an organization can learn policies if trust values are private. We find that incorporating trust into RL algorithms can lead to more successful policies, specifically when the organization's goals are less certain. We find more conservative trust estimates lead to increased fairness and average community trust, though organization success suffers. Finally, we explore a strategy to prevent unfair outcomes to communities. We implement a quota system by an external entity which decreases the organization's utility when it does not serve enough community members. We find this intervention can improve fairness and trust among communities in some cases, while decreasing the success of the organization. This work underscores the importance of institutional trust in algorithm design and implementation, and identifies a tension between organization success and community well-being.

强化学习机构信任资源分配公平性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。