arXiv:2507.15895cs.AIcs.CY2025-07被引 1

让智能体通过推理做出道德决策,提升机器人伦理可靠性。

Integrating Reason-Based Moral Decision-Making in the Reinforcement Learning Architecture

  • 在强化学习中引入基于理由的道德理论,通过案例反馈学习
  • 实验验证了该框架能有效引导智能体遵循道德义务
  • 适合研发具伦理能力的自动驾驶、人形机器人等系统

强化学习在各类任务中表现优异,是构建自主智能体的核心方法。随着这些智能体(如人形机器人或自动驾驶汽车)逐步走向实际应用,其行为的伦理合规性成为关键要求。本文提出一种基于推理的人工道德代理(RBAMA),通过扩展强化学习架构,使智能体具备学习‘理由理论’的能力——即处理道德相关命题并推导道德义务。该机制通过案例反馈进行训练,使智能体在完成任务的同时动态调整行为以符合道德义务。实验验证了该方法在初步测试中的可行性,展现出更高的道德可辩护性、鲁棒性与可信度,为实现符合核心伦理标准的智能体提供了一个具体且可部署的框架。

原文摘要 · Abstract (English)

Reinforcement Learning is a machine learning methodology that has demonstrated strong performance across a variety of tasks. In particular, it plays a central role in the development of artificial autonomous agents. As these agents become increasingly capable, market readiness is rapidly approaching, which means those agents, for example taking the form of humanoid robots or autonomous cars, are poised to transition from laboratory prototypes to autonomous operation in real-world environments. This transition raises concerns leading to specific requirements for these systems - among them, the requirement that they are designed to behave ethically. Crucially, research directed toward building agents that fulfill the requirement to behave ethically - referred to as artificial moral agents(AMAs) - has to address a range of challenges at the intersection of computer science and philosophy. This study explores the development of reason-based artificial moral agents (RBAMAs). RBAMAs are build on an extension of the reinforcement learning architecture to enable moral decision-making based on sound normative reasoning, which is achieved by equipping the agent with the capacity to learn a reason-theory - a theory which enables it to process morally relevant propositions to derive moral obligations - through case-based feedback. They are designed such that they adapt their behavior to ensure conformance to these obligations while they pursue their designated tasks. These features contribute to the moral justifiability of the their actions, their moral robustness, and their moral trustworthiness, which proposes the extended architecture as a concrete and deployable framework for the development of AMAs that fulfills key ethical desiderata. This study presents a first implementation of an RBAMA and demonstrates the potential of RBAMAs in initial experiments.

道德智能体强化学习伦理决策

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。