arXiv:2606.11489cs.RO2026-06

不修改模型权重,实时调整机器人群体行为。

Steering Multirobot Behavior via Closed-Loop Affine Activation Editing

论文配图:Steering Multirobot Behavior via Closed-Loop Affine Activation Editing
图 1 · 摘自论文原文
  • 通过闭环编辑中间激活值,动态调节机器人行为。
  • 可控制单机速度、保持编队、避开监控摄像头。
  • 适合需快速适配场景的机器人系统部署。

现实世界中的机器人需要在预训练策略之外适应新行为。微调或重新训练可能引发灾难性遗忘,损害原有性能。为此,我们提出CLAE:闭环仿射激活编辑,一种在推理阶段通过编辑中间激活值来引导冻结策略行为的框架,保持基础模型权重和下游动作头不变。CLAE将行为调控视为闭环问题,其输出会根据机器人状态、环境、目标行为和多机器人上下文在线调整激活值。该方法在冻结策略激活上训练稀疏自编码器,通过事后探测筛选出与行为相关的潜在特征,并学习一个轻量级强化学习驱动的调控策略,在推理时对选定潜在变量施加状态相关的仿射编辑。我们在一个仅训练过导航至目标点避障任务的多旋翼无人机策略上验证了CLAE。大量仿真与物理实验表明,使用CLAE后,机器人在导航过程中可实现:1)通过控制每台机器人的速度分布来调节个体行为;2)维持期望的编队结构以协调多机行为;3)生成全新行为,使机器人减少暴露于环境中监控摄像头的范围。

原文摘要 · Abstract (English)

Real-world robots need to adapt their behavior beyond the envelope of their pre-trained policy. Policy finetuning or retraining are options, but they risk catastrophic forgetting, degrading the pretrained policy's base performance. To combat this, we introduce CLAE: Closed-Loop Affine Activation Editing, an inference-time framework for steering the behavior of a frozen policy by editing intermediate activations while keeping the base policy weights and downstream action head untouched. CLAE approaches behavior steering as a closed-loop problem whose outputs edit policy activations that adapt online to the robot state, environment, target behavior, and multi-robot context. It trains a sparse autoencoder over frozen-policy activations, selects behavior-relevant latent features via post-hoc probing, and learns a lightweight RL-based steering policy that applies state-dependent affine edits to selected latents during inference. We validate CLAE on a frozen multi-quadrotor navigation policy trained to perform a single task: navigating robots to a set of goal locations while avoiding obstacles. Through extensive simulations and physical tests, we show that while navigating to their goal positions, CLAE can 1. steer individual robot behavior by controlling each robot's velocity profile; 2. coordinate multirobot behavior by preserving a desired formation; and 3. produce entirely new behavior wherein robots are required to reduce their exposure to surveillance cameras in the environment.

多机器人行为调控推理编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。