arXiv:2606.12200cs.LGcs.AI2026-06

用隐式神经表示学习无标签行为数据中的策略,无需监督即可区分不同行为模式。

Implicit Neural Representations of Individual Behavior

论文配图:Implicit Neural Representations of Individual Behavior
图 1 · 摘自论文原文
  • 将视觉隐式神经表示拓展到行为建模,以状态-动作函数形式表征策略
  • 通过层级潜在变量实现无监督策略识别,在复杂连续空间中效果最优
  • 适用于长短不一、采样粒度不同的轨迹,适合真实世界多策略混合数据

我们研究从无标签的多策略行为数据中学习策略表示。每个轨迹由固定策略生成,但策略标签不可用。该场景常见于机器人游戏、示范数据、赛车和各类未标注的行为数据集。本文提出「行为INR」,一种自监督生成模型,将视觉领域的隐式神经表示(INRs)扩展至行为建模。不同于将坐标映射为RGB值,行为INR将策略表示为状态到后续动作的函数,通过轨迹级潜在变量结合FiLM层调节该函数,从而建立策略的生成先验,实现无监督策略身份推断。由于INRs将每个数据点视为潜在函数的采样,同一模型可自然处理不同长度轨迹与异构采样粒度,如同视觉INRs支持不同图像分辨率。我们还定义了沿状态分布和动作分布轴的策略级分布外(OOD)变化,当策略在状态或动作上重叠但未被传统基于新智能体或环境的OOD设定捕捉时出现。我们在合成高斯随机场数据、带可控OOD划分的MuJoCo示范数据,以及真实世界的国际象棋、一级方程式赛车、机器人和寻避数据集上进行评估。行为INR在最困难的连续状态-动作设置中表现最佳,尤其在长轨迹、多策略及OOD划分削弱边际捷径的情况下;当策略身份可通过符号重复或低维动作统计恢复时,历史编码器仍具竞争力。代码与检查点已开源。

原文摘要 · Abstract (English)

We study policy representation learning from unlabeled multi-policy behavioral data. Each episode is generated by a fixed policy, but policy labels are unavailable. This setting appears in robotics play, demonstrations, games, racing, and other datasets where heterogeneous behaviors are mixed without annotations. We introduce \emph{Behavioral INR}, a self-supervised generative model that adapts implicit neural representations (INRs) from vision to behavior. Instead of mapping coordinates to RGB values, Behavioral INR represents a policy as a state-action function mapping states to subsequent actions. An episode-level latent modulates this function through FiLM layers, yielding a generative prior over policies and allowing policy identity to be inferred without supervision. Because INRs treat each datapoint as samples from an underlying function, the same model naturally accommodates variable episode lengths and different sampling granularities, as in vision INRs with different image resolutions. We also define policy-level out-of-distribution (OOD) shifts along state-distribution and action-distribution axes, which arise when policies overlap in states or actions but are not captured by standard behavioral OOD settings based only on new agents or environments. We evaluate on synthetic Gaussian random field data, MuJoCo demonstrations with controlled OOD splits, and real-world chess, Formula 1 racing, robotics, and Seek-Avoid datasets. Behavioral INR most consistently improves policy identifiability in the hardest continuous state-action settings, especially when longer episodes, more policies, and OOD splits reduce the usefulness of marginal shortcuts; amortized history encoders remain competitive when policy identity can be recovered from symbolic repetition or low-dimensional action statistics. We release code and checkpoints.

行为建模隐式表示无监督学习策略识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。