一个神经网络同时实现机器人运动生成、行为识别和置信度估计
CERNet: Class-Embedding Predictive-Coding RNN for Unified Robot Motion, Recognition, and Confidence Estimation
- 用动态更新的类别嵌入向量统一控制运动生成与行为识别
- 在26个字母动作上误差比基线低76%,识别准确率达Top-1 68%
- 内置预测误差可直接反映模型置信度,适合人机协作场景
机器人与人类交互需实时生成动作、推断行为意图并评估自身判断的置信度。本文提出统一模型CERNet,基于分层预测编码循环神经网络(PC-RNN)与类别嵌入向量,整合运动生成、行为识别与置信度估计。模型在生成模式下,类别嵌入约束隐藏状态至特定子空间;在推理模式下,在线优化嵌入以最小化预测误差,实现实时识别。在拟人机器人上对26个动力学教学字母进行验证,其轨迹重建误差比参数匹配的单层基线低76%,在外部扰动下仍保持运动保真性,且在线识别准确率为Top-1 68%、Top-2 81%。内部预测误差自然反映模型置信度。该框架将鲁棒生成、实时识别与内在不确定性估计集成于紧凑的PC-RNN中,为物理机器人提供可扩展的运动记忆方案,适用于意图敏感的人机协作。
原文摘要 · Abstract (English)
Robots interacting with humans must not only generate learned movements in real-time, but also infer the intent behind observed behaviors and estimate the confidence of their own inferences. This paper proposes a unified model that achieves all three capabilities within a single hierarchical predictive-coding recurrent neural network (PC-RNN) equipped with a class embedding vector, CERNet, which leverages a dynamically updated class embedding vector to unify motor generation and recognition. The model operates in two modes: generation and inference. In the generation mode, the class embedding constrains the hidden state dynamics to a class-specific subspace; in the inference mode, it is optimized online to minimize prediction error, enabling real-time recognition. Validated on a humanoid robot across 26 kinesthetically taught alphabets, our hierarchical model achieves 76% lower trajectory reproduction error than a parameter-matched single-layer baseline, maintains motion fidelity under external perturbations, and infers the demonstrated trajectory class online with 68% Top-1 and 81% Top-2 accuracy. Furthermore, internal prediction errors naturally reflect the model's confidence in its recognition. This integration of robust generation, real-time recognition, and intrinsic uncertainty estimation within a compact PC-RNN framework offers a compact and extensible approach to motor memory in physical robots, with potential applications in intent-sensitive human-robot collaboration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。