arXiv:2608.07558cs.ROcs.CV2026-08综述

系统梳理触觉与力觉感知的机器人学习方法,构建统一分析框架。

Learning Physical Interaction: A Survey of Tactile- and Force-aware Robot Learning

论文配图:Learning Physical Interaction: A Survey of Tactile- and Force-aware Robot Learning
图 1 · 摘自论文原文
  • 提出TF-ART分类框架,整合多模态感知与多阶段控制架构
  • 揭示触觉/力觉信息在动作生成与优化中的关键作用
  • 适合研究机器人感知、控制与智能交互的学者参考

具备物理交互能力的机器人智能需要其能够感知、推理并调控与物理世界之间的互动。在接触敏感的操作任务中,任务成功不仅依赖视觉感知和运动生成,还需力调节与自适应控制。近年来,机器人学习方法通过融合力觉、触觉、视觉、语言和本体感觉,显著提升了操控性能。许多系统采用多阶段架构,结合高层策略、动作精炼模块与底层控制器,实现语义理解与实时物理执行的衔接。然而,现有综述未从统一视角系统涵盖多模态感知与多阶段设计。本文提出TF-ART(触觉/力觉感知机器人学习分类体系),将各类方法映射至统一分层结构,分析其如何组织观测模态、融合异构传感输入、跨阶段生成与精炼动作,并连接学习策略与反应式末端控制。基于该方法论视角,进一步探讨物理交互的任务设定与基础设施需求,综合算法与实践双重维度,推动力觉与触觉感知机器人学习的发展。

原文摘要 · Abstract (English)

Physically grounded robot intelligence requires robots to perceive, reason about, and regulate their interactions with the physical world. This capability is particularly critical in contact-sensitive manipulation, where successful task execution depends not only on visual perception and motion generation, but also on force regulation and adaptive control. In this context, recent robot learning methods have made substantial progress by integrating force, tactile, vision, language, and proprioceptive sensing into learned manipulation policies. In parallel, many systems adopt multi-phase architectures that combine high-level policies, action-refinement modules, and low-level controllers to bridge semantic task understanding with reactive physical execution. Despite these advances, existing surveys have not explicitly reviewed force- and tactile-aware robot learning from a unified perspective that jointly captures multimodal sensing and multi-phase system design. This survey addresses this gap by proposing TF-ART, a Tactile/Force-Aware Robot learning Taxonomy for multimodal and multi-phase frameworks, which maps individual methods into a unified hierarchical structure. The framework characterizes how recent works organize observation modalities, encode and fuse heterogeneous sensory inputs, generate and refine actions across multiple phases, and connect learned policies to reactive robot-end control. Building on this methodological view, we further examine the task settings and infrastructure requirements of physical interaction, thereby integrating both algorithmic and practical perspectives on force- and tactile-aware robot learning.

机器人学习触觉感知力觉控制多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。