让机器人更准抓变形物体,尤其在纹理复杂时仍能精准定位可操作区域。
TRACER: Texture-Robust Affordance Chain-of-Thought for Deformable-Object Refinement
- 分层思维链引导任务分解,实现语义到物理操作的精准映射。
- 通过边界约束机制减少预测溢出,提升功能区域的空间完整性。
- 适合需要长流程操作的机器人抓取任务,尤其对纹理多变物体有效。
机器人操作变形物体的核心挑战在于:如何在复杂外观与纹理变化下,将高层语义指令与物理交互点对齐。由于自由度极高、动态复杂且模式多样,现有视觉方法常出现边界溢出和功能区域破碎。为此,本文提出TRACER框架——一种纹理鲁棒的变形物体功能区域推理与优化系统。其核心包括:树状分层思维链(TA-CoT),将高层任务意图分解为多层级子任务语义,提供跨阶段一致指导;空间约束边界优化(SCBR)机制,抑制预测溢出,引导感知收敛至真实交互流形;以及交互收敛优化流(ICRF),聚合受外观噪声干扰的离散像素,显著提升功能区域的空间连续性与物理合理性。在Fine-AGDDO15数据集及真实机器人平台上大量实验表明,TRACER在多种纹理和图案下显著提升功能区域定位精度,并有效提高长程任务成功率,成功弥合高层语义推理与底层物理执行之间的鸿沟。代码与数据集将公开于https://github.com/Dikay1/TRACER。
原文摘要 · Abstract (English)
The central challenge in robotic manipulation of deformable objects lies in aligning high-level semantic instructions with physical interaction points under complex appearance and texture variations. Due to near-infinite degrees of freedom, complex dynamics, and heterogeneous patterns, existing vision-based affordance prediction methods often suffer from boundary overflow and fragmented functional regions. To address these issues, we propose TRACER, a Texture-Robust Affordance Chain-of-thought with dEformable-object Refinement framework, which establishes a cross-hierarchical mapping from hierarchical semantic reasoning to appearance-robust and physically consistent functional region refinement. Specifically, a Tree-structured Affordance Chain-of-Thought (TA-CoT) is formulated to decompose high-level task intentions into hierarchical sub-task semantics, providing consistent guidance across various execution stages. To ensure spatial integrity, a Spatial-Constrained Boundary Refinement (SCBR) mechanism is introduced to suppress prediction spillover, guiding the perceptual response to converge toward authentic interaction manifolds. Furthermore, an Interactive Convergence Refinement Flow (ICRF) is developed to aggregate discrete pixels corrupted by appearance noise, significantly enhancing the spatial continuity and physical plausibility of the identified functional regions. Extensive experiments conducted on the Fine-AGDDO15 dataset and a real-world robotic platform demonstrate that TRACER significantly improves affordance grounding precision across diverse textures and patterns inherent to deformable objects. More importantly, it enhances the success rate of long-horizon tasks, effectively bridging the gap between high-level semantic reasoning and low-level physical execution. The source code and dataset will be made publicly available at https://github.com/Dikay1/TRACER.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。