用信息瓶颈理论减少机器人视觉模仿中的冗余,提升泛化能力。
Rethinking Latent Redundancy in Behavior Cloning: An Information Bottleneck Approach for Robot Manipulation
- 引入信息瓶颈原则,压缩无关信息保留任务关键特征。
- 在CortexBench和LIBERO上性能显著提升,验证理论有效性。
- 适合关注机器人模仿学习泛化与表征优化的研究者。
行为克隆(BC)是机器人操作中广泛使用的视觉模仿学习方法。现有方法通过大规模数据集及多模态信息提升泛化能力,但忽视了学习表征中的冗余问题,且缺乏理论指导。本文从信息论视角出发,引入互信息量化并抑制潜在表征冗余,将信息瓶颈(IB)原则融入BC,构建结构化框架以压缩无关信息、保留任务相关特征。这是首个系统研究不同方法、主干网络与实验设置下潜在表征冗余的工作,并拓展了IB在BC中的适用性。在CortexBench与LIBERO基准上的大量实验表明,引入IB后性能显著提升,凸显减少输入冗余的重要性及其对实际应用的实用价值。
原文摘要 · Abstract (English)
Behavior Cloning (BC) is a widely adopted visual imitation learning method in robot manipulation. Current BC approaches often enhance generalization by leveraging large datasets and incorporating additional visual and textual modalities to capture more diverse information. However, these methods overlook whether the learned representations contain redundant information and lack a solid theoretical foundation to guide the learning process. To address these limitations, we adopt an information-theoretic perspective and introduce mutual information to quantify and mitigate redundancy in latent representations. Building on this, we incorporate the Information Bottleneck (IB) principle into BC, which extends the idea of reducing redundancy by providing a structured framework for compressing irrelevant information while preserving task-relevant features. This work presents the first comprehensive study on redundancy in latent representations across various methods, backbones, and experimental settings, while extending the generalizability of the IB to BC. Extensive experiments and analyses on the CortexBench and LIBERO benchmarks demonstrate significant performance improvements with IB, underscoring the importance of reducing input data redundancy and highlighting its practical value for more practical applications. Project Page: https://baishuanghao.github.io/BC-IB.github.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。