解决触觉少样本增量学习中的环境干扰问题,提升模型泛化能力。
When Sensing Varies with Contexts: Context Probing for Tactile Few-Shot Class-Incremental Learning
- 通过上下文探针诊断触觉表征的局部变化,识别环境干扰源。
- 在HapTex和LMT108数据集上,准确率较基线提升5.2%~7.6%。
- 适用于触觉、音频等多模态少样本增量学习,尤其适合设备/状态多变场景。
少样本增量学习(FSCIL)旨在仅用少量标注样本识别新类别,同时保留已学知识。尽管现有视觉FSCIL方法进展显著,但在触觉感知中仍受限——同一材料在不同传感设备、接触状态、扫描轨迹和交互条件下会产生明显差异。在触觉FSCIL中,少样本与增量学习挑战因采集上下文而加剧:支持样本不仅稀少,且携带上下文偏差。若将此类偏差原型引入分类器,会扰动后续会话的决策边界。为此,本文提出上下文探针少样本增量学习框架(CoP-FSCIL)。该框架首先使用上下文探针干预(CPI)诊断触觉表征中的局部上下文敏感变化;再引入探针条件商适配器(PCQA)抑制探针识别出的上下文敏感成分;最后通过探针稳定性原型校准(PSPC)根据探针引发的嵌入波动估计支持样本可靠性,并相应校准随机原型。在HapTex和LMT108上的实验表明,CoP-FSCIL持续优于代表性基线,音频FSCIL的扩展实验进一步验证了上下文探针机制的通用性。代码即将发布。
原文摘要 · Abstract (English)
Few-shot class-incremental learning (FSCIL) aims to recognize novel classes from only a few labeled samples while retaining previously learned knowledge. Although recent FSCIL methods have achieved substantial progress on visual benchmarks, they remain limited in tactile sensing, where the same material may produce markedly different observations under different acquisition contexts, such as sensing devices, contact states, scanning trajectories, and interaction conditions. In tactile FSCIL, the challenges of few-shot learning and class-incremental learning are further amplified by acquisition context: the limited support samples may not only be scarce, but also carry context-induced biases. Once the resulting biased prototypes are inserted into the classifier, they may affect the decision boundaries in subsequent sessions. To address this problem, we propose Context-Probing Few-Shot Class-Incremental Learning (CoP-FSCIL), a context-aware framework for tactile FSCIL. CoP-FSCIL first employs Context-Probing Intervention (CPI) to diagnose local context-sensitive variations in tactile representations. It then introduces a Probe-Conditioned Quotient Adapter (PCQA) to suppress context-sensitive components identified by the probes. Finally, Probe-Stability Prototype Calibration (PSPC) estimates support sample reliability from probe-induced embedding fluctuations and calibrates stochastic prototypes accordingly. Experiments on HapTex and LMT108 show that CoP-FSCIL consistently outperforms representative FSCIL baselines, and extended experiments on audio FSCIL further demonstrate the generality of the proposed context probing mechanism. The source code is currently being prepared and will be released soon.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。