解决食物识别中类别样本和新增类数量双重不均衡问题。
Dual-Imbalance Continual Learning for Real-World Food Recognition
- 用轻量适配器与谱融合策略应对两类不均衡挑战。
- 在真实长尾数据集上比现有方法提升超3%准确率。
- 适合需要持续学习的新食物类别系统部署。
真实饮食记录中的视觉食物识别普遍存在严重数据不平衡:少数食物类别频繁出现,而大量类别稀少,形成长尾分布。实际应用中,食物识别常以持续学习方式运行,新类别逐阶段引入。但现有研究通常假设每步引入相近数量的新类别,这与现实严重不符——各阶段新类别数量差异显著,导致学习动态极不均衡。因此,持续食物识别面临双重不平衡:类内样本不均,以及各阶段新增类别数量不均。本文提出DIME框架,通过参数高效微调为每阶段学习轻量适配器,并采用基于类别数量引导的谱融合策略逐步整合。进一步引入按秩阈值调制机制,稳定融合过程,保留主导知识并支持自适应更新。最终模型仅保留单一合并适配器用于推理,实现高效部署且无需累积任务专属模块。在本文构建的步长不均衡设置下,多个真实长尾食物基准测试显示,该方法相比最强现有持续学习基线平均提升超过3%。代码已开源。
原文摘要 · Abstract (English)
Visual food recognition in real-world dietary logging scenarios naturally exhibits severe data imbalance, where a small number of food categories appear frequently while many others occur rarely, resulting in long-tailed class distributions. In practice, food recognition systems often operate in a continual learning setting, where new categories are introduced sequentially over time. However, existing studies typically assume that each incremental step introduces a similar number of new food classes, which rarely happens in real world where the number of newly observed categories can vary significantly across steps, leading to highly uneven learning dynamics. As a result, continual food recognition exhibits a dual imbalance: imbalanced samples within each food class and imbalanced numbers of new food classes to learn at each incremental learning step. In this work, we introduce DIME, a Dual-Imbalance-aware Adapter Merging framework for continual food recognition. DIME learns lightweight adapters for each task using parameter-efficient fine-tuning and progressively integrates them through a class-count guided spectral merging strategy. A rank-wise threshold modulation mechanism further stabilizes the merging process by preserving dominant knowledge while allowing adaptive updates. The resulting model maintains a single merged adapter for inference, enabling efficient deployment without accumulating task-specific modules. Experiments on realistic long-tailed food benchmarks under our step-imbalanced setup show that the proposed method consistently improves by more than 3% over the strongest existing continual learning baselines. Code is available at https://github.com/xiaoyanzhang1/DIME.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。