arXiv:2504.04801cs.CV2025-04ICCV被引 3

提升多模态模型对顺序任务的理解能力,显著改善年龄、疾病分级等预测准确率。

OrderChain: Towards General Instruct-Tuning for Stimulating the Ordinal Understanding Ability of MLLM

  • 设计分步优化提示链,将顺序回归任务拆解为小范围优化子任务。
  • 在年龄估计数据集上准确率从47.5%提升至93.2%,糖尿病视网膜病变任务从30.0%升至85.7%。
  • 首次系统增强多模态模型的顺序理解能力,适合需要精准排序的应用场景。

尽管多模态大语言模型(MLLMs)取得显著进展,但在顺序回归(OR,又称顺序分类)任务上仍表现不足。本文提出OrderChain,一种新颖通用的提示范式,通过显性特异性与共性建模提升MLLM的顺序理解能力。OrderChain包含一组任务感知提示以促进多样化OR任务的特异性建模,并引入新的范围优化思维链(RO-CoT),通过统一分解为多个小范围优化子任务来学习共性推理方式。此外,提出类别递归划分(CRD)方法生成指令候选类别提示,支持RO-CoT自动优化。大量实验表明,采用OrderChain的LLaVA模型在多种OR数据集上显著优于基线:在Adience年龄估计数据集上准确率从47.5%提升至93.2%,在糖尿病视网膜病变数据集上从30.0%提升至85.7%。尤其在Adience数据集上,相比现有最优方法,准确率提升27%,平均绝对误差(MAE)降低0.24。据我们所知,OrderChain是首个系统增强MLLM处理顺序回归任务能力的工作,其有效性在广泛OR数据集上得到验证。

原文摘要 · Abstract (English)

Despite the remarkable progress of multimodal large language models (MLLMs), they continue to face challenges in achieving competitive performance on ordinal regression (OR; a.k.a. ordinal classification). To address this issue, this paper presents OrderChain, a novel and general prompting paradigm that improves the ordinal understanding ability of MLLMs by specificity and commonality modeling. Specifically, our OrderChain consists of a set of task-aware prompts to facilitate the specificity modeling of diverse OR tasks and a new range optimization Chain-of-Thought (RO-CoT), which learns a commonality way of thinking about OR tasks by uniformly decomposing them into multiple small-range optimization subtasks. Further, we propose a category recursive division (CRD) method to generate instruction candidate category prompts to support RO-CoT automatic optimization. Comprehensive experiments show that LLaVA model with our OrderChain improves baseline LLaVA significantly on diverse OR datasets, e.g., from 47.5\% to 93.2\% accuracy on the Adience dataset for age estimation, and from 30.0\% to 85.7\% accuracy on the Diabetic Retinopathy dataset. Notably, LLaVA with our OrderChain also remarkably outperforms state-of-the-art methods by 27% on accuracy and 0.24 on MAE on the Adience dataset. To our best knowledge, our OrderChain is the first work that augments MLLMs for OR tasks, and the effectiveness is witnessed across a spectrum of OR datasets. Project Page: https://order-chain.github.io/.

顺序理解多模态模型提示工程分类优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。