让提示词动态调整模型计算路径,提升小样本任务适应能力
PromptPath: Prompt-Adaptive Computational Pathways for In-Context Learning

- 用提示词驱动路由机制,动态组合轻量级专家形成任务专属路径
- 在点云与图像识别任务上超越现有最先进基线,通用性强
- 适合关注小样本学习可解释性与动态推理的研究者
上下文学习(ICL)因仅需少量输入-输出示例即可让模型执行新任务而受到关注。然而,现有方法存在浅层任务适配问题:提示词仅作为语义线索隐式推断任务意图,底层计算过程保持不变,限制了任务特异性与推理可解释性。本文认为提示词应不仅调节特征表示,还应动态调控模型的计算路径。为此提出 PromptPath,一种通过提示条件化动态路径实现计算级适配的框架。具体而言,该框架引入提示驱动的路由机制,选择性激活并组合轻量级低秩专家,构建针对不同提示的任务专属计算路径。通过将提示信息直接融入推理过程,PromptPath 动态重构模型计算以增强任务特异性和可解释性。在 3D 点云与 2D 视觉识别基准上的大量实验表明,PromptPath 持续优于当前最优的 ICL 基线,并展现出强大的跨领域与跨任务泛化能力。
原文摘要 · Abstract (English)
In-context learning (ICL) has attracted increasing attention for enabling models to perform new tasks using only a few ``input--output'' prompt examples. However, existing approaches suffer from \textbf{shallow task adaptation}, where prompts are primarily used as contextual cues to implicitly infer task intent through semantic representations, while the underlying computational process remains unchanged. This limitation restricts task-specific adaptation and compromises inference interpretability. We argue that prompts should not only condition feature representations but also dynamically regulate the model's computation pathways. To this end, we propose \textbf{PromptPath}, an adaptive ICL framework that enables computation-level adaptation through prompt-conditioned dynamic pathways. Specifically, PromptPath introduces a prompt-driven routing mechanism to selectively activate and compose lightweight low-rank experts, forming task-specific computational pathways tailored to different prompts. By integrating prompt information directly into the inference process, PromptPath dynamically reconfigures model computation to enhance task specialization and interpretability. Extensive experiments on 3D point cloud and 2D visual recognition benchmarks demonstrate that PromptPath consistently outperforms state-of-the-art ICL baselines while exhibiting strong cross-domain and cross-task generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。