arXiv:2609.06590cs.LGcs.AI2026-09

动态截断视觉提示,让模型自动选关键信息。

Layer-Wise Gate-Controlled Prompt Truncation in a Multimodal Chest X-Ray Classifier

  • 按层门控控制提示长度,样本自适应截断。
  • 最高验证准确率达89.96%,优于固定长度基线。
  • 适合研究提示压缩与多模态模型优化的读者。

混合提示专家(MoPE)通过输入相关的提示组合来适应多模态变换器,同时保持固定的提示长度。本文在二分类胸片分类的初步研究中,探索了分层门控扩展方法。控制器为每个样本预测保留比例,对小批量内的比例求平均,并用得到的整数长度截断静态和混合视觉提示。保留的混合提示还按个体比例缩放。每种配置记录一次运行结果,门控模型的最佳验证准确率为0.8996,固定长度基线为0.8969;对应最终值分别为0.8963和0.8802。导出的门控统计显示,在所有记录训练点上实际保留长度为1,相对于配置的最大值6。这将完整视觉序列从210个标记减少至200个,但未进行直接运行时间测量以确认加速效果。报告标签、报告文本作为输入、序列数据划分及缺乏重复受控实验限制了结果解读。研究记录了在门控惩罚配置下的提示缩短现象,但未证实样本级长度分配、优于固定短提示的性能或临床实用性。代码已公开:https://github.com/jingtaolei/mope-dynamic-prompt-truncation。

原文摘要 · Abstract (English)

Mixture of Prompt Experts (MoPE) adapts multimodal transformers through input-dependent prompt composition, while retaining a fixed prompt length. We investigate a layer-wise gating extension in a binary chest X-ray classification pilot study. The controller predicts a retention ratio for each sample, averages these ratios within a mini-batch, and uses the resulting integer length to truncate the static and mixed visual prompts. Retained mixed prompts are also scaled by the individual ratios. In one recorded run per configuration, the gated model reached a best validation accuracy of 0.8996, compared with 0.8969 for the fixed-length baseline; the corresponding final values were 0.8963 and 0.8802. The exported gate statistics imply a retained length of one at all recorded training points, relative to a configured maximum of six. This reduces the complete visual sequence from 210 to 200 tokens, but no direct runtime measurements establish an acceleration benefit. Report-derived labels, report text as input, sequential data partitioning, and the absence of repeated controlled experiments limit interpretation. The findings document prompt shortening under the configured gate penalty; they do not establish sample-specific length allocation, superiority over fixed short prompts, or clinical utility. Code is available at: https://github.com/jingtaolei/mope-dynamic-prompt-truncation.

多模态提示工程医学图像门控机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。